Storebot-Google — shopping crawler
Storebot-Google is the Google crawler associated with shopping experiences, used to crawl product and shopping-related pages. Google documents it among its crawlers with its own user-agent token, so operators can recognise shopping-related crawling distinctly from general Googlebot indexing.
What this means
Storebot-Google is the Google crawler associated with shopping experiences. It crawls product and shopping-related pages to support Google Shopping surfaces. Google lists it among its crawlers with its own user-agent token, distinct from the main Googlebot used for general web indexing.
For retail and product sites, recognising Storebot-Google explains crawling that targets product pages specifically, separate from ordinary indexing.
robots.txt considerations
Storebot-Google honours robots.txt. To control shopping-related crawling independently, target the Storebot-Google token. Verify suspect requests using Google's reverse-DNS and published IP-range method, since the user agent is spoofable. Match on the stable token rather than a version string.
- User-agent token: Storebot-Google
- Crawls product/shopping content for Google Shopping
- Verify via reverse DNS to googlebot.com / google.com
How it appears in analytics and logs
A request carrying the Storebot-Google token is Google crawling product or shopping-related content — a bot event tied to Google Shopping surfaces, not general web indexing and not a human visit.
Diagnostic use case
Recognise Storebot-Google hits as shopping-related crawling and control it via robots.txt independently of general Googlebot indexing.
What WebmasterID can help detect
WebmasterID classifies Storebot-Google server-side as search-crawler activity and shows it separately from human traffic, so shopping-related crawl coverage is visible without log parsing.
Common mistakes
- Assuming a Googlebot rule is the only Google token affecting product pages.
- Counting shopping-crawl hits as human visits or conversions.
- Trusting the user agent without reverse-DNS or IP verification.
Privacy and accuracy notes
Identification uses the user agent plus Google's reverse-DNS/IP verification — no human identity. WebmasterID records Storebot-Google as a bot event, separate from human analytics.
Related pages
- Googlebot Smartphone — Google's mobile-first crawler
Googlebot Smartphone is the mobile user-agent variant of Googlebot and, under mobile-first indexing, Google's primary crawler for most sites. It uses the Googlebot robots.txt token and can be verified through reverse DNS and Google's published crawler IP ranges.
- AdsBot-Google — Google Ads landing-page checker
AdsBot-Google is the Google crawler that checks the quality of web pages used as Google Ads landing pages. Google documents that AdsBot crawlers may ignore the global robots.txt wildcard group, so to control them you target the AdsBot-Google token explicitly.
- Bot intelligence
See search-engine crawlers separated from human traffic.
Sources and verification notes
- Google — Google crawlers (user agents) overviewLists Storebot-Google among Google's crawlers and its shopping role.
Last reviewed 2026-06-24. Facts are checked against primary/official sources where available; uncertain specifics are marked “Data not yet verified” rather than guessed.