Shopzilla crawler
Shopzilla is a long-running shopping-comparison brand (part of the Connexity/Kit network of comparison and retail-media services) that aggregates product offers and prices for shoppers. Its data collection combines merchant feeds with crawling of retailer product pages to read prices and availability. It is a commerce/shopping crawler rather than a search engine building a public web index.
What this means
Shopzilla aggregates retail product offers so shoppers can compare prices, as part of the broader Connexity/Kit comparison and retail-media network. To populate listings it relies on merchant feeds and, where needed, crawling of retailer product pages.
If you run an online store and participate in this network, related crawling may fetch your product pages to read price and stock. This is commerce-focused data collection, not general web search indexing.
How it identifies itself
Shopzilla-related crawling carries a comparison-network user-agent. Because Shopzilla operates within the Connexity/Kit family and relies heavily on merchant feeds, and its exact public crawler token and IP ranges are not exhaustively documented, this entry is marked partially verified; the shopping-comparison purpose and network identity are the reliable signals.
As with any crawler, the user-agent is a claim and can be copied. Corroborate with behaviour where authenticity matters.
- Brand: Shopzilla (Connexity/Kit comparison network)
- Scope: retailer product offers — price and availability
- Relies heavily on merchant feeds plus crawling
robots.txt considerations
To express a crawl preference, target the documented comparison-network user-agent token in robots.txt. Because much offer data comes from merchant feeds, blocking a direct crawler may not remove feed-supplied listings.
robots.txt is honoured by compliant crawlers and is not an access control.
How it appears in analytics and logs
A Shopzilla-related request means a shopping-comparison service fetched your product page to read price and availability. It is commerce crawl traffic, not a human shopper and not a search-index crawl.
Diagnostic use case
Recognise Shopzilla-related commerce crawling in logs, distinguish shopping comparison from search indexing, and set policy for a product-offer aggregator.
What WebmasterID can help detect
WebmasterID classifies Shopzilla-related crawling server-side as a commerce/price-comparison bot and surfaces it on the bot-intelligence surface, so price-crawl coverage stays separate from human shopper analytics.
Common mistakes
- Treating a shopping-comparison crawler as a search engine indexing your catalogue.
- Blocking the crawler while still supplying offers via a merchant feed.
- Counting commerce crawl hits as human shoppers in analytics.
Privacy and accuracy notes
Identification uses only the request user-agent. No visitor identity is involved. WebmasterID records the fetch as a bot event, separate from human analytics, and never attaches it to a profile.
Related pages
- Price-comparison and shopping crawlers — overview
Price-comparison and shopping crawlers fetch retailer product pages to read prices, availability, and product details for comparison platforms. This overview explains how Idealo, PriceRunner, and Shopzilla operate, why they combine crawling with structured merchant feeds, and how retailers should set policy. They build offer-comparison datasets, not a general search index, so their crawling reflects offer-refresh cadence.
- Idealo price-comparison crawler
Idealo is a major European price-comparison platform, particularly in Germany, that aggregates product offers so shoppers can compare prices across retailers. Its crawler fetches retailer and merchant product pages to read prices, availability, and product details for that comparison. It is a shopping/commerce crawler, not a search engine, and operates alongside merchant feeds rather than building a general web index.
- PriceRunner crawler
PriceRunner is a price-comparison platform, strong across the Nordics and Europe, that helps shoppers compare prices and offers across retailers. Its crawler fetches retailer product pages to read prices, availability, and product details, complementing structured merchant feeds. It is a commerce/shopping crawler rather than a search engine, gathering offer data for comparison rather than a public web index.
- Bot intelligence
Deterministic categorisation of commerce and search crawlers.
Sources and verification notes
- Shopzilla / Connexity — shopping comparisonShopping-comparison network; relies on merchant feeds, exact crawler token/IP ranges not exhaustively published.
Last reviewed 2026-06-24. Facts are checked against primary/official sources where available; uncertain specifics are marked “Data not yet verified” rather than guessed.