Idealo price-comparison crawler
Idealo is a major European price-comparison platform, particularly in Germany, that aggregates product offers so shoppers can compare prices across retailers. Its crawler fetches retailer and merchant product pages to read prices, availability, and product details for that comparison. It is a shopping/commerce crawler, not a search engine, and operates alongside merchant feeds rather than building a general web index.
What this means
Idealo aggregates retail offers so shoppers can compare prices and availability across many merchants. To keep comparisons current, it fetches product pages from retailers, often in combination with structured merchant feeds.
If you run an online store, Idealo's crawler may fetch your product pages to read price and stock. This is commerce-focused crawling for a comparison platform, not general web search indexing.
How it identifies itself
Idealo crawling carries an Idealo-identifying user-agent. Because Idealo also ingests merchant feeds and its exact public crawler token and IP ranges are not exhaustively documented in one canonical place, this entry is marked partially verified; the Idealo identity and price-comparison purpose are the reliable signals.
As with any crawler, the user-agent is a claim and can be copied. Match on the Idealo identity and corroborate with behaviour where authenticity matters.
- Operator: Idealo (European price-comparison platform)
- Scope: retailer product pages — price, availability, details
- Often combined with structured merchant feeds
robots.txt considerations
To express a crawl preference for Idealo, target its documented user-agent token in robots.txt. Note that if you also submit a merchant feed to Idealo, blocking the crawler does not stop offer ingestion through that feed.
robots.txt is honoured by compliant crawlers and is not an access control. For retailers, allowing the crawler can increase offer visibility in comparison results.
How it appears in analytics and logs
An Idealo request means a price-comparison platform fetched your product page to read price and availability. It is commerce crawl traffic, not a human shopper and not a search-index crawl; activity tracks how often your offers are refreshed for comparison.
Diagnostic use case
Recognise Idealo's price-comparison crawler in logs, distinguish commerce price crawling from search indexing and SEO link crawlers, and set policy for a shopping aggregator.
What WebmasterID can help detect
WebmasterID classifies the Idealo crawler server-side as a commerce/price-comparison bot and surfaces its activity on the bot-intelligence surface, so price-crawl coverage stays separate from human shopper analytics.
Common mistakes
- Treating a price-comparison crawler as a search engine indexing your catalogue for general search.
- Blocking the crawler while still feeding offers via a merchant feed and expecting offers to disappear.
- Counting price-crawl hits as human shoppers in analytics.
Privacy and accuracy notes
Identification uses only the request user-agent. No visitor identity is involved. WebmasterID records the fetch as a bot event, separate from human analytics, and never attaches it to a profile.
Related pages
- Price-comparison and shopping crawlers — overview
Price-comparison and shopping crawlers fetch retailer product pages to read prices, availability, and product details for comparison platforms. This overview explains how Idealo, PriceRunner, and Shopzilla operate, why they combine crawling with structured merchant feeds, and how retailers should set policy. They build offer-comparison datasets, not a general search index, so their crawling reflects offer-refresh cadence.
- PriceRunner crawler
PriceRunner is a price-comparison platform, strong across the Nordics and Europe, that helps shoppers compare prices and offers across retailers. Its crawler fetches retailer product pages to read prices, availability, and product details, complementing structured merchant feeds. It is a commerce/shopping crawler rather than a search engine, gathering offer data for comparison rather than a public web index.
- Shopzilla crawler
Shopzilla is a long-running shopping-comparison brand (part of the Connexity/Kit network of comparison and retail-media services) that aggregates product offers and prices for shoppers. Its data collection combines merchant feeds with crawling of retailer product pages to read prices and availability. It is a commerce/shopping crawler rather than a search engine building a public web index.
- Bot intelligence
Deterministic categorisation of commerce, search, and SEO crawlers.
Sources and verification notes
- Idealo — for retailers / how Idealo worksPrice-comparison platform; crawler identity documented, exact token/IP ranges not exhaustively published.
Last reviewed 2026-06-24. Facts are checked against primary/official sources where available; uncertain specifics are marked “Data not yet verified” rather than guessed.