How to block Amazonbot in robots.txt
Amazonbot is Amazon's web crawler. This page gives the robots.txt rule to disallow it, notes that Amazon documents Amazonbot's robots.txt compliance and a way to verify its requests, and keeps the usual caveat that robots.txt is a request to compliant crawlers, not enforcement.
What Amazonbot is
Amazonbot is Amazon's web crawler. Amazon documents the crawler, its robots.txt token, and how to verify that a request really comes from Amazonbot. Consult Amazon's documentation directly for what Amazonbot is used for before deciding policy.
The rule
To disallow Amazonbot site-wide:
User-agent: Amazonbot Disallow: /
To block only part of the site, list specific paths instead of /. Amazon documents that Amazonbot honours robots.txt, but robots.txt cannot force compliance and is not an access-control boundary. For requests where authenticity matters, use Amazon's verification guidance rather than trusting the user agent alone.
- Token: Amazonbot
- Honours robots.txt per Amazon's documentation
- Verify suspicious requests via Amazon's published guidance
How it appears in analytics and logs
After adding an Amazonbot Disallow, compliant Amazonbot requests to blocked paths should stop. Requests claiming to be Amazonbot can be checked against Amazon's published verification guidance.
Diagnostic use case
Disallow Amazonbot site-wide or on specific paths while leaving other crawlers governed by their own tokens.
What WebmasterID can help detect
WebmasterID shows Amazonbot crawl activity before and after the change, so you can confirm the block took effect for the compliant crawler.
Common mistakes
- Trusting the Amazonbot user agent without verification where authenticity matters.
- Expecting robots.txt to enforce access rather than request compliance.
- Misspelling the token — it must be exactly Amazonbot.
Privacy and accuracy notes
Blocking Amazonbot is a publishing-policy choice expressed in a public file. It involves no visitor data.
Related pages
- Amazonbot — Amazon crawler
Amazonbot is the web crawler operated by Amazon. Amazon documents the crawler, its robots.txt token, and how site owners can control it. Amazonbot honours robots.txt and identifies itself with the Amazonbot token plus a self-identifying URL.
- robots.txt basics: what it does and what it cannot do
robots.txt is a plain-text file at your site root that tells compliant crawlers which paths they may request. This page covers the directives, how user-agent groups are matched, and the limits that trip people up: robots.txt is advisory, it does not hide pages from search, and it is not a security boundary.
- Writing an AI crawler policy for robots.txt
An AI crawler policy is a deliberate decision about which AI-related tokens you allow and which you disallow in robots.txt. This page offers a structured way to make and document those choices, while staying realistic: robots.txt is a request to compliant crawlers, not a legal or technical guarantee.
- Bot intelligence
See Amazonbot activity separate from human traffic.
Sources and verification notes
- Amazon — Amazonbot documentationDocuments Amazonbot, its token, robots.txt handling, and verification.
Last reviewed 2026-06-24. Facts are checked against primary/official sources where available; uncertain specifics are marked “Data not yet verified” rather than guessed.