How to block serpstatbot
serpstatbot is an SEO crawler that gathers backlink and ranking data for the Serpstat platform. This page shows how to disallow it in robots.txt, how to slow rather than fully block it, and how to confirm the rule works.
robots.txt rule
serpstatbot documents its token and publishes a self-identifying URL in its user agent. To disallow it site-wide:
User-agent: serpstatbot Disallow: /
Serpstat documents that the crawler honours robots.txt, so a correctly targeted Disallow is the supported way to opt out. Match on the serpstatbot token rather than a version string.
- robots.txt token: serpstatbot
- Self-identifying URL in the user agent
- Honours robots.txt per Serpstat's documentation
Slow instead of block
If you want serpstatbot to keep crawling but more gently, Serpstat documents support for crawl-delay. For example:
User-agent: serpstatbot Crawl-delay: 10
That asks the crawler to wait between requests rather than stop entirely. Note that Google ignores crawl-delay, so this directive affects only crawlers like serpstatbot that honour it; keep it in the serpstatbot group to avoid confusion.
How it appears in analytics and logs
serpstatbot hits mean Serpstat's crawler is collecting SEO/backlink data about your pages. It is not search-engine indexing and brings no referral traffic of its own.
Diagnostic use case
Stop serpstatbot from consuming crawl resources when you do not use Serpstat and do not want a third-party SEO tool mapping your site.
What WebmasterID can help detect
WebmasterID categorises serpstatbot as an SEO crawler distinct from search and AI bots, so you can confirm a block lands and keep these hits out of human analytics.
Common mistakes
- Adding Crawl-delay in the Google group expecting Googlebot to slow — it ignores it.
- Misspelling the serpstatbot token so the rule never matches.
- Treating SEO-crawler hits as human visits in analytics.
Privacy and accuracy notes
The rule targets the serpstatbot token; no visitor data is involved. robots.txt asks compliant crawlers to comply and is not an access control.
Related pages
- SerpstatBot — Serpstat's web crawler
SerpstatBot is the crawler operated by Serpstat to collect backlink and SEO data for its platform. It is a third-party SEO tool crawler, not a search engine. Serpstat documents SerpstatBot and publishes robots.txt and crawl-rate guidance for operators who want to identify or restrict it.
- How to block AhrefsBot in robots.txt
AhrefsBot is the crawler Ahrefs uses to build its backlink and SEO index. This page gives the robots.txt rule to disallow it and notes that Ahrefs documents support for both robots.txt rules and the crawl-delay directive, so you can slow rather than fully block it.
- The crawl-delay directive in robots.txt
Crawl-delay is a non-standard robots.txt directive that asks a crawler to wait between requests. Support is uneven: Google does not use it and points to Search Console instead, while Bing and Yandex have historically honoured it. This page explains the directive and the safer alternatives.
- Bot intelligence
Separate SEO crawlers like serpstatbot from real visitors.
Sources and verification notes
- Serpstat — serpstatbot crawler informationOfficial serpstatbot page: token, robots.txt and crawl-delay support.
Last reviewed 2026-06-24. Facts are checked against primary/official sources where available; uncertain specifics are marked “Data not yet verified” rather than guessed.