Ryte crawler (BotLogen)
Ryte is a website-quality and SEO auditing platform, and its crawler has been observed identifying with the BotLogen token. It fetches a customer's pages to run technical and content audits. As a tool crawler it does not serve a consumer search engine. Token and self-identifying URL are observable; some specifics are not exhaustively published, so this entry is partially verified.
What this means
Ryte is a platform for website quality, technical SEO, and content auditing. Its crawler fetches a customer's site to gather data for those audits. It has been seen self-identifying with the BotLogen token.
Because it is a commissioned audit crawler, it typically appears when someone runs a Ryte project for the domain. It does not power a public search engine, so blocking it only stops Ryte's own crawling.
How it identifies itself
It uses a user-agent token observed as BotLogen with a self-identifying URL. Match on the stable token. Ryte's published details for its crawler are limited, so confirm by the self-identifying URL and behaviour rather than asserting unverified IP ranges or version strings.
- robots.txt token: BotLogen (Ryte's crawler)
- Purpose: technical/content SEO audits, not search
- Usually present because a Ryte project is configured
How it appears in analytics and logs
A request with the BotLogen token is Ryte's audit crawler fetching pages, typically because a Ryte project is configured for the site. It is SEO-tool traffic, not search indexing, and should be counted as bot.
Diagnostic use case
Recognise Ryte's BotLogen crawler as a commissioned SEO-audit crawler in your logs and distinguish it from search-engine bots when reviewing crawl load.
What WebmasterID can help detect
WebmasterID classifies Ryte's crawler as an SEO/audit crawler separate from search bots, so its requests are visible on the bot-intelligence surface and excluded from human analytics.
Common mistakes
- Mistaking Ryte's audit crawler for a search-engine indexer.
- Counting BotLogen hits as human traffic.
- Inventing an exact user-agent string or IP range for it.
Privacy and accuracy notes
BotLogen is identified by its user-agent token only. It is a crawler, not a person; WebmasterID records it as a bot event without any visitor identity.
Related pages
- Screaming Frog SEO Spider
Screaming Frog SEO Spider is a desktop application that site owners and SEO professionals run themselves to audit a site. It is not a public, continuously operating crawler like Googlebot; its user agent is user-controlled and its crawling is initiated by whoever runs the tool.
- SEOkicks crawler (SEOkicks-Robot)
SEOkicks-Robot is the crawler operated by SEOkicks, a backlink-analysis service. Like other link-index crawlers, it fetches pages to discover and record hyperlinks for its backlink database rather than to serve a public search engine. The token and self-identifying URL are observable in logs; some operational specifics are not exhaustively published, so this entry is partially verified.
- Managing third-party SEO crawler load
Third-party SEO crawlers such as AhrefsBot and SemrushBot can generate significant request volume without contributing to search visibility. You can manage their load by targeting their tokens in robots.txt, using crawl-delay where the crawler supports it, and blocking those that bring no value to you.
- Bot intelligence
Identifies commissioned SEO-audit crawlers separately.
Sources and verification notes
- Ryte — website quality and SEO platformPlatform operates an audit crawler; BotLogen token observed, full specifics not exhaustively published.
Last reviewed 2026-06-24. Facts are checked against primary/official sources where available; uncertain specifics are marked “Data not yet verified” rather than guessed.