MojeekBot — independent index crawler
MojeekBot is the crawler for Mojeek, a search engine notable for building and operating its own independent web index rather than reselling another engine's results. Its robots.txt token is MojeekBot. Mojeek documents the crawler, though some specifics are marked partially verified.
What this means
Mojeek is a search engine that builds its own web index, independently of Google and Bing. MojeekBot is the crawler that gathers pages for that index. This independence is the distinguishing point: being crawled by MojeekBot affects visibility in a result set that is not a syndication of a larger engine.
Mojeek publishes documentation about its crawler and how site owners can control it, which is the authoritative source for current behaviour.
robots.txt considerations
MojeekBot is documented as honouring robots.txt. To control it, target the MojeekBot token. The user agent is spoofable, so verify against Mojeek's published guidance where authenticity matters, and do not invent IP ranges. Some specifics are marked partially verified pending confirmation in Mojeek's docs.
- robots.txt token: MojeekBot
- Mojeek builds and operates its own independent index
- Honours robots.txt per Mojeek documentation
How it appears in analytics and logs
A request carrying the MojeekBot token is Mojeek's crawler fetching a URL for its own index — a bot event, not a human visit. Because Mojeek runs an independent index, allowing MojeekBot contributes to a result set not derived from the major engines.
Diagnostic use case
Recognise MojeekBot as crawling that feeds an independent index, and apply robots.txt policy for Mojeek's crawler using its token.
What WebmasterID can help detect
WebmasterID classifies MojeekBot server-side as a search crawler and shows its activity separately from human traffic, so Mojeek crawl coverage is visible without log parsing.
Common mistakes
- Assuming Mojeek reuses Google or Bing results — it runs its own index.
- Trusting a MojeekBot user agent without checking its documentation.
- Counting crawler hits as human visits.
Privacy and accuracy notes
Identification uses only the user agent — no human identity. WebmasterID records MojeekBot as a bot event, separate from human analytics.
Related pages
- Brave Search crawler
Brave Search operates its own independent web index, and uses a dedicated crawler to gather pages for it. Brave documents the crawler and its robots.txt token. The exact token and verification specifics should be confirmed in Brave's documentation, so this entry is marked partially verified.
- DuckDuckBot — DuckDuckGo's crawler
DuckDuckBot is the crawler operated by DuckDuckGo. DuckDuckGo also draws on third-party indexes for some results, so DuckDuckBot is one part of how its results are built. DuckDuckGo documents the crawler and publishes IP addresses operators can use to verify it.
- Bot intelligence
See search-engine crawlers separated from human traffic.
Sources and verification notes
- Mojeek — crawler documentationDocuments MojeekBot and robots.txt handling; some specifics partially verified.
Last reviewed 2026-06-24. Facts are checked against primary/official sources where available; uncertain specifics are marked “Data not yet verified” rather than guessed.