PetalBot — Huawei Petal Search crawler
PetalBot is the crawler operated for Huawei's Petal Search. It uses the PetalBot robots.txt token and is documented as honouring robots.txt. Petal Search is associated with Huawei devices and services, so PetalBot crawling supports that search experience.
What this means
PetalBot is the crawler for Petal Search, the search service associated with Huawei devices and services. It crawls public web content to support that search experience.
Its user agent contains the PetalBot token plus a self-identifying URL pointing at PetalBot documentation, following the common crawler pattern of token plus reference URL.
robots.txt considerations
PetalBot is documented as honouring robots.txt. To control it, target the PetalBot token. As with any crawler, the user agent is spoofable, so verify against PetalBot's published guidance where authenticity matters.
- robots.txt token: PetalBot
- Operated for Huawei Petal Search
- Documented as honouring robots.txt
How it appears in analytics and logs
A request carrying the PetalBot token is Huawei Petal Search's crawler fetching a URL — a bot event, not a human visit.
Diagnostic use case
Recognise PetalBot crawling and apply robots.txt policy for Huawei's Petal Search crawler using its token.
What WebmasterID can help detect
WebmasterID classifies PetalBot server-side as a search crawler and shows its activity separately from human traffic, so Petal Search crawl coverage is visible without log parsing.
Common mistakes
- Assuming PetalBot is unrelated to Huawei's search service.
- Trusting a PetalBot user agent without checking its documentation.
- Counting crawler hits as human visits.
Privacy and accuracy notes
Identification uses the user agent — no human identity. WebmasterID records PetalBot as a bot event, separate from human analytics.
Related pages
- Baiduspider — Baidu's web crawler
Baiduspider is the main crawler for Baidu, a leading search engine for Chinese-language search. It uses the Baiduspider robots.txt token. Baidu's documentation is primarily in Chinese and verification options are more limited than Google's, so treat verification with care.
- Sogou Spider — Sogou's web crawler
Sogou Spider is the crawler for Sogou, a Chinese search engine. Its user agent contains the Sogou identifier. English-language documentation is limited and verification options are not well published, so this entry is marked partially verified.
- Bot intelligence
See search-engine crawlers separated from human traffic.
Sources and verification notes
- Huawei — PetalBot documentationDocuments PetalBot, its token, and robots.txt handling.
Last reviewed 2026-06-24. Facts are checked against primary/official sources where available; uncertain specifics are marked “Data not yet verified” rather than guessed.