BOT DIRECTORY

Known bots and crawlers

Identity reference coverage for AI crawlers, search bots, SEO crawlers, social bots, monitoring agents, and other automated traffic recognised by RequestIntel.

Check a crawler request →

Search bots or organisationsCategory

Bot	Organisation	Category	Verification	Status
AhrefsBot	Ahrefs	SEO crawler	Identification only	active
Amazonbot	Amazon	AI crawler	Identification only	active
Amzn-SearchBot	Amazon	Search crawler	Identification only	active
Amzn-User	Amazon	AI crawler	Identification only	active
ClaudeBot	Anthropic	AI crawler	Identification only	active
Claude-SearchBot	Anthropic	AI crawler	Identification only	active
Claude-User	Anthropic	AI crawler	Identification only	active
Applebot	Apple	Search crawler	Independent verification available	active
iTMS	Apple	Other bot	Identification only	active
Baiduspider	Baidu	Search crawler	Identification only	active
Better Uptime Bot	Better Uptime	Monitoring bot	Identification only	active
CensysInspect	Censys	Security scanner	Identification only	active
CCBot	Common Crawl	AI crawler	Independent verification available	active
Datadog Synthetics	Datadog	Monitoring bot	Identification only	active
DataForSeoBot	DataForSEO	SEO crawler	Identification only	active
Discordbot	Discord	Social bot	Independent verification available	active
DuckDuckBot	DuckDuckGo	Search crawler	Identification only	active
AdsBot-Google	Google	Search crawler	Independent verification available	active
Googlebot	Google	Search crawler	Independent verification available	active
Googlebot-Image	Google	Search crawler	Independent verification available	active