Crawlers Trfyx checks
Every AI assistant, search index, and training crawler classified on the server — because those bots request HTML without running your analytics script.
AI answers
User-triggered / 16 crawlers
OpenAI
ChatGPT-User
Fetches a page when a person asks ChatGPT to open it.
Anthropic
Claude-User
Fetches a page when a person asks Claude to open it.
Perplexity
Perplexity-User
Fetches a page so Perplexity can cite it in a person’s answer.
Google
Google-Agent
User-triggered Google fetcher used by AI and product experiences.
Google
Google-NotebookLM
Fetches sources a person added to NotebookLM.
Google
Google-Read-Aloud
Fetches a page for Google read-aloud and assistant playback.
Google
GoogleAgent
Alternate Google agent token used by AI product fetches.
Mistral
MistralAI-User
Fetches a page when a person asks a Mistral product to open it.
Microsoft
Copilot
Fetches a page when Microsoft Copilot needs it for a person.
Amazon
Amzn-User
Fetches a page when an Amazon assistant needs a live answer.
DuckDuckGo
DuckAssistBot
Fetches sources for DuckDuckGo’s AI-assisted answers.
xAI
xAI-SearchBot
Fetches pages xAI uses for Grok search-style answers.
xAI
Grok-DeepSearch
Fetches sources during a Grok DeepSearch run.
Meta
meta-externalfetcher
Fetches a URL a person requested or shared in a Meta product.
Moonshot AI
Kimi-User
Fetches a page when a person asks Kimi to open it.
Alibaba
Qwen-User
Fetches a page when a person asks Qwen to open it.
See which of these
hit your site
Trfyx splits these crawlers from people, with the pages each one requested. One server-side package.
EU-hosted cloud