About this crawler
Fetches a URL a person requested or shared in a Meta product.
Usually means: A person asked an AI assistant a question, and the assistant fetched this URL to answer with fresh context or citations.
User agent
meta-externalfetcher
Trfyx matches these as user-agent tokens, not full browser strings. Providers may add surrounding version or product text.
How Trfyx matches
Matched from the user-agent token
Trfyx reads the request on the server, because these crawlers ask for HTML without running your analytics script.
User agent
Request user-agent contains meta-externalfetcher.
Server fetch
Recorded in middleware, not the browser script.
robots.txt
The published name to allow or disallow.
Sample robots.txt
User-agent: meta-externalfetcher
Disallow: /See when meta-externalfetcher
hits your site
Trfyx records meta-externalfetcher on the server and keeps it out of your human visitor counts.
EU-hosted cloud