meta-externalagent

About this crawler

Crawls public pages to improve Meta products and AI systems.

Usually means: This operator is collecting the page as public web content that may improve future models.

meta-externalagent

Trfyx matches these as user-agent tokens, not full browser strings. Providers may add surrounding version or product text.

Matched from the user-agent token

Trfyx reads the request on the server, because these crawlers ask for HTML without running your analytics script.

User agent

Request user-agent contains meta-externalagent.

Server fetch

Recorded in middleware, not the browser script.

robots.txt

The published name to allow or disallow.

Sample robots.txt

robots.txt

User-agent: meta-externalagent
Disallow: /

Trfyx records meta-externalagent on the server and keeps it out of your human visitor counts.

20-day free trial · No card requiredEU-hosted cloud