Crawler directory
Search indexesUser-agent

ByteDance

TikTokSpider

About this crawler

Indexes public pages for TikTok search surfaces.

Usually means: This operator is discovering or refreshing the page so it can show up in its search results.

User agent

TikTokSpider

Trfyx matches these as user-agent tokens, not full browser strings. Providers may add surrounding version or product text.

How Trfyx matches

Matched from the user-agent token

Trfyx reads the request on the server, because these crawlers ask for HTML without running your analytics script.

User agent

Request user-agent contains TikTokSpider.

Server fetch

Recorded in middleware, not the browser script.

robots.txt

The published name to allow or disallow.

Sample robots.txt

robots.txt
User-agent: TikTokSpider
Disallow: /

See when TikTokSpider
hits your site

Trfyx records TikTokSpider on the server and keeps it out of your human visitor counts.

20-day free trial · No card requiredEU-hosted cloud