tiktok.com
robots.txt

Robots Exclusion Standard data for tiktok.com

Resource Scan

Scan Details

Site Domain tiktok.com
Base Domain tiktok.com
Scan Status Ok
Last Scan2024-11-11T05:17:28+00:00
Next Scan 2024-11-18T05:17:28+00:00

Last Scan

Scanned2024-11-11T05:17:28+00:00
URL https://tiktok.com/robots.txt
Redirect https://www.tiktok.com/robots.txt
Redirect Domain www.tiktok.com
Redirect Base tiktok.com
Domain IPs 108.156.133.118, 108.156.133.28, 108.156.133.4, 108.156.133.46
Redirect IPs 23.59.80.170, 23.59.80.186, 23.59.80.195, 23.59.80.208, 23.59.80.216, 23.59.80.218, 23.59.80.224, 23.59.80.225, 23.59.80.241
Response IP 23.210.250.82
Found Yes
Hash 219b834575ab90c870d40b128e5c6eeb1fb2e9e729d24732e7907246f8c01edb
SimHash 679698d06719

Groups

baiduspider
sogouspider
yisouspider
petalbot
bytespider

Rule Path
Disallow /

*

Rule Path
Allow /foryou
Allow /discover
Allow /about
Allow /legal
Allow /safety
Allow /forgood
Allow /community-guidelines
Allow /tag
Allow /amp
Allow /transparency
Allow /share
Allow /music
Disallow /inapp
Disallow /auth
Disallow /embed/%40
Disallow /embed/v2
Disallow /embed/curated
Disallow /link
Disallow */directory/
Disallow /search/video?
Disallow /search/user?q=

bingbot

Rule Path
Disallow /discover

Warnings

  • 1 invalid line.