super-mpo868.com
robots.txt

Robots Exclusion Standard data for super-mpo868.com

Resource Scan

Scan Details

Site Domain super-mpo868.com
Base Domain super-mpo868.com
Scan Status Ok
Last Scan6/4/2025, 9:37:24 AM
Next Scan 6/11/2025, 9:37:24 AM

Last Scan

Scanned6/4/2025, 9:37:24 AM
URL https://super-mpo868.com/robots.txt
Redirect https://www.tiktok.com/robots.txt
Redirect Domain www.tiktok.com
Redirect Base tiktok.com
Domain IPs 104.21.83.180, 172.67.180.123, 2606:4700:3030::ac43:b47b, 2606:4700:3032::6815:53b4
Redirect IPs 23.53.118.240, 23.53.118.241, 23.53.118.242, 23.53.118.244, 23.53.118.246, 23.53.118.247, 23.53.118.248, 23.53.118.249, 23.53.118.250
Response IP 23.61.202.34
Found Yes
Hash 7747245e34d211b9484a405aa6d869bcad4d113a8a7b488c822cab02797bb8c5
SimHash 25d698f06719

Groups

baiduspider
sogouspider
yisouspider
petalbot
bytespider

Rule Path
Disallow /

*

Rule Path
Allow /foryou
Allow /discover
Allow /about
Allow /legal
Allow /safety
Allow /forgood
Allow /community-guidelines
Allow /tag
Allow /amp
Allow /transparency
Allow /share
Allow /music
Disallow /inapp
Disallow /auth
Disallow /embed/%40
Disallow /embed/v2
Disallow /embed/curated
Disallow /link
Disallow */directory/
Disallow /search/video?
Disallow /search/user?q=
Disallow /shop/view/product/
Disallow /sgtm/g/collect
Disallow /api/share/settings
Disallow /api/recommend/embed_videos
Disallow /discover/trending/detail/

bingbot

Rule Path
Disallow /discover

Warnings

  • 1 invalid line.