m.douyin.com
robots.txt

Robots Exclusion Standard data for m.douyin.com

Resource Scan

Scan Details

Site Domain m.douyin.com
Base Domain douyin.com
Scan Status Ok
Last Scan2024-11-07T20:43:53+00:00
Next Scan 2024-11-21T20:43:53+00:00

Last Scan

Scanned2024-11-07T20:43:53+00:00
URL https://m.douyin.com/robots.txt
Domain IPs 103.136.221.67
Response IP 103.136.221.67
Found Yes
Hash dea772fe35d9ecc33074dcc42dd71599bc5be4dc347e298363ba636582e96f99
SimHash c954dd32670b

Groups

googlebot
bingbot
duckduckbot
baiduspider
sogouspider
yisouspider
bytespider
toutiaospider
sogou web spider
sogou wap spider
sogou inst spider
sogou blog
sogou news spider
sogou orion spider
sosospider
sogou spider2
haosouspider
haosospider

Rule Path
Allow /
Disallow /topic/

baiduspider

Rule Path
Allow /topic/

*

Rule Path
Disallow /

Warnings

  • 1 invalid line.