dt02.cn
robots.txt

Robots Exclusion Standard data for dt02.cn

Resource Scan

Scan Details

Site Domain dt02.cn
Base Domain dt02.cn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-02-26T02:59:31+00:00
Next Scan 2026-03-12T02:59:31+00:00

Last Successful Scan

Scanned2026-02-04T02:43:13+00:00
URL https://dt02.cn/robots.txt
Domain IPs 104.21.1.153, 172.67.129.115, 2606:4700:3031::ac43:8173, 2606:4700:3036::6815:199
Response IP 172.67.129.115
Found Yes
Hash e894c559138efe2514b43898c7402ea3dfcc18805938068dd7c32b5ef2dca16a
SimHash 4644d9376313

Groups

baiduspider

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-news

Rule Path
Allow /

googlebot

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

youdaobot

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

sogou inst spider

Rule Path
Allow /

sogou spider2

Rule Path
Allow /

sogou blog

Rule Path
Allow /

sogou news spider

Rule Path
Allow /

sogou orion spider

Rule Path
Allow /

sosospider

Rule Path
Allow /

yisouspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandex

Rule Path
Allow /

*

Rule Path
Disallow /

Warnings

  • 2 invalid lines.