phdream333.com
robots.txt

Robots Exclusion Standard data for phdream333.com

Resource Scan

Scan Details

Site Domain phdream333.com
Base Domain phdream333.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-19T06:06:51+00:00
Next Scan 2025-03-21T06:06:51+00:00

Last Successful Scan

Scanned2024-12-29T06:05:44+00:00
URL https://phdream333.com/robots.txt
Redirect https://www.phdream333.com/robots.txt
Redirect Domain www.phdream333.com
Redirect Base phdream333.com
Domain IPs 104.21.88.201, 172.67.152.162, 2606:4700:3030::ac43:98a2, 2606:4700:3035::6815:58c9
Redirect IPs 104.21.88.201, 172.67.152.162, 2606:4700:3030::ac43:98a2, 2606:4700:3035::6815:58c9
Response IP 104.21.88.201
Found Yes
Hash 1a644f3d5573b54742e1ceaa67c71f9f0e3c7f7742130834e83886b02dfcea94
SimHash 8a665b74a39b

Groups

*

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

huihuispider

Rule Path
Disallow /

gwdangspider

Rule Path
Disallow /

wochachaspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

Warnings

  • 2 invalid lines.