d5uu.com
robots.txt

Robots Exclusion Standard data for d5uu.com

Resource Scan

Scan Details

Site Domain d5uu.com
Base Domain d5uu.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-17T00:10:13+00:00
Next Scan 2024-08-15T00:10:13+00:00

Last Successful Scan

Scanned2024-01-18T23:49:13+00:00
URL https://d5uu.com/robots.txt
Redirect https://www.d5uu.com/robots.txt
Redirect Domain www.d5uu.com
Redirect Base d5uu.com
Domain IPs 104.21.43.44, 172.67.219.93, 2606:4700:3032::6815:2b2c, 2606:4700:3035::ac43:db5d
Redirect IPs 104.21.43.44, 172.67.219.93, 2606:4700:3032::6815:2b2c, 2606:4700:3035::ac43:db5d
Response IP 104.21.43.44
Found Yes
Hash dc0555e2a7d430fe547ffcdfb75897d8accd67a9942dd8c563f92ac66e870699
SimHash ea04d8b243f1

Groups

*

Rule Path
Allow /
Disallow /search.php*
Disallow /comment.php?*

Other Records

Field Value
crawl-delay 10