ww1.dp-stuff.org
robots.txt

Robots Exclusion Standard data for ww1.dp-stuff.org

Resource Scan

Scan Details

Site Domain ww1.dp-stuff.org
Base Domain dp-stuff.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-05T18:21:49+00:00
Next Scan 2025-10-03T18:21:49+00:00

Last Successful Scan

Scanned2024-11-15T09:03:44+00:00
URL https://ww1.dp-stuff.org/robots.txt
Domain IPs 104.21.40.176, 172.67.155.192, 2606:4700:3031::6815:28b0, 2606:4700:3037::ac43:9bc0
Response IP 172.67.155.192
Found Yes
Hash c0afd7f31bd33b9260f152dbab90c0e0142dc074b268448c94e664252e83ff0c
SimHash 4a54d4954550

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

mediapartners-google

Rule Path
Disallow

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /