delaware.gov
robots.txt

Robots Exclusion Standard data for delaware.gov

Resource Scan

Scan Details

Site Domain delaware.gov
Base Domain delaware.gov
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-12T06:08:44+00:00
Next Scan 2024-11-19T06:08:44+00:00

Last Successful Scan

Scanned2024-10-11T21:03:08+00:00
URL https://delaware.gov/robots.txt
Domain IPs 167.21.84.89
Response IP 167.21.84.89
Found Yes
Hash 2f5d0fd06a788d5debe3239357cd6eaf78328c5adeab4fbf9dfabf1a53889af4
SimHash 3ca04c228993

Groups

archive.org_bot

Rule Path
Disallow

*

Rule Path
Disallow /contact
Disallow /admin
Disallow /pages
Disallow /sso
Disallow /courtsearch