delaware.gov
robots.txt

Robots Exclusion Standard data for delaware.gov

Resource Scan

Scan Details

Site Domain delaware.gov
Base Domain delaware.gov
Scan Status Ok
Last Scan2024-09-11T19:32:35+00:00
Next Scan 2024-10-11T19:32:35+00:00

Last Scan

Scanned2024-09-11T19:32:35+00:00
URL https://delaware.gov/robots.txt
Domain IPs 167.21.84.89
Response IP 167.21.84.89
Found Yes
Hash 2f5d0fd06a788d5debe3239357cd6eaf78328c5adeab4fbf9dfabf1a53889af4
SimHash 3ca04c228993

Groups

archive.org_bot

Rule Path
Disallow

*

Rule Path
Disallow /contact
Disallow /admin
Disallow /pages
Disallow /sso
Disallow /courtsearch