surpriseaz.gov
robots.txt

Robots Exclusion Standard data for surpriseaz.gov

Resource Scan

Scan Details

Site Domain surpriseaz.gov
Base Domain surpriseaz.gov
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-07-30T14:08:46+00:00
Next Scan 2024-10-28T14:08:46+00:00

Last Successful Scan

Scanned2022-06-08T04:55:30+00:00
URL https://surpriseaz.gov/robots.txt
Redirect https://www.surpriseaz.gov/robots.txt
Redirect Domain www.surpriseaz.gov
Redirect Base surpriseaz.gov
Response IP 208.90.188.186
Found Yes
Hash 6771bf6465ddd6e600a7866b5e41825007c4a20433b378e56746547c40d205c5
SimHash 01199cd020e1

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /activedit
Disallow /admin
Disallow /common/admin/
Disallow /OJA
Disallow /support
Disallow /currenteventsview.asp
Disallow /search.asp
Disallow /currenteventsview.aspx
Disallow /search.aspx
Disallow /currentevents.aspx
Disallow /Support
Disallow /CurrentEventsView.asp
Disallow /Search.asp
Disallow /CurrentEventsView.aspx
Disallow /Search.aspx
Disallow /Search
Disallow /CurrentEvents.aspx
Disallow /Currentevents.aspx
Disallow /map.aspx
Disallow /map.asp
Disallow /Map.aspx
Disallow /Map.asp
Disallow /RSS.aspx

siteimprove

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

siteimprovebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

siteimprovebot-crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap /sitemap.xml