cityofdavis.org
robots.txt

Robots Exclusion Standard data for cityofdavis.org

Resource Scan

Scan Details

Site Domain cityofdavis.org
Base Domain cityofdavis.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-22T18:38:10+00:00
Next Scan 2024-11-21T18:38:10+00:00

Last Successful Scan

Scanned2023-09-05T06:29:14+00:00
URL https://cityofdavis.org/robots.txt
Redirect https://www.cityofdavis.org/robots.txt
Redirect Domain www.cityofdavis.org
Redirect Base cityofdavis.org
Domain IPs 135.84.124.41
Redirect IPs 2600:1413:b000:6::17d5:2bd6, 2600:1413:b000:6::17d5:2be0, 96.17.96.24, 96.17.96.9
Response IP 23.209.46.160
Found Yes
Hash bcb50a9475e18a185a55b71d1857c0bf7231a1cf79dcf9f94426ff14ffc9b0b8
SimHash 80144c208b51

Groups

*

Rule Path
Disallow /Scripts
Disallow /Admin
Disallow /*.asmx*

ahrefsbot

Rule Path
Disallow /