dot.ca.gov
robots.txt

Robots Exclusion Standard data for dot.ca.gov

Resource Scan

Scan Details

Site Domain dot.ca.gov
Base Domain ca.gov
Scan Status Ok
Last Scan2024-06-20T03:58:17+00:00
Next Scan 2024-07-20T03:58:17+00:00

Last Scan

Scanned2024-06-20T03:58:17+00:00
URL https://dot.ca.gov/robots.txt
Response IP 149.136.36.108
Found Yes
Hash 5872222c64f4672f4c0256fd4b4b925b8409eaf1eb1488f8ce6e9bc0bf9cedc0
SimHash 68045800ab93

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://dot.ca.gov/caltrans-sitemap.xml