edd.ca.gov
robots.txt

Robots Exclusion Standard data for edd.ca.gov

Resource Scan

Scan Details

Site Domain edd.ca.gov
Base Domain ca.gov
Scan Status Ok
Last Scan2024-10-29T06:07:22+00:00
Next Scan 2024-11-28T06:07:22+00:00

Last Scan

Scanned2024-10-29T06:07:22+00:00
URL https://edd.ca.gov/robots.txt
Domain IPs 13.226.2.30, 13.226.2.55, 13.226.2.86, 13.226.2.93
Response IP 13.226.2.55
Found Yes
Hash 63e3fe3b455ff1a09eaa0220657f2fd15998402a4c8b682b1aa6ddc72645f585
SimHash e30519d305b2

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://edd.ca.gov/sitemap.xml

Comments

  • This document prevents compliant search engines from indexing, retrieving and displaying all pages. This file is for test servers only. Production uses a differnt robots.txt file.