mrca.ca.gov
robots.txt

Robots Exclusion Standard data for mrca.ca.gov

Resource Scan

Scan Details

Site Domain mrca.ca.gov
Base Domain ca.gov
Scan Status Ok
Last Scan2024-04-29T18:35:13+00:00
Next Scan 2024-05-29T18:35:13+00:00

Last Scan

Scanned2024-04-29T18:35:13+00:00
URL https://mrca.ca.gov/robots.txt
Domain IPs 209.132.199.53
Response IP 209.132.199.53
Found Yes
Hash ff88cfd9500e35567b7cbd459b7c7cafbbfca172a3d7d416463b2786a91101be
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10