calpers.ca.gov
robots.txt
Robots Exclusion Standard data for calpers.ca.gov
Resource Scan
Scan Details
| Site Domain | calpers.ca.gov |
| Base Domain | ca.gov |
| Scan Status | Ok |
| Last Scan | 2024-05-21T21:39:16+00:00 |
| Next Scan | 2024-06-20T21:39:16+00:00 |
Last Scan
| Scanned | 2024-05-21T21:39:16+00:00 |
| URL | https://calpers.ca.gov/robots.txt |
| Domain IPs | 199.164.57.8 |
| Response IP | 199.164.57.8 |
| Found | Yes |
| Hash | d0db0ffebb6852f1ef10c20adff0005e706bbe031ba59d9b823c923790762662 |
| SimHash | 194002426303 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /page/under-construction |
| Disallow | /resources/js/external-target-blank.js |
| Disallow | /index.jsp* |
| Disallow | /eip-docs/* |
| Disallow | /*widget* |
| Disallow | /*mercury* |
| Disallow | /*gcalc* |
| Disallow | /*ghlt* |
| Disallow | /*jrpcs* |
| Disallow | /*faq-JSON* |
| Disallow | /*scce-pers* |
| Disallow | /*eip-docs* |
| Disallow | /*mriweb* |