colorado.gov
robots.txt
Robots Exclusion Standard data for colorado.gov
Resource Scan
Scan Details
| Site Domain | colorado.gov |
| Base Domain | colorado.gov |
| Scan Status | Ok |
| Last Scan | 2024-06-01T14:13:24+00:00 |
| Next Scan | 2024-07-01T14:13:24+00:00 |
Last Scan
| Scanned | 2024-06-01T14:13:24+00:00 |
| URL | https://colorado.gov/robots.txt |
| Redirect | https://www.colorado.gov:443/robots.txt |
| Redirect Domain | www.colorado.gov |
| Redirect Base | colorado.gov |
| Domain IPs | 75.2.28.46, 99.83.143.241 |
| Redirect IPs | 75.2.28.46, 99.83.143.241 |
| Response IP | 99.83.143.241 |
| Found | Yes |
| Hash | d5bd56038140d849d2eef7a553dfb5bd326d1767967a6063d01b026e85cc332e |
| SimHash | 816d5f647787 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /mining/ | still in production stage |
| Disallow | /dpa/dhr/dhrredo | still in production |
| Disallow | /csrc/test/ | still in production |
| Disallow | /quarter | still in production |
| Disallow | newpage1.html | - |
| Disallow | newpage2.html | - |
| Disallow | /cs/Satellite/Rev-Authenticated/ | - |
| Disallow | /archive/ | - |
| Disallow | /colorado-doing-business/ | - |
| Disallow | /colorado-get-involved/ | - |
| Disallow | /colorado-government/ | - |
| Disallow | /colorado-government-links/ | - |
| Disallow | /colorado-government-services-for/ | - |
| Disallow | /colorado-how-do-i/ | - |
| Disallow | /colorado-images/ | - |
| Disallow | /colorado-learning-education/ | - |
| Disallow | /colorado-living-here/ | - |
| Disallow | /colorado-online-services/ | - |
| Disallow | /colorado-government-services-for/ | - |
| Disallow | /colorado-working/ | - |
| Disallow | index-hm.html | - |
| Disallow | google-search-results.html | - |
| Disallow | lottery.html | - |
| Disallow | social-media-twitter.html | - |
| Disallow | social-media-facebook.html | - |
| Disallow | social-media-facebook.html | - |
| Disallow | state-bill-results.html | - |
| Disallow | sub-agencies.html | - |
| Disallow | /about-colorado/ | - |
| Disallow | /work/ | - |
| Disallow | /live/ | - |
| Disallow | /play/ | - |
| Disallow | /government/ | - |
| Disallow | /includes/ | - |
| Disallow | /registered-services | - |
| Disallow | /images/ | - |
| Disallow | /search/site/ | - |
| Disallow | /js/ | - |
| Disallow | /graphic-transfers/ | - |
| Disallow | /cs/Satellite?blobcol=urldata&blobheader=application%2Fpdf&blobheadername1=Content-Disposition&blobheadername2=MDT-Type&blobheadervalue1=inline%3B%20filename=601%2F432%2FCDOT-Policy-Directive-14.pdf&blobheadervalue2=abinary%3B%20charset=UTF-8&blobkey=id&blobtable=MungoBlobs&blobwhere=1224913536621&ssbinary=true | - |
| Disallow | /contactcompass | - |
| Disallow | /pacific/ospb/* | - |
| Disallow | /pacific/ | - |
Warnings
- 2 invalid lines.
Comments