ncdot.gov
robots.txt
Robots Exclusion Standard data for ncdot.gov
Resource Scan
Scan Details
Site Domain | ncdot.gov |
Base Domain | ncdot.gov |
Scan Status | Ok |
Last Scan | 5/6/2025, 4:26:18 PM |
Next Scan | 6/5/2025, 4:26:18 PM |
Last Scan
Scanned | 5/6/2025, 4:26:18 PM |
URL | https://ncdot.gov/robots.txt |
Redirect | https://www.ncdot.gov/robots.txt |
Redirect Domain | www.ncdot.gov |
Redirect Base | ncdot.gov |
Domain IPs | 207.4.216.226 |
Redirect IPs | 207.4.216.226 |
Response IP | 207.4.216.226 |
Found | Yes |
Hash | c83c4a695e4ca8abe1e0b5a1f2c9b2a0385d5668100a04778cb8f56b636ae0d6 |
SimHash | 4c1599eb81f2 |
Groups
*
Rule | Path |
---|---|
Allow | /search/ |
Disallow | */projectsnearme/ |
Disallow | */_Layouts/ |
Disallow | */_layouts/ |
Disallow | */Style%20Library/ |
Disallow | */style%20library/ |
Disallow | */Lists/ |
Disallow | */lists/ |
Disallow | */_catalogs/ |
Disallow | */WorkflowTasks/* |
Disallow | */workflowtasks/* |
Disallow | */js/* |
Disallow | */_vti_bin/ |
Disallow | */_catalogs/ |
Disallow | */_private/ |
Disallow | */m/ |
Disallow | */ReusableContent/ |
Disallow | */SiteCollectionImages/ |
Disallow | */SiteAssets/ |
Disallow | */no-js-site-map.aspx |
Other Records
Field | Value |
---|---|
sitemap | https://www.ncdot.gov/sitemap.xml |
sitemap | https://www.ncdot.gov:443/sitemap.xml |
sitemap | https://www.ncdot.gov:443/sitemap.xml |
sitemap | https://www.ncdot.gov:443/sitemap.xml |
Warnings
- 3 invalid lines.