ncdot.org
robots.txt

Robots Exclusion Standard data for ncdot.org

Resource Scan

Scan Details

Site Domain ncdot.org
Base Domain ncdot.org
Scan Status Ok
Last Scan2025-12-06T03:28:35+00:00
Next Scan 2026-01-05T03:28:35+00:00

Last Scan

Scanned2025-12-06T03:28:35+00:00
URL http://ncdot.org/robots.txt
Redirect https://www.ncdot.gov/robots.txt
Redirect Domain www.ncdot.gov
Redirect Base ncdot.gov
Domain IPs 207.4.216.226
Redirect IPs 207.4.216.226
Response IP 207.4.216.226
Found Yes
Hash 65879b48d4306382a932a431edf28b5c24c530f82c71fb231551daffbad14ec0
SimHash 4c178beb81f2

Groups

*

Rule Path
Allow /search/
Disallow */projectsnearme/
Disallow */_Layouts/
Disallow */_layouts/
Disallow */Style%20Library/
Disallow */style%20library/
Disallow */_graphics/
Disallow */Lists/
Disallow */lists/
Disallow */_catalogs/
Disallow */WorkflowTasks/*
Disallow */workflowtasks/*
Disallow */js/*
Disallow */_vti_bin/
Disallow */_catalogs/
Disallow */_private/
Disallow */m/
Disallow */ReusableContent/
Disallow */SiteCollectionImages/
Disallow */SiteAssets/
Disallow */no-js-site-map.aspx

Other Records

Field Value
sitemap https://www.ncdot.gov/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml

Warnings

  • 3 invalid lines.