ncdot.org
robots.txt

Robots Exclusion Standard data for ncdot.org

Resource Scan

Scan Details

Site Domain ncdot.org
Base Domain ncdot.org
Scan Status Ok
Last Scan2025-05-08T18:22:25+00:00
Next Scan 2025-06-07T18:22:25+00:00

Last Scan

Scanned2025-05-08T18:22:25+00:00
URL http://ncdot.org/robots.txt
Redirect https://www.ncdot.gov/robots.txt
Redirect Domain www.ncdot.gov
Redirect Base ncdot.gov
Domain IPs 207.4.216.226
Redirect IPs 207.4.216.226
Response IP 207.4.216.226
Found Yes
Hash c83c4a695e4ca8abe1e0b5a1f2c9b2a0385d5668100a04778cb8f56b636ae0d6
SimHash 4c1599eb81f2

Groups

*

Rule Path
Allow /search/
Disallow */projectsnearme/
Disallow */_Layouts/
Disallow */_layouts/
Disallow */Style%20Library/
Disallow */style%20library/
Disallow */Lists/
Disallow */lists/
Disallow */_catalogs/
Disallow */WorkflowTasks/*
Disallow */workflowtasks/*
Disallow */js/*
Disallow */_vti_bin/
Disallow */_catalogs/
Disallow */_private/
Disallow */m/
Disallow */ReusableContent/
Disallow */SiteCollectionImages/
Disallow */SiteAssets/
Disallow */no-js-site-map.aspx

Other Records

Field Value
sitemap https://www.ncdot.gov/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml

Warnings

  • 3 invalid lines.