ncdot.gov
robots.txt

Robots Exclusion Standard data for ncdot.gov

Resource Scan

Scan Details

Site Domain ncdot.gov
Base Domain ncdot.gov
Scan Status Ok
Last Scan5/6/2025, 4:26:18 PM
Next Scan 6/5/2025, 4:26:18 PM

Last Scan

Scanned5/6/2025, 4:26:18 PM
URL https://ncdot.gov/robots.txt
Redirect https://www.ncdot.gov/robots.txt
Redirect Domain www.ncdot.gov
Redirect Base ncdot.gov
Domain IPs 207.4.216.226
Redirect IPs 207.4.216.226
Response IP 207.4.216.226
Found Yes
Hash c83c4a695e4ca8abe1e0b5a1f2c9b2a0385d5668100a04778cb8f56b636ae0d6
SimHash 4c1599eb81f2

Groups

*

Rule Path
Allow /search/
Disallow */projectsnearme/
Disallow */_Layouts/
Disallow */_layouts/
Disallow */Style%20Library/
Disallow */style%20library/
Disallow */Lists/
Disallow */lists/
Disallow */_catalogs/
Disallow */WorkflowTasks/*
Disallow */workflowtasks/*
Disallow */js/*
Disallow */_vti_bin/
Disallow */_catalogs/
Disallow */_private/
Disallow */m/
Disallow */ReusableContent/
Disallow */SiteCollectionImages/
Disallow */SiteAssets/
Disallow */no-js-site-map.aspx

Other Records

Field Value
sitemap https://www.ncdot.gov/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml
sitemap https://www.ncdot.gov:443/sitemap.xml

Warnings

  • 3 invalid lines.