mclconstruction.com
robots.txt

Robots Exclusion Standard data for mclconstruction.com

Resource Scan

Scan Details

Site Domain mclconstruction.com
Base Domain mclconstruction.com
Scan Status Ok
Last Scan2026-01-01T12:46:47+00:00
Next Scan 2026-01-31T12:46:47+00:00

Last Scan

Scanned2026-01-01T12:46:47+00:00
URL https://mclconstruction.com/robots.txt
Redirect https://www.mclconstruction.com/robots.txt
Redirect Domain www.mclconstruction.com
Redirect Base mclconstruction.com
Domain IPs 10.20.91.51, 10.20.91.53, 199.34.228.74
Redirect IPs 10.20.91.51, 10.20.91.53, 199.34.228.74
Response IP 199.34.228.74
Found Yes
Hash 81960088ef2b7c542d05a0b2f2350b2ae07b0fd105b61501a09e04cb2d9b6832
SimHash 1855dc262793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /how-we-build.html
Disallow /education.html
Disallow /what-we-build.html
Disallow /project-delivery-methods.html
Disallow /community.html
Disallow /community-new.html
Disallow /schedule-photos.html
Disallow /locations.html

Other Records

Field Value
sitemap https://www.mclconstruction.com/sitemap.xml