mcginnhomes.com
robots.txt

Robots Exclusion Standard data for mcginnhomes.com

Resource Scan

Scan Details

Site Domain mcginnhomes.com
Base Domain mcginnhomes.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-29T20:01:30+00:00
Next Scan 2025-11-27T20:01:30+00:00

Last Successful Scan

Scanned2024-02-22T16:02:43+00:00
URL https://mcginnhomes.com/robots.txt
Redirect https://www.mcginnhomes.com/robots.txt
Redirect Domain www.mcginnhomes.com
Redirect Base mcginnhomes.com
Domain IPs 104.17.235.232, 104.17.236.232, 104.17.237.232, 104.17.238.232, 104.17.239.232, 2606:4700::6811:ebe8, 2606:4700::6811:ece8, 2606:4700::6811:ede8, 2606:4700::6811:eee8, 2606:4700::6811:efe8
Redirect IPs 104.17.235.232, 104.17.236.232, 104.17.237.232, 104.17.238.232, 104.17.239.232, 2606:4700::6811:ebe8, 2606:4700::6811:ece8, 2606:4700::6811:ede8, 2606:4700::6811:eee8, 2606:4700::6811:efe8
Response IP 104.17.239.232
Found Yes
Hash 68aa8811c3d9c5b66d97d8a881dfe7a9f9fb4af5bdde337f712b5a9f3ef503f5
SimHash 4a61c4668291

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /cgi-bin/
Disallow /emails_kvarea/
Disallow /index.php?similar=1
Disallow /language.php
Disallow /mobilefirst/
Disallow /print-flyer.php
Disallow /private_kvarea/
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.mcginnhomes.com/sitemap-index.xml