whynothomes.com
robots.txt

Robots Exclusion Standard data for whynothomes.com

Resource Scan

Scan Details

Site Domain whynothomes.com
Base Domain whynothomes.com
Scan Status Ok
Last Scan2025-11-23T02:25:25+00:00
Next Scan 2025-12-23T02:25:25+00:00

Last Scan

Scanned2025-11-23T02:25:25+00:00
URL https://whynothomes.com/robots.txt
Domain IPs 104.21.62.79, 172.67.221.207, 2606:4700:3033::ac43:ddcf, 2606:4700:3035::6815:3e4f
Response IP 104.21.62.79
Found Yes
Hash 4281c01615e02813b086f6e3a280ff5e8eb5acd52603a3b4616ec6d5a5a4abc0
SimHash 281e4ca42f1b

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /thank-you-40.html
Disallow /thank-you-80.html
Disallow /thank-you-120.html
Disallow /thank-you-160.html
Disallow /thank-you-200.html
Disallow /thank-you-240.html
Disallow /thank-you-280.html
Disallow /thank-you-320.html
Disallow /thank-you-360.html
Disallow /thank-you-55.html
Disallow /thank-you-110.html
Disallow /thank-you-165.html
Disallow /thank-you-220.html
Disallow /thank-you-275.html
Disallow /thank-you-330.html
Disallow /thank-you-385.html
Disallow /thank-you-450.html
Disallow /thank-you-495.html
Disallow /thank-you-480.html
Disallow /thank-you-400.html

Other Records

Field Value
sitemap http://whynothomes.com/sitemap.xml