homefinder.com
robots.txt

Robots Exclusion Standard data for homefinder.com

Resource Scan

Scan Details

Site Domain homefinder.com
Base Domain homefinder.com
Scan Status Ok
Last Scan2024-05-24T23:53:51+00:00
Next Scan 2024-05-31T23:53:51+00:00

Last Scan

Scanned2024-05-24T23:53:51+00:00
URL https://homefinder.com/robots.txt
Domain IPs 35.171.156.155, 54.158.98.96, 54.221.223.98
Response IP 35.171.156.155
Found Yes
Hash 50f4b77afa150a2cdc35bcca4f2e43782164e5b9c678d9705f8210d856c8a314
SimHash 8f18c0a60b33

Groups

*

Rule Path
Disallow /property

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

realspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

Other Records

Field Value
sitemap https://homefinder.com/sitemap/static/sitemap.xml
sitemap https://homefinder.com/sitemap/articles/sitemap.xml
sitemap https://homefinder.com/sitemap/foreclosures/sitemap.xml
sitemap https://homefinder.com/sitemap/homes-for-sale/sitemap.xml
sitemap https://homefinder.com/sitemap/rentals/sitemap.xml
sitemap https://homefinder.com/sitemap/rent-to-own/sitemap.xml