homeguideexpert.com
robots.txt

Robots Exclusion Standard data for homeguideexpert.com

Resource Scan

Scan Details

Site Domain homeguideexpert.com
Base Domain homeguideexpert.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-09T23:15:18+00:00
Next Scan 2025-11-08T23:15:18+00:00

Last Successful Scan

Scanned2025-08-18T22:47:56+00:00
URL https://homeguideexpert.com/robots.txt
Domain IPs 185.199.220.37
Response IP 185.199.220.37
Found Yes
Hash 59c80a36478fe781be048330f0e187d3fd70c244d09470a199cb2c95d1ba1594
SimHash 4510d3175711

Groups

scrapy

Rule Path
Allow /