insuranceprovider.ca
robots.txt

Robots Exclusion Standard data for insuranceprovider.ca

Resource Scan

Scan Details

Site Domain insuranceprovider.ca
Base Domain insuranceprovider.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-08T03:03:12+00:00
Next Scan 2025-06-06T03:03:12+00:00

Last Successful Scan

Scanned2024-11-09T03:00:59+00:00
URL https://insuranceprovider.ca/robots.txt
Domain IPs 198.58.118.244
Response IP 198.58.118.244
Found Yes
Hash 93ab8f9fc2f1cb77876b2f12a0aca12dd7ff03c9b03cf3717999800093f22af8
SimHash 0e0ed27281b3

Groups

*

Rule Path
Disallow /account
Disallow /advantage

Other Records

Field Value
crawl-delay 1

ccbot
baiduspider
baiduspider
baiduspider+
yandex
sosospider

Rule Path
Disallow /