properstar.ca
robots.txt

Robots Exclusion Standard data for properstar.ca

Resource Scan

Scan Details

Site Domain properstar.ca
Base Domain properstar.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-04T02:48:51+00:00
Next Scan 2024-11-03T02:48:51+00:00

Last Successful Scan

Scanned2023-11-27T00:54:16+00:00
URL https://properstar.ca/robots.txt
Redirect https://www.properstar.ca/robots.txt
Redirect Domain www.properstar.ca
Redirect Base properstar.ca
Domain IPs 13.107.213.58, 13.107.246.58
Redirect IPs 13.107.213.59, 13.107.246.59, 2620:1ec:46::59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 1c24fbc00f205610e6445e6a903df2b384be2773df0335546dfc67f069b4cb78
SimHash f20cc082ea90

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10.0

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /