properstar.com
robots.txt

Robots Exclusion Standard data for properstar.com

Resource Scan

Scan Details

Site Domain properstar.com
Base Domain properstar.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-14T08:44:23+00:00
Next Scan 2024-10-14T08:44:23+00:00

Last Successful Scan

Scanned2024-08-09T08:43:32+00:00
URL https://properstar.com/robots.txt
Redirect https://www.properstar.com/robots.txt
Redirect Domain www.properstar.com
Redirect Base properstar.com
Domain IPs 13.107.246.73
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 3e025971832a990b3f5b50f0591bed502bc2bc617665a2d0de01fbe839996f86
SimHash f20cc082ea90

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10.0

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow

petalbot

Rule Path
Disallow /