properstar.pt
robots.txt

Robots Exclusion Standard data for properstar.pt

Resource Scan

Scan Details

Site Domain properstar.pt
Base Domain properstar.pt
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/10/2025, 12:59:48 PM
Next Scan 8/8/2025, 12:59:48 PM

Last Successful Scan

Scanned1/13/2023, 5:25:20 AM
URL https://properstar.pt/robots.txt
Redirect https://www.properstar.pt/robots.txt
Redirect Domain www.properstar.pt
Redirect Base properstar.pt
Domain IPs 52.166.78.97
Redirect IPs 13.107.237.59, 13.107.238.59, 2620:1ec:4e:1::59, 2620:1ec:4f:1::59
Response IP 13.107.237.59
Found Yes
Hash 1c24fbc00f205610e6445e6a903df2b384be2773df0335546dfc67f069b4cb78
SimHash f20cc082ea90

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10.0

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /