properstar.es
robots.txt

Robots Exclusion Standard data for properstar.es

Resource Scan

Scan Details

Site Domain properstar.es
Base Domain properstar.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-28T16:39:57+00:00
Next Scan 2024-10-27T16:39:57+00:00

Last Successful Scan

Scanned2023-11-20T15:39:42+00:00
URL https://properstar.es/robots.txt
Redirect https://www.properstar.es/robots.txt
Redirect Domain www.properstar.es
Redirect Base properstar.es
Domain IPs 13.107.213.73, 13.107.246.73
Redirect IPs 13.107.213.59, 13.107.246.59, 2620:1ec:46::59, 2620:1ec:bdf::59
Response IP 13.107.213.59
Found Yes
Hash 1c24fbc00f205610e6445e6a903df2b384be2773df0335546dfc67f069b4cb78
SimHash f20cc082ea90

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10.0

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /