properstar.jp
robots.txt

Robots Exclusion Standard data for properstar.jp

Resource Scan

Scan Details

Site Domain properstar.jp
Base Domain properstar.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-04T12:23:59+00:00
Next Scan 2024-10-02T12:23:59+00:00

Last Successful Scan

Scanned2023-09-01T05:21:00+00:00
URL https://www.properstar.jp/robots.txt
Domain IPs 13.107.226.59, 13.107.253.59, 2620:1ec:46::59, 2620:1ec:bdf::59
Response IP 13.107.253.59
Found Yes
Hash 1c24fbc00f205610e6445e6a903df2b384be2773df0335546dfc67f069b4cb78
SimHash f20cc082ea90

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10.0

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /