Log In Sign Up

cheercloset.jp
robots.txt

Robots Exclusion Standard data for cheercloset.jp

Resource Scan

Scan Details

Site Domain cheercloset.jp
Base Domain cheercloset.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-04-27T11:58:40+00:00
Next Scan 2025-05-11T11:58:40+00:00

Last Successful Scan

Scanned2025-04-12T10:17:39+00:00
URL https://cheercloset.jp/robots.txt
Domain IPs 104.21.52.137, 172.67.199.181, 2606:4700:3035::6815:3489, 2606:4700:3035::ac43:c7b5
Response IP 104.21.52.137
Found Yes
Hash ad77e45e8372cd0a9e72c5da1ba712fb0ea632c6b7184594a423ca45d6ea0e8b
SimHash 6bb0d8458993

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120
Back to top

Other Records

Field Value
sitemap https://cheercloset.jp/sitemap_index.xml
Back to top