panahome.co.jp
robots.txt

Robots Exclusion Standard data for panahome.co.jp

Resource Scan

Scan Details

Site Domain panahome.co.jp
Base Domain panahome.co.jp
Scan Status Ok
Last Scan2024-10-23T03:27:31+00:00
Next Scan 2024-11-22T03:27:31+00:00

Last Scan

Scanned2024-10-23T03:27:31+00:00
URL http://panahome.co.jp/robots.txt
Redirect http://www.panahome.jp/robots.txt
Redirect Domain www.panahome.jp
Redirect Base panahome.jp
Domain IPs 202.244.222.9
Redirect IPs 202.244.222.9
Response IP 202.244.222.9
Found Yes
Hash bdfa2cea7b03a52919b6f2270f5576bcad493f7a9307fe459795f59d6da48376
SimHash 6a1ac062c2b9

Groups

blp_bbot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mappy

Rule Path
Disallow /

steeler

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 60

*

Rule Path
Allow /cgi-bin/

Other Records

Field Value
crawl-delay 30