panahome.jp
robots.txt

Robots Exclusion Standard data for panahome.jp

Resource Scan

Scan Details

Site Domain panahome.jp
Base Domain panahome.jp
Scan Status Ok
Last Scan2024-11-18T05:07:49+00:00
Next Scan 2024-12-18T05:07:49+00:00

Last Scan

Scanned2024-11-18T05:07:49+00:00
URL https://www.panahome.jp/robots.txt
Domain IPs 202.244.222.9
Response IP 202.244.222.9
Found Yes
Hash bdfa2cea7b03a52919b6f2270f5576bcad493f7a9307fe459795f59d6da48376
SimHash 6a1ac062c2b9

Groups

blp_bbot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mappy

Rule Path
Disallow /

steeler

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 60

*

Rule Path
Allow /cgi-bin/

Other Records

Field Value
crawl-delay 30