help.hotpepper.jp
robots.txt

Robots Exclusion Standard data for help.hotpepper.jp

Resource Scan

Scan Details

Site Domain help.hotpepper.jp
Base Domain hotpepper.jp
Scan Status Ok
Last Scan2024-09-13T14:19:26+00:00
Next Scan 2024-09-27T14:19:26+00:00

Last Scan

Scanned2024-09-13T14:19:26+00:00
URL https://help.hotpepper.jp/robots.txt
Domain IPs 13.228.64.83, 13.228.64.84, 13.228.64.85
Response IP 13.228.64.84
Found Yes
Hash 84c976437b97ee7011c079450932516e6cd0509637dcee0d60df2f61dde9339a
SimHash 6e4dd801c447

Groups

googlebot

Product Comment
googlebot Google
Rule Path
Disallow /s/ask

msnbot

Product Comment
msnbot MSN
Rule Path
Disallow /s/ask

Other Records

Field Value
crawl-delay 0.2

slurp

Product Comment
slurp Yahoo!
Rule Path
Disallow /s/ask

Other Records

Field Value
crawl-delay 0.2

teoma

Product Comment
teoma Ask.com
Rule Path
Disallow /s/ask

bingbot

Product Comment
bingbot Bing
Rule Path
Disallow /s/ask

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://help.hotpepper.jp/CMN_Sitemap