beauty.help.hotpepper.jp
robots.txt

Robots Exclusion Standard data for beauty.help.hotpepper.jp

Resource Scan

Scan Details

Site Domain beauty.help.hotpepper.jp
Base Domain hotpepper.jp
Scan Status Ok
Last Scan2024-11-08T07:10:52+00:00
Next Scan 2024-11-22T07:10:52+00:00

Last Scan

Scanned2024-11-08T07:10:52+00:00
URL https://beauty.help.hotpepper.jp/robots.txt
Domain IPs 13.228.64.83, 13.228.64.84, 13.228.64.85
Response IP 13.228.64.84
Found Yes
Hash f5410b047a129d00c92747c2d06657319d530b30c8f0ca96f35330e8b495e662
SimHash 6e4dd801c047

Groups

googlebot

Product Comment
googlebot Google
Rule Path
Disallow /s/ask

msnbot

Product Comment
msnbot MSN
Rule Path
Disallow /s/ask

Other Records

Field Value
crawl-delay 0.2

slurp

Product Comment
slurp Yahoo!
Rule Path
Disallow /s/ask

Other Records

Field Value
crawl-delay 0.2

teoma

Product Comment
teoma Ask.com
Rule Path
Disallow /s/ask

bingbot

Product Comment
bingbot Bing
Rule Path
Disallow /s/ask

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://beauty.help.hotpepper.jp/CMN_Sitemap