help.point.recruit.co.jp
robots.txt

Robots Exclusion Standard data for help.point.recruit.co.jp

Resource Scan

Scan Details

Site Domain help.point.recruit.co.jp
Base Domain recruit.co.jp
Scan Status Ok
Last Scan2024-11-09T00:36:09+00:00
Next Scan 2024-11-23T00:36:09+00:00

Last Scan

Scanned2024-11-09T00:36:09+00:00
URL https://help.point.recruit.co.jp/robots.txt
Domain IPs 13.228.64.83, 13.228.64.84, 13.228.64.85
Response IP 13.228.64.85
Found Yes
Hash 0b2f19adac9f86a6db5a22f22369611444518ebb37813dcaa9c7b97a952f526e
SimHash 6e4cf801c057

Groups

googlebot

Product Comment
googlebot Google
Rule Path
Disallow /s/ask

msnbot

Product Comment
msnbot MSN
Rule Path
Disallow /s/ask

Other Records

Field Value
crawl-delay 0.2

slurp

Product Comment
slurp Yahoo!
Rule Path
Disallow /s/ask

Other Records

Field Value
crawl-delay 0.2

teoma

Product Comment
teoma Ask.com
Rule Path
Disallow /s/ask

bingbot

Product Comment
bingbot Bing
Rule Path
Disallow /s/ask

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://help.point.recruit.co.jp/CMN_Sitemap