faq.ikyu.com
robots.txt

Robots Exclusion Standard data for faq.ikyu.com

Resource Scan

Scan Details

Site Domain faq.ikyu.com
Base Domain ikyu.com
Scan Status Ok
Last Scan2025-09-29T14:53:50+00:00
Next Scan 2025-10-29T14:53:50+00:00

Last Scan

Scanned2025-09-29T14:53:50+00:00
URL https://faq.ikyu.com/robots.txt
Domain IPs 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217
Response IP 199.232.46.217
Found Yes
Hash 2ee58cb4299877931a1e4c31dd1abb35db110e5b3eebdeda7a262aa325ceaaab
SimHash 6e4ed801c407

Groups

bingbot

Product Comment
bingbot CUSTOM

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 30 CUSTOM

googlebot

Product Comment
googlebot Google # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

msnbot

Product Comment
msnbot MSN # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

slurp

Product Comment
slurp Yahoo! # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

teoma

Product Comment
teoma Ask.com # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

bingbot

Product Comment
bingbot Bing # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

*

Product Comment
* ADDED BY HMS
Rule Path Comment
Disallow / ADDED BY HMS

Other Records

Field Value Comment
sitemap https://faq.ikyu.com/ci/sitemap/ ADDED BY HMS