kyoto-wel.com
robots.txt

Robots Exclusion Standard data for kyoto-wel.com

Resource Scan

Scan Details

Site Domain kyoto-wel.com
Base Domain kyoto-wel.com
Scan Status Ok
Last Scan2024-09-04T17:44:55+00:00
Next Scan 2024-10-04T17:44:55+00:00

Last Scan

Scanned2024-09-04T17:44:55+00:00
URL https://kyoto-wel.com/robots.txt
Redirect https://www.kyoto-wel.com/robots.txt
Redirect Domain www.kyoto-wel.com
Redirect Base kyoto-wel.com
Domain IPs 210.233.71.163
Redirect IPs 210.233.71.163
Response IP 210.233.71.163
Found Yes
Hash 1e405919f67b87272d02bfb1945f1e6a3c907406b1c5593a7dd7e6b7cca86d97
SimHash d8de87d08a98

Groups

*

Rule Path
Allow /
Disallow /item/IS81131N*
Disallow /shop/search_item.html*
Disallow /news/news_detail.html*
Disallow /shop/category_shop.html
Disallow /S81186/
Disallow /shop/search_kwd.html?kwd=%2594%2592%2596%25A1%2591X
Disallow /shop/search_kwd.html?kwd=%258D%2595%258E%25B5%2596%25A1
Disallow /shop/search_kwd.html?kwd=%2596%2595%2592%2583
Disallow /mshop/search_kwd.html?kwd=%2590%25EE%258Eq
Disallow /mshop/search_kwd.html?kwd=%258D%2595%258E%25B5%2596%25A1
Disallow /mshop/search_kwd.html?kwd=%2583%257B%2583%258B%2583T%2583%258A%2581%255B%2583m
Disallow /S81615/blog_detail.html?blog_code=682
Disallow /S81615/blog_detail.html?blog_code=759
Disallow /shop/search_item.html?cat_cd=161
Disallow /S81495/ichiran.html
Disallow /shoptool/
Disallow /master/
Disallow /cart_orderinq.html
Disallow /ecopoint_goodslist.html
Disallow /*?PSID=
Disallow /*?*&PSID=
Disallow /S20002/*
Disallow /mshop/S20002/*
Disallow /item/IS20002N*

icc-crawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseo

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kyoto-wel.com/sitemap_index.xml

Warnings

  • 2 invalid lines.