nowaki-kyoto.net
robots.txt

Robots Exclusion Standard data for nowaki-kyoto.net

Resource Scan

Scan Details

Site Domain nowaki-kyoto.net
Base Domain nowaki-kyoto.net
Scan Status Ok
Last Scan2024-06-24T02:43:14+00:00
Next Scan 2024-07-24T02:43:14+00:00

Last Scan

Scanned2024-06-24T02:43:14+00:00
URL https://nowaki-kyoto.net/robots.txt
Domain IPs 104.21.14.98, 172.67.158.156, 2606:4700:3031::6815:e62, 2606:4700:3033::ac43:9e9c
Response IP 172.67.158.156
Found Yes
Hash 4acda792aa477e74504addb79fd919b274806b75c8ba7ac5604b15852008f990
SimHash c67dde425a19

Groups

*

Rule Path
Disallow /iframe
Disallow /signup/register
Disallow /signup
Disallow /login
Disallow /logout
Disallow /cart
Disallow /mypage
Disallow /reset_password
Disallow /forgot_password
Disallow /checkout
Disallow /checkout_paypal
Disallow /checkout_carrier
Disallow /checkout_amazon_pay_callback
Disallow /checkout_amazon_pay_complete
Disallow /checkout_amazon_pay
Disallow /checkout_rakuten_pay
Disallow /checkout_rakuten_pay_error
Disallow /checkout_paypay_callback
Disallow /checkout_paypay
Disallow /items/*/image_gallery
Disallow /orders
Disallow /tokushoho

Other Records

Field Value
crawl-delay 20

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

blexbot

Rule Path
Disallow /