giftmall.co.jp
robots.txt

Robots Exclusion Standard data for giftmall.co.jp

Resource Scan

Scan Details

Site Domain giftmall.co.jp
Base Domain giftmall.co.jp
Scan Status Ok
Last Scan2024-11-12T06:17:40+00:00
Next Scan 2024-11-26T06:17:40+00:00

Last Scan

Scanned2024-11-12T06:17:40+00:00
URL https://giftmall.co.jp/robots.txt
Domain IPs 104.26.10.36, 104.26.11.36, 172.67.72.245, 2606:4700:20::681a:a24, 2606:4700:20::681a:b24, 2606:4700:20::ac43:48f5
Response IP 172.67.72.245
Found Yes
Hash 839a34038e76fa743a3c37670f03a7d1bcad724c26560a224cf21b8a288c56c9
SimHash ec2c426cca39

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

y!j-brj/yats crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

*

Rule Path
Disallow /cart/
Disallow /cart/index.php
Disallow /contact/
Disallow /contact/index.php
Disallow /contact/complete
Disallow /contact/complete.php
Disallow /entry/
Disallow /entry/index.php
Disallow /entry/complete
Disallow /entry/complete.php
Disallow /forgot/
Disallow /forgot/index.php
Disallow /password/
Disallow /mypage/
Disallow /mypage/index.php
Disallow /mypage/change
Disallow /mypage/change.php
Disallow /mypage/delivery
Disallow /mypage/delivery.php
Disallow /mypage/delivery_addr
Disallow /mypage/delivery_addr.php
Disallow /mypage/login
Disallow /mypage/login.php
Disallow /shop/*/cart/
Disallow /shop/*/cart/index.php
Disallow /shop/*/shopping/form
Disallow /shop/*/shopping/form.php
Disallow /shop/*/shopping/form_confirm
Disallow /shop/*/shopping/form_confirm.php
Disallow /shop/*/shopping/confirm
Disallow /shop/*/shopping/confirm.php
Disallow /shop/*/shopping/deliv
Disallow /shop/*/shopping/deliv.php
Disallow /shop/*/shopping/
Disallow /shop/*/shopping/index.php
Disallow /shop/*/shopping/load_payment_module
Disallow /shop/*/shopping/load_payment_module.php
Disallow /shop/*/shopping/payment
Disallow /shop/*/shopping/payment.php
Disallow /shop/*/shopping/checkout
Disallow /shop/*/shopping/checkout_result
Disallow /shopping/address_form
Disallow /shopping/address_form.php
Disallow /external_callback/
Disallow /mgt/