supervoid-caudex.com
robots.txt

Robots Exclusion Standard data for supervoid-caudex.com

Resource Scan

Scan Details

Site Domain supervoid-caudex.com
Base Domain supervoid-caudex.com
Scan Status Ok
Last Scan2024-06-23T12:53:08+00:00
Next Scan 2024-07-23T12:53:08+00:00

Last Scan

Scanned2024-06-23T12:53:08+00:00
URL https://supervoid-caudex.com/robots.txt
Domain IPs 104.21.16.22, 172.67.165.248, 2606:4700:3031::ac43:a5f8, 2606:4700:3032::6815:1016
Response IP 172.67.165.248
Found Yes
Hash 4acda792aa477e74504addb79fd919b274806b75c8ba7ac5604b15852008f990
SimHash c67dde425a19

Groups

*

Rule Path
Disallow /iframe
Disallow /signup/register
Disallow /signup
Disallow /login
Disallow /logout
Disallow /cart
Disallow /mypage
Disallow /reset_password
Disallow /forgot_password
Disallow /checkout
Disallow /checkout_paypal
Disallow /checkout_carrier
Disallow /checkout_amazon_pay_callback
Disallow /checkout_amazon_pay_complete
Disallow /checkout_amazon_pay
Disallow /checkout_rakuten_pay
Disallow /checkout_rakuten_pay_error
Disallow /checkout_paypay_callback
Disallow /checkout_paypay
Disallow /items/*/image_gallery
Disallow /orders
Disallow /tokushoho

Other Records

Field Value
crawl-delay 20

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

blexbot

Rule Path
Disallow /