supermagnete.at
robots.txt

Robots Exclusion Standard data for supermagnete.at

Resource Scan

Scan Details

Site Domain supermagnete.at
Base Domain supermagnete.at
Scan Status Ok
Last Scan2025-05-04T23:36:02+00:00
Next Scan 2025-06-03T23:36:02+00:00

Last Scan

Scanned2025-05-04T23:36:02+00:00
URL https://supermagnete.at/robots.txt
Redirect https://www.supermagnete.at/robots.txt
Redirect Domain www.supermagnete.at
Redirect Base supermagnete.at
Domain IPs 104.26.4.42, 104.26.5.42, 172.67.68.217, 2606:4700:20::681a:42a, 2606:4700:20::681a:52a, 2606:4700:20::ac43:44d9
Redirect IPs 104.26.4.42, 104.26.5.42, 172.67.68.217, 2606:4700:20::681a:42a, 2606:4700:20::681a:52a, 2606:4700:20::ac43:44d9
Response IP 104.26.4.42
Found Yes
Hash f046d6b021759e401d6feb4c90a5a865d78a79f07db08c4dff41c3c9813af4ed
SimHash de464e80e304

Groups

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

yandex

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow /*Checkout*
Disallow /*checkout/*
Disallow /*search
Disallow /*paypal*.php
Disallow */saferpay/
Disallow */editcart.php
Disallow */login_check
Disallow */order/
Disallow */shop-warp*
Disallow */offer/article/request
Disallow */custom_order
Disallow */shop_order*
Disallow *?group=
Disallow *?img=
Disallow */notification.php*

Other Records

Field Value
crawl-delay 3

bingbot

Rule Path
Disallow /*Checkout*
Disallow /*search
Disallow /*paypal*.php
Disallow */saferpay/
Disallow */editcart.php
Disallow */login_check
Disallow */order/
Disallow */shop-warp*
Disallow */offer/article/request
Disallow */custom_order
Disallow */shop_order*
Disallow *?group=
Disallow *?img=
Disallow */notification.php*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.supermagnete.at/sitemap.xml