supermagnete.fr
robots.txt
Robots Exclusion Standard data for supermagnete.fr
Resource Scan
Scan Details
| Site Domain | supermagnete.fr |
| Base Domain | supermagnete.fr |
| Scan Status | Ok |
| Last Scan | 2025-12-20T02:26:43+00:00 |
| Next Scan | 2026-01-03T02:26:43+00:00 |
Last Scan
| Scanned | 2025-12-20T02:26:43+00:00 |
| URL | https://supermagnete.fr/robots.txt |
| Redirect | https://www.supermagnete.fr/robots.txt |
| Redirect Domain | www.supermagnete.fr |
| Redirect Base | supermagnete.fr |
| Domain IPs | 104.26.2.166, 104.26.3.166, 172.67.74.227, 2606:4700:20::681a:2a6, 2606:4700:20::681a:3a6, 2606:4700:20::ac43:4ae3 |
| Redirect IPs | 104.26.2.166, 104.26.3.166, 172.67.74.227, 2606:4700:20::681a:2a6, 2606:4700:20::681a:3a6, 2606:4700:20::ac43:4ae3 |
| Response IP | 104.26.2.166 |
| Found | Yes |
| Hash | e5a904d665ba6700f45c34e6f9b462547c9e7763934d55c782f91fa9fe31256a |
| SimHash | ce464c00e728 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*checkout/* |
| Disallow | /*search |
| Disallow | /*paypal*.php |
| Disallow | */saferpay/ |
| Disallow | */editcart.php |
| Disallow | */login_check |
| Disallow | */order/ |
| Disallow | */shop-warp* |
| Disallow | */offer/article/request |
| Disallow | */custom_order |
| Disallow | */shop_order* |
| Disallow | *?group= |
| Disallow | *?img= |
| Disallow | */availabilitynotification/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /*checkout/* |
| Disallow | /*search |
| Disallow | /*paypal*.php |
| Disallow | */saferpay/ |
| Disallow | */editcart.php |
| Disallow | */login_check |
| Disallow | */order/ |
| Disallow | */shop-warp* |
| Disallow | */offer/article/request |
| Disallow | */custom_order |
| Disallow | */shop_order* |
| Disallow | *?group= |
| Disallow | *?img= |
| Disallow | */availabilitynotification/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.supermagnete.fr/sitemap.xml |