mhw-bike.com
robots.txt
Robots Exclusion Standard data for mhw-bike.com
Resource Scan
Scan Details
| Site Domain | mhw-bike.com |
| Base Domain | mhw-bike.com |
| Scan Status | Ok |
| Last Scan | 2024-06-21T23:52:32+00:00 |
| Next Scan | 2024-07-21T23:52:32+00:00 |
Last Scan
| Scanned | 2024-06-21T23:52:32+00:00 |
| URL | https://mhw-bike.com/robots.txt |
| Redirect | https://www.mhw-bike.com/robots.txt |
| Redirect Domain | www.mhw-bike.com |
| Redirect Base | mhw-bike.com |
| Domain IPs | 104.21.20.13, 172.67.190.198, 2606:4700:3035::ac43:bec6, 2606:4700:3037::6815:140d |
| Redirect IPs | 104.21.20.13, 172.67.190.198, 2606:4700:3035::ac43:bec6, 2606:4700:3037::6815:140d |
| Response IP | 104.21.20.13 |
| Found | Yes |
| Hash | c38a0edb009169237c3484b7e7df908240e9516965af50514497e336fbdab8ef |
| SimHash | e1541a50fabd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /compare/ |
| Disallow | /checkout/ |
| Disallow | /register/ |
| Disallow | /account/ |
| Disallow | /address/ |
| Disallow | /note/ |
| Disallow | /widgets/ |
| Disallow | /listing/ |
| Disallow | /ticket/ |
| Disallow | /tracking/ |
| Disallow | /versandkosten/ |
| Allow | /widgets/emotion |
| Allow | /widgets/index/refreshStatistic |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mhw-bike.com/sitemap_index.xml |