drmartens.com
robots.txt
Robots Exclusion Standard data for drmartens.com
Resource Scan
Scan Details
| Site Domain | drmartens.com |
| Base Domain | drmartens.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-22T02:42:17+00:00 |
| Next Scan | 2025-01-20T02:42:17+00:00 |
Last Successful Scan
| Scanned | 2023-09-05T03:23:36+00:00 |
| URL | https://www.drmartens.com/robots.txt |
| Domain IPs | 104.18.41.134, 172.64.146.122, 2606:4700:4400::6812:2986, 2606:4700:4400::ac40:927a |
| Response IP | 172.64.146.122 |
| Found | Yes |
| Hash | 9a68da93bce192f7af85396992188b0c67519b526105e24a78d0cfab0cc866ec |
| SimHash | 01553712fdf0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/cart |
| Disallow | /*/checkout |
| Disallow | /*/my-account |
| Disallow | /*/search |
| Disallow | /*/login |
| Disallow | */c/*?*=* |
| Disallow | /*filtered* |
| Disallow | */p/*?yoReviews |
| Allow | */c/*?page=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.drmartens.com/de/de/sitemap.xml |
| sitemap | https://www.drmartens.com/es/es/sitemap.xml |
| sitemap | https://www.drmartens.com/eu/en_eu/sitemap.xml |
| sitemap | https://www.drmartens.com/fr/fr/sitemap.xml |
| sitemap | https://www.drmartens.com/it/it/sitemap.xml |
| sitemap | https://www.drmartens.com/nl/nl/sitemap.xml |
| sitemap | https://www.drmartens.com/uk/en_gb/sitemap.xml |
| sitemap | https://www.drmartens.com/us/en/sitemap.xml |
| sitemap | https://www.drmartens.com/ca/en_ca/sitemap.xml |
| sitemap | https://www.drmartens.com/se/se/sitemap.xml |
| sitemap | https://www.drmartens.com/dk/da/sitemap.xml |
| sitemap | https://www.drmartens.com/fi/fi/sitemap.xml |
| sitemap | https://www.drmartens.com/intl/en/sitemap.xml |
Comments