stuartslondon.com
robots.txt
Robots Exclusion Standard data for stuartslondon.com
Resource Scan
Scan Details
| Site Domain | stuartslondon.com |
| Base Domain | stuartslondon.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T08:49:51+00:00 |
| Next Scan | 2024-11-27T08:49:51+00:00 |
Last Scan
| Scanned | 2024-10-28T08:49:51+00:00 |
| URL | https://stuartslondon.com/robots.txt |
| Redirect | https://www.stuartslondon.com/robots.txt |
| Redirect Domain | www.stuartslondon.com |
| Redirect Base | stuartslondon.com |
| Domain IPs | 109.108.148.102 |
| Redirect IPs | 109.108.148.112 |
| Response IP | 109.108.148.112 |
| Found | Yes |
| Hash | e956465865b65a5be14082b2f540fd2e991e9825717540a94b5f0c6a26d86326 |
| SimHash | 600bd7f0060c |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ajax/removefrombasket/ |
| Disallow | /au/ajax/removefrombasket/ |
| Disallow | /basket$ |
| Disallow | /au/basket$ |
| Disallow | /checkout/ |
| Disallow | /au/checkout/ |
| Disallow | /errors/ |
| Disallow | /au/errors/ |
| Disallow | /quickbuy/ |
| Disallow | /au/quickbuy/ |
| Disallow | /au/product_personalisation/ |
| Disallow | /register/ |
| Disallow | /au/register/ |
| Disallow | /register |
| Disallow | /au/register |
| Disallow | /vs/ |
| Disallow | /au/vs/ |
| Disallow | /images/products/yofla/ |
| Disallow | /au/images/products/yofla/ |
| Disallow | /customer_groups/choose_group/ |
| Disallow | /au/customer_groups/choose_group/ |
| Disallow | /formbuilder/ |
| Disallow | /au/formbuilder/ |
| Disallow | /callbacks/ |
| Disallow | /au/callbacks/ |
| Disallow | /ajax/formatprice/ |
| Disallow | /au/ajax/formatprice/ |
| Disallow | /products/ |
| Disallow | /au/products/ |
| Disallow | /productimages/gallery/ |
| Disallow | /images/products/moving_stills/ |
| Disallow | /productimages/ |
| Disallow | /tell-a-friend-tb33 |
| Disallow | /*under-25-gbp-b1$ |
| Disallow | /*25-to-50-gbp-b2$ |
| Disallow | /*50-to-75-gbp-b3$ |
| Disallow | /*75-to-100-gbp-b4$ |
| Disallow | /*100-to-200-gbp-b5$ |
| Disallow | /*200-to-300-gbp-b6$ |
| Disallow | /*300-to-400-gbp-b7$ |
| Disallow | /*400-500-gbp-b8$ |
| Disallow | /*500-to-1000-gbp-b9$ |
| Disallow | /images/digitalmag/ |
| Disallow | /search/ |
| Disallow | /wishlist/ |
| Disallow | /gift-ideas-c182/ |
| Disallow | /buyers-top-12-selected-c115/ |
| Disallow | /weekend-outfit-c194/ |
| Disallow | /autumn-winter-2015-c197/ |
| Disallow | /spring-summer-2015-c195/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.stuartslondon.com/sitemap-index.xml |
| sitemap | https://www.stuartslondon.com/au/sitemap-index.xml |
| sitemap | https://www.stuartslondon.com/blog/sitemap.xml |
Warnings
- `request-rate` is not a known field.