jonrichard.com
robots.txt
Robots Exclusion Standard data for jonrichard.com
Resource Scan
Scan Details
| Site Domain | jonrichard.com |
| Base Domain | jonrichard.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T18:10:30+00:00 |
| Next Scan | 2024-12-13T18:10:30+00:00 |
Last Scan
| Scanned | 2024-11-13T18:10:30+00:00 |
| URL | https://jonrichard.com/robots.txt |
| Redirect | https://www.jonrichard.com/robots.txt |
| Redirect Domain | www.jonrichard.com |
| Redirect Base | jonrichard.com |
| Domain IPs | 109.108.148.102, 81.29.73.170 |
| Redirect IPs | 80.66.203.177 |
| Response IP | 80.66.203.177 |
| Found | Yes |
| Hash | e72da46482d14db4114ba59da8eed24a8c613c4f8a2083bffda6d55953592de0 |
| SimHash | 700fde41c69a |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ajax/removefrombasket/ |
| Disallow | /basket$ |
| Disallow | /checkout/ |
| Disallow | /errors/ |
| Disallow | /quickbuy/ |
| Disallow | /register/ |
| Disallow | /vs/ |
| Disallow | /images/products/yofla/ |
| Disallow | /customer_groups/choose_group/ |
| Disallow | /formbuilder/ |
| Disallow | /callbacks/ |
| Disallow | /ajax/formatprice/ |
| Disallow | /products/ |
| Disallow | /images/products/moving_stills/ |
| Disallow | /*.cfm$ |
| Disallow | /images/products/moving_stills/ |
| Disallow | /press_office/ |
| Disallow | /search/ |
| Disallow | /ask-a-question-i28/ |
| Disallow | /*under-10-gbp-b1$ |
| Disallow | /*10-to-15-gbp-b2$ |
| Disallow | /*50-to-75-gbp-b3$ |
| Disallow | /*75-to-100-gbp-b4$ |
| Disallow | /*100-to-200-gbp-b5$ |
| Disallow | /*200-to-300-gbp-b6$ |
| Disallow | /*15-to-25-gbp-b14$ |
| Disallow | /*25-to-50-gbp-b15$ |
| Disallow | /*.cfm$ |
| Disallow | /press_office/ |
| Disallow | /search/ |
| Disallow | /*under-10-gbp-b1$ |
| Disallow | /*10-to-15-gbp-b2$ |
| Disallow | /*50-to-75-gbp-b3$ |
| Disallow | /*75-to-100-gbp-b4$ |
| Disallow | /*100-to-200-gbp-b5$ |
| Disallow | /*200-to-300-gbp-b6$ |
| Disallow | /*15-to-25-gbp-b14$ |
| Disallow | /*25-to-50-gbp-b15$ |
| Disallow | /productimages/ |
| Disallow | /images/products/moving_stills/ |
| Disallow | /ask-a-question-i28/ |
| Disallow | */best-sellers-t1673 |
| Disallow | */under-*-t*$ |
| Disallow | */*-to-*-t*$ |
| Allow | /blog/*-to-* |
| Disallow | */*-discount-t*$ |
| Disallow | *full-price-t315 |
| Disallow | /wishlist |
| Disallow | /basket |
| Disallow | *?page= |
| Disallow | /gifts-c24/*-p*$ |
| Disallow | *-a39$ |
| Disallow | *-a4$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.jonrichard.com/sitemap-index.xml |
| sitemap | https://www.jonrichard.com/sitemap-index.xml |
Warnings
- `request-rate` is not a known field.