catalogueoffers.co.uk
robots.txt
Robots Exclusion Standard data for catalogueoffers.co.uk
Resource Scan
Scan Details
| Site Domain | catalogueoffers.co.uk |
| Base Domain | catalogueoffers.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-28T08:51:02+00:00 |
| Next Scan | 2024-10-05T08:51:02+00:00 |
Last Scan
| Scanned | 2024-09-28T08:51:02+00:00 |
| URL | https://catalogueoffers.co.uk/robots.txt |
| Redirect | https://www.catalogueoffers.co.uk/robots.txt |
| Redirect Domain | www.catalogueoffers.co.uk |
| Redirect Base | catalogueoffers.co.uk |
| Domain IPs | 104.21.34.163, 172.67.163.18, 2606:4700:3030::ac43:a312, 2606:4700:3033::6815:22a3 |
| Redirect IPs | 13.227.254.118, 13.227.254.72, 13.227.254.82, 13.227.254.89, 2600:9000:200a:0:e:11d3:21c0:93a1, 2600:9000:200a:2000:e:11d3:21c0:93a1, 2600:9000:200a:4800:e:11d3:21c0:93a1, 2600:9000:200a:5e00:e:11d3:21c0:93a1, 2600:9000:200a:7800:e:11d3:21c0:93a1, 2600:9000:200a:7c00:e:11d3:21c0:93a1, 2600:9000:200a:8e00:e:11d3:21c0:93a1, 2600:9000:200a:c600:e:11d3:21c0:93a1 |
| Response IP | 13.227.254.89 |
| Found | Yes |
| Hash | 2642dabf73090f9b2c4071016e90ea4a0da6d0fd47607fbcbf50f168a1d99d05 |
| SimHash | ec97ef01d510 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search/* |
| Disallow | /shopping-list/ |
| Disallow | /click-out/ |
| Disallow | /index.php/click-out/ |
| Disallow | /admin/ |
| Disallow | /cdn-cgi/ |
| Disallow | /offers/*?sort=relevance&page=*&* |
| Allow | /offers/*?sort=relevance&page=* |
| Disallow | /offers/*?page=*&* |
| Allow | /offers/*?page=* |
| Disallow | /offers/*?* |
| Disallow | /brands/*?page=*&* |
| Allow | /brands/*?page=* |
| Disallow | /brands/*?* |
| Disallow | /stores/*?page=*&* |
| Allow | /stores/*?page=* |
| Disallow | /stores/*?* |
| Disallow | /cities/*?page=*&* |
| Allow | /cities/*?page=* |
| Disallow | /cities/*?* |
| Disallow | /latest-leaflets?page=*&* |
| Allow | /latest-leaflets?page=* |
| Disallow | /latest-leaflets?* |
| Disallow | /almost-expired-leaflets?page=*&* |
| Allow | /almost-expired-leaflets?page=* |
| Disallow | /almost-expired-leaflets?* |
| Disallow | /popular-leaflets?page=*&* |
| Allow | /popular-leaflets?page=* |
| Disallow | /popular-leaflets?* |
| Disallow | /recommended-leaflets?page=*&* |
| Allow | /recommended-leaflets?page=* |
| Disallow | /recommended-leaflets?* |
| Disallow | /latest-offers?page=*&* |
| Allow | /latest-offers?page=* |
| Disallow | /latest-offers?* |
| Disallow | /almost-expired-offers?page=*&* |
| Allow | /almost-expired-offers?page=* |
| Disallow | /almost-expired-offers?* |
| Disallow | /popular-offers?page=*&* |
| Allow | /popular-offers?page=* |
| Disallow | /popular-offers?* |
| Disallow | /recommended-offers?page=*&* |
| Allow | /recommended-offers?page=* |
| Disallow | /recommended-offers?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.catalogueoffers.co.uk/sitemap.xml |