chards.co.uk
robots.txt
Robots Exclusion Standard data for chards.co.uk
Resource Scan
Scan Details
| Site Domain | chards.co.uk |
| Base Domain | chards.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-02T17:26:37+00:00 |
| Next Scan | 2024-10-02T17:26:37+00:00 |
Last Scan
| Scanned | 2024-09-02T17:26:37+00:00 |
| URL | https://chards.co.uk/robots.txt |
| Redirect | https://www.chards.co.uk/robots.txt |
| Redirect Domain | www.chards.co.uk |
| Redirect Base | chards.co.uk |
| Domain IPs | 75.2.60.5, 99.83.231.61 |
| Redirect IPs | 2406:da18:880:3800::c8, 2406:da18:b3d:e201::64, 46.137.195.11, 52.74.166.77 |
| Response IP | 46.137.195.11 |
| Found | Yes |
| Hash | cbf817a0c604e6c84dce7869f402469b8b20587c4d66556d063ebcb1791a43f1 |
| SimHash | 646bdb60ca19 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /basket/ |
| Disallow | /checkout/ |
| Disallow | /account/ |
| Disallow | /*?search* |
| Disallow | /products?* |
| Disallow | /*?attributes* |
| Disallow | /*?category* |
| Disallow | /*?sort_by* |
| Disallow | /investment-calculator?metal* |
| Disallow | /chatbot/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |