hgvdirect.co.uk
robots.txt
Robots Exclusion Standard data for hgvdirect.co.uk
Resource Scan
Scan Details
| Site Domain | hgvdirect.co.uk |
| Base Domain | hgvdirect.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-11-22T00:14:44+00:00 |
| Next Scan | 2025-12-22T00:14:44+00:00 |
Last Scan
| Scanned | 2025-11-22T00:14:44+00:00 |
| URL | https://hgvdirect.co.uk/robots.txt |
| Domain IPs | 192.124.249.11 |
| Response IP | 192.124.249.11 |
| Found | Yes |
| Hash | 97f95ee6db399ffb803fdfda4e42048f36bf6885cb6ff01f2ba1daa81e1bab01 |
| SimHash | 4d14404c63bb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /catalogsearch |
| Disallow | /catalog/product_compare |
| Disallow | /wishlist |
| Disallow | /checkout |
| Disallow | /customer |
| Disallow | /sendfriend |
| Disallow | /review |
| Disallow | /newsletter |
| Disallow | /*?price= |
| Disallow | /*?dir= |
| Disallow | /*?order= |
| Disallow | /*?cat= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |