dobies.co.uk
robots.txt
Robots Exclusion Standard data for dobies.co.uk
Resource Scan
Scan Details
| Site Domain | dobies.co.uk |
| Base Domain | dobies.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-03-19T12:28:29+00:00 |
| Next Scan | 2025-04-18T12:28:29+00:00 |
Last Scan
| Scanned | 2025-03-19T12:28:29+00:00 |
| URL | https://dobies.co.uk/robots.txt |
| Redirect | https://www.dobies.co.uk/robots.txt |
| Redirect Domain | www.dobies.co.uk |
| Redirect Base | dobies.co.uk |
| Domain IPs | 162.13.65.111 |
| Redirect IPs | 162.13.65.111 |
| Response IP | 162.13.65.111 |
| Found | Yes |
| Hash | 4aeb2c8ed98eadd9281bb89f31011900cdd4abdca1f3de65d0c6095aa54d1b27 |
| SimHash | 3531ddc0a9d0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /reader |
| Disallow | /all-offers/* |
| Disallow | /basket |
| Disallow | /error |
| Disallow | /search/go* |
| Disallow | /PartialControlHandler.ashx* |
Warnings
- `noindex` is not a known field.