barnsleysaggregates.co.uk
robots.txt
Robots Exclusion Standard data for barnsleysaggregates.co.uk
Resource Scan
Scan Details
| Site Domain | barnsleysaggregates.co.uk |
| Base Domain | barnsleysaggregates.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-06-19T02:26:15+00:00 |
| Next Scan | 2025-08-18T02:26:15+00:00 |
Last Successful Scan
| Scanned | 2025-03-29T00:06:50+00:00 |
| URL | https://barnsleysaggregates.co.uk/robots.txt |
| Domain IPs | 104.21.7.153, 172.67.130.82, 2606:4700:3031::6815:799, 2606:4700:3033::ac43:8252 |
| Response IP | 104.21.7.153 |
| Found | Yes |
| Hash | 44fac7b94f4a3a859a424e05da43127c7d10f57374174bb828838f9ecc98b9c9 |
| SimHash | 436168c0e5d2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://barnsleysaggregates.co.uk/sitemap_index.xml |
| sitemap | http://barnsleysaggregates.co.uk/sitemap_index.php |
Warnings
- `host` is not a known field.
Comments