npg.org.uk
robots.txt
Robots Exclusion Standard data for npg.org.uk
Resource Scan
Scan Details
| Site Domain | npg.org.uk |
| Base Domain | npg.org.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-20T01:27:25+00:00 |
| Next Scan | 2025-09-19T01:27:25+00:00 |
Last Successful Scan
| Scanned | 2025-06-28T18:05:04+00:00 |
| URL | https://npg.org.uk/robots.txt |
| Redirect | https://www.npg.org.uk/robots.txt |
| Redirect Domain | www.npg.org.uk |
| Redirect Base | npg.org.uk |
| Domain IPs | 104.26.4.251, 104.26.5.251, 172.67.72.38 |
| Redirect IPs | 104.26.4.251, 104.26.5.251, 172.67.72.38 |
| Response IP | 104.26.4.251 |
| Found | Yes |
| Hash | 5af72eba332b6388194dec23c7e72cf6e9b9350bcac396556281cde626de742f |
| SimHash | 66151c46e2fa |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /search.php |
| Disallow | /events-search |
| Disallow | /live/ |
| Disallow | /live/* |
| Disallow | /shop/shop-list |
| Disallow | /shop/shop-list.php |
| Disallow | /dev/* |
| Disallow | /dev2/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 4 |
Comments