ne-derbyshire.gov.uk
robots.txt
Robots Exclusion Standard data for ne-derbyshire.gov.uk
Resource Scan
Scan Details
| Site Domain | ne-derbyshire.gov.uk |
| Base Domain | ne-derbyshire.gov.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-10T12:57:53+00:00 |
| Next Scan | 2024-10-17T12:57:53+00:00 |
Last Scan
| Scanned | 2024-10-10T12:57:53+00:00 |
| URL | https://ne-derbyshire.gov.uk/robots.txt |
| Redirect | https://www.ne-derbyshire.gov.uk/robots.txt |
| Redirect Domain | www.ne-derbyshire.gov.uk |
| Redirect Base | ne-derbyshire.gov.uk |
| Domain IPs | 213.175.196.48 |
| Redirect IPs | 104.26.0.101, 104.26.1.101, 172.67.70.239, 2606:4700:20::681a:165, 2606:4700:20::681a:65, 2606:4700:20::ac43:46ef |
| Response IP | 172.67.70.239 |
| Found | Yes |
| Hash | e5af67364f0d08c842370c9adbbd511f20661a61ad8da9a96fc509b81ece2016 |
| SimHash | 391c9530eb08 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Allow | /cache/com_templates/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /components/com_edocman/ |
| Disallow | /documents/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /modules/ |
| Disallow | /templates/ |
| Allow | /templates/shaper_helixultimate/ |
| Disallow | /tmp/ |
| Disallow | /_applications/ |
| Disallow | /_old/ |
| Disallow | /*?* |
| Disallow | /*com_content* |
| Disallow | /*Itemid%3D* |
| Disallow | /*id%3D* |
| Disallow | /*catid%3D* |
| Disallow | /*print%3D1* |
| Disallow | /*com_jevents* |
| Disallow | /*tag* |
| Disallow | /*tags* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ne-derbyshire.gov.uk/component/route66/sitemap/1/content?format=xml |
Comments