environment.data.gov.uk
robots.txt

Robots Exclusion Standard data for environment.data.gov.uk

Resource Scan

Scan Details

Site Domain environment.data.gov.uk
Base Domain data.gov.uk
Scan Status Ok
Last Scan2026-01-27T10:40:09+00:00
Next Scan 2026-02-26T10:40:09+00:00

Last Scan

Scanned2026-01-27T10:40:09+00:00
URL https://environment.data.gov.uk/robots.txt
Domain IPs 4.234.196.14
Response IP 4.234.196.14
Found Yes
Hash 3cb46b4d9df0f5ec67e1f71a6a74cdfd169ffbb23269c3d4af8bfb42a249d0fe
SimHash 28450d41efb0

Groups

*

Rule Path
Disallow /pubutil/
Disallow /doc/
Disallow /data/
Disallow /bng/api/
Disallow /image/services/HomeOffice/ResilienceDirect/MapServer/WMSServer
Disallow /geoservices
Disallow /public-register/view/api-reference
Disallow /asset-management-editor
Disallow /searchresults
Disallow /water-quality

Other Records

Field Value
sitemap https://environment.data.gov.uk/sitemap.xml

Comments

  • Bathing Water Quality API and internal
  • Biodiversity Net Gain API
  • Geospatial services
  • Public registers online API
  • AIMS/DRL
  • Catalogue search
  • WIMS