dwp.gov.uk
robots.txt

Robots Exclusion Standard data for dwp.gov.uk

Resource Scan

Scan Details

Site Domain dwp.gov.uk
Base Domain dwp.gov.uk
Scan Status Ok
Last Scan2026-01-20T02:35:27+00:00
Next Scan 2026-02-19T02:35:27+00:00

Last Scan

Scanned2026-01-20T02:35:27+00:00
URL http://dwp.gov.uk/robots.txt
Domain IPs 151.101.2.30
Response IP 151.101.2.30
Found Yes
Hash 58abf2240e8ea0ddb52fcfd71ebc778176631ce0a07f62d8c55d2707e4effa63
SimHash 680c5c048992

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap http://dwp.gov.uk/sitemap.xml