dfid.gov.uk
robots.txt

Robots Exclusion Standard data for dfid.gov.uk

Resource Scan

Scan Details

Site Domain dfid.gov.uk
Base Domain dfid.gov.uk
Scan Status Ok
Last Scan2024-11-01T01:18:25+00:00
Next Scan 2024-11-15T01:18:25+00:00

Last Scan

Scanned2024-11-01T01:18:25+00:00
URL https://dfid.gov.uk/robots.txt
Domain IPs 151.101.2.30
Response IP 151.101.2.30
Found Yes
Hash 7fb6e27fa8b5fdeb7521303d5ec128981482181f872a8e4680d0746bce1ceb29
SimHash 690008048d92

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap http://dfid.gov.uk/sitemap.xml