Log In Sign Up

security.gov.uk
robots.txt

Robots Exclusion Standard data for security.gov.uk

Resource Scan

Scan Details

Site Domain security.gov.uk
Base Domain security.gov.uk
Scan Status Ok
Last Scan2024-06-17T15:22:26+00:00
Next Scan 2024-07-01T15:22:26+00:00

Last Scan

Scanned2024-06-17T15:22:26+00:00
URL https://security.gov.uk/robots.txt
Redirect https://www.security.gov.uk/robots.txt
Redirect Domain www.security.gov.uk
Redirect Base security.gov.uk
Domain IPs 13.226.2.114, 13.226.2.24, 13.226.2.42, 13.226.2.47, 2600:9000:24ba:0:17:3c6b:7b40:93a1, 2600:9000:24ba:2400:17:3c6b:7b40:93a1, 2600:9000:24ba:3e00:17:3c6b:7b40:93a1, 2600:9000:24ba:7a00:17:3c6b:7b40:93a1, 2600:9000:24ba:a000:17:3c6b:7b40:93a1, 2600:9000:24ba:ba00:17:3c6b:7b40:93a1, 2600:9000:24ba:ca00:17:3c6b:7b40:93a1, 2600:9000:24ba:fc00:17:3c6b:7b40:93a1
Redirect IPs 18.164.174.127, 18.164.174.69, 18.164.174.96, 18.164.174.97, 2600:9000:263c:1e00:17:3c6b:7b40:93a1, 2600:9000:263c:3600:17:3c6b:7b40:93a1, 2600:9000:263c:4c00:17:3c6b:7b40:93a1, 2600:9000:263c:5800:17:3c6b:7b40:93a1, 2600:9000:263c:7000:17:3c6b:7b40:93a1, 2600:9000:263c:9200:17:3c6b:7b40:93a1, 2600:9000:263c:9600:17:3c6b:7b40:93a1, 2600:9000:263c:e00:17:3c6b:7b40:93a1
Response IP 3.160.246.54
Found Yes
Hash d51681bcf6189e181494aecfe6c5af917217a548df629f8e98957b8baef5aa28
SimHash 6d5099d2f7b0

Groups

googlebot
adsbot-google
adsbot-google-mobile

Rule Path
Allow /

*

Rule Path
Allow /
Back to top