think.gov.uk
robots.txt

Robots Exclusion Standard data for think.gov.uk

Resource Scan

Scan Details

Site Domain think.gov.uk
Base Domain think.gov.uk
Scan Status Ok
Last Scan2024-04-18T12:56:42+00:00
Next Scan 2024-05-18T12:56:42+00:00

Last Scan

Scanned2024-04-18T12:56:42+00:00
URL https://think.gov.uk/robots.txt
Redirect https://www.think.gov.uk/robots.txt
Redirect Domain www.think.gov.uk
Redirect Base think.gov.uk
Domain IPs 15.197.178.82, 3.33.190.119
Redirect IPs 2600:9000:269a:1000:c:2ee1:5d80:93a1, 2600:9000:269a:1c00:c:2ee1:5d80:93a1, 2600:9000:269a:4600:c:2ee1:5d80:93a1, 2600:9000:269a:5e00:c:2ee1:5d80:93a1, 2600:9000:269a:8400:c:2ee1:5d80:93a1, 2600:9000:269a:c400:c:2ee1:5d80:93a1, 2600:9000:269a:ca00:c:2ee1:5d80:93a1, 2600:9000:269a:dc00:c:2ee1:5d80:93a1, 3.160.188.101, 3.160.188.102, 3.160.188.68, 3.160.188.73
Response IP 18.165.171.42
Found Yes
Hash 98c4910109d9e88231b752ab8139708124b34e34be22d3b7080ba3ce7af71cb7
SimHash 410108008bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.think.gov.uk/wp-sitemap.xml