gloucestershire.gov.uk
robots.txt

Robots Exclusion Standard data for gloucestershire.gov.uk

Resource Scan

Scan Details

Site Domain gloucestershire.gov.uk
Base Domain gloucestershire.gov.uk
Scan Status Ok
Last Scan2024-10-11T03:34:49+00:00
Next Scan 2024-11-10T03:34:49+00:00

Last Scan

Scanned2024-10-11T03:34:49+00:00
URL https://gloucestershire.gov.uk/robots.txt
Domain IPs 20.77.81.59
Response IP 20.77.81.59
Found Yes
Hash e5a847221d8faf990d52422a04d6816d66b02afa00aef0921f4bb2c76b45895f
SimHash e80c4001c7f7

Groups

*

Rule Path
Disallow /

twitterbot

Rule Path
Allow /*

facebookexternalhit

Rule Path
Allow /*

linkedinbot

Rule Path
Allow /*

googlebot

Rule Path
Allow /*

bingbot

Rule Path
Allow /*