gohenry.co.uk
robots.txt

Robots Exclusion Standard data for gohenry.co.uk

Resource Scan

Scan Details

Site Domain gohenry.co.uk
Base Domain gohenry.co.uk
Scan Status Ok
Last Scan2025-10-16T10:01:07+00:00
Next Scan 2025-11-15T10:01:07+00:00

Last Scan

Scanned2025-10-16T10:01:07+00:00
URL https://gohenry.co.uk/robots.txt
Redirect https://awardedtenders.uk/robots.txt
Redirect Domain awardedtenders.uk
Redirect Base awardedtenders.uk
Domain IPs 104.18.12.127, 104.18.13.127, 2606:4700::6812:c7f, 2606:4700::6812:d7f
Redirect IPs 34.120.9.79
Response IP 34.120.9.79
Found Yes
Hash fa63b7b0aa53c669746e2279efd8f880725bacba5e73104b33b15d549407f30b
SimHash 123459600172

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /