brewdigital.uk
robots.txt

Robots Exclusion Standard data for brewdigital.uk

Resource Scan

Scan Details

Site Domain brewdigital.uk
Base Domain brewdigital.uk
Scan Status Ok
Last Scan2025-04-28T07:06:56+00:00
Next Scan 2025-05-28T07:06:56+00:00

Last Scan

Scanned2025-04-28T07:06:56+00:00
URL https://brewdigital.uk/robots.txt
Redirect https://brewdigital.com/robots.txt
Redirect Domain brewdigital.com
Redirect Base brewdigital.com
Domain IPs 104.21.51.30, 172.67.220.7, 2606:4700:3032::6815:331e, 2606:4700:3035::ac43:dc07
Redirect IPs 104.26.12.129, 104.26.13.129, 172.67.73.252, 2606:4700:20::681a:c81, 2606:4700:20::681a:d81, 2606:4700:20::ac43:49fc
Response IP 104.26.13.129
Found Yes
Hash 5a8c2f06150744ee597b8a4110d7a0a221aa112aa77a0039fce3837ff59628d4
SimHash 5094494880b6

Groups

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /