Log In Sign Up

brewdigital.com
robots.txt

Robots Exclusion Standard data for brewdigital.com

Resource Scan

Scan Details

Site Domain brewdigital.com
Base Domain brewdigital.com
Scan Status Ok
Last Scan2025-04-28T03:13:15+00:00
Next Scan 2025-05-28T03:13:15+00:00

Last Scan

Scanned2025-04-28T03:13:15+00:00
URL https://brewdigital.com/robots.txt
Domain IPs 104.26.12.129, 104.26.13.129, 172.67.73.252, 2606:4700:20::681a:c81, 2606:4700:20::681a:d81, 2606:4700:20::ac43:49fc
Response IP 104.26.12.129
Found Yes
Hash 5a8c2f06150744ee597b8a4110d7a0a221aa112aa77a0039fce3837ff59628d4
SimHash 5094494880b6

Groups

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /
Back to top