craftbeering.com
robots.txt

Robots Exclusion Standard data for craftbeering.com

Resource Scan

Scan Details

Site Domain craftbeering.com
Base Domain craftbeering.com
Scan Status Ok
Last Scan2024-11-18T21:23:57+00:00
Next Scan 2024-11-25T21:23:57+00:00

Last Scan

Scanned2024-11-18T21:23:57+00:00
URL https://craftbeering.com/robots.txt
Domain IPs 104.21.10.157, 172.67.131.139, 2606:4700:3031::ac43:838b, 2606:4700:3035::6815:a9d
Response IP 172.67.131.139
Found Yes
Hash c8dd77e6f626bd01bb49bcb7de12c5459f26458fd32e96739926c2eaa76b62a4
SimHash 3058d940a192

Groups

*

Rule Path
Disallow

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /