beeradvocate.com
robots.txt

Robots Exclusion Standard data for beeradvocate.com

Resource Scan

Scan Details

Site Domain beeradvocate.com
Base Domain beeradvocate.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-26T19:22:44+00:00
Next Scan 2024-06-24T19:22:44+00:00

Last Successful Scan

Scanned2023-11-28T18:59:26+00:00
URL https://beeradvocate.com/robots.txt
Redirect https://www.beeradvocate.com/robots.txt
Redirect Domain www.beeradvocate.com
Redirect Base beeradvocate.com
Domain IPs 104.22.28.195, 104.22.29.195, 172.67.8.3, 2606:4700:10::6816:1cc3, 2606:4700:10::6816:1dc3, 2606:4700:10::ac43:803
Redirect IPs 104.22.28.195, 104.22.29.195, 172.67.8.3, 2606:4700:10::6816:1cc3, 2606:4700:10::6816:1dc3, 2606:4700:10::ac43:803
Response IP 104.22.28.195
Found Yes
Hash 9d695d4f49c0da241c4caffea35cd4fb75ba2695ffb1a6fbd26680c7ee5e9787
SimHash 4c05d054e323

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /beer/new/
Disallow /beer/trade/
Disallow /community/account/
Disallow /community/conversations/
Disallow /community/find-new/profile-posts
Disallow /community/login/
Disallow /community/members/
Disallow /community/register/
Disallow /community/search/
Disallow /fileupload/
Disallow /forms/
Disallow /members/
Disallow /place/directory/
Disallow /place/list/
Disallow /place/reviews/
Disallow /search/
Disallow /user/
Disallow /toolbox/
Allow /

Other Records

Field Value
sitemap https://www.beeradvocate.com/sitemap.xml
sitemap https://www.beeradvocate.com/community/sitemap.xml