beerizer.com
robots.txt

Robots Exclusion Standard data for beerizer.com

Resource Scan

Scan Details

Site Domain beerizer.com
Base Domain beerizer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-12T03:24:42+00:00
Next Scan 2025-08-10T03:24:42+00:00

Last Successful Scan

Scanned2025-01-13T00:10:28+00:00
URL https://beerizer.com/robots.txt
Domain IPs 104.21.33.208, 172.67.166.160, 2606:4700:3035::6815:21d0, 2606:4700:3035::ac43:a6a0
Response IP 172.67.166.160
Found Yes
Hash bdc10c79e5492b8b2547df96bd622f8d27007b2e43de2d5b249da88e967d4670
SimHash 9c18d120dd50

Groups

*

Rule Path
Disallow /redirect/*
Disallow /login
Disallow /yadayada/
Disallow /shop/*/bundle_maker
Disallow /shop.png
Disallow /shop/*.png

semrushbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /shop.png
Disallow /shop/*.png
Disallow /index.php/shop.png
Disallow /index.php/shop/*.png
Disallow /img/generated/*