brewa.pl
robots.txt

Robots Exclusion Standard data for brewa.pl

Resource Scan

Scan Details

Site Domain brewa.pl
Base Domain brewa.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-18T14:49:25+00:00
Next Scan 2025-11-01T14:49:25+00:00

Last Successful Scan

Scanned2025-09-10T14:36:52+00:00
URL https://brewa.pl/robots.txt
Redirect https://www.brewa.pl/robots.txt
Redirect Domain www.brewa.pl
Redirect Base brewa.pl
Domain IPs 104.21.79.30, 172.67.168.237, 2606:4700:3032::6815:4f1e, 2606:4700:3032::ac43:a8ed
Redirect IPs 104.21.79.30, 172.67.168.237, 2606:4700:3032::6815:4f1e, 2606:4700:3032::ac43:a8ed
Response IP 104.21.79.30
Found Yes
Hash 9d6b268cd1d502210752df55d99af902b441100bde19855a3cd3bbd6fc7b7a78
SimHash bc10408261f2

Groups

*

Rule Path
Disallow /*.pdf$
Disallow /media/
Disallow /polityka-cookies.html
Disallow /brewa/regulaminy.html
Disallow /newsletter/unsubscribe.html
Disallow /brewa/polityka-prywatnosci.html
Disallow /brewa/zostan-partnerem-brewa-informacje-o-wspolpracy.html
Disallow /*tag1
Disallow /*tag2
Disallow /*?tag
Disallow /*tag
Disallow /*gclid