homebrewtalk.com.br
robots.txt
Robots Exclusion Standard data for homebrewtalk.com.br
Resource Scan
Scan Details
Site Domain | homebrewtalk.com.br |
Base Domain | homebrewtalk.com.br |
Scan Status | Ok |
Last Scan | 2024-06-06T08:59:36+00:00 |
Next Scan | 2024-06-13T08:59:36+00:00 |
Last Scan
Scanned | 2024-06-06T08:59:36+00:00 |
URL | https://homebrewtalk.com.br/robots.txt |
Domain IPs | 104.21.73.230, 172.67.192.176, 2606:4700:3031::6815:49e6, 2606:4700:3033::ac43:c0b0 |
Response IP | 104.21.73.230 |
Found | Yes |
Hash | 874201fa3929e56b5dca3d5e77727c43a0f94f094721ed8f0d92879a102f6616 |
SimHash | 005148508fb1 |
Groups
*
Rule | Path |
---|---|
Disallow | /find-new/ |
Disallow | /account/ |
Disallow | /attachments/ |
Disallow | /goto/ |
Disallow | /posts/ |
Disallow | /login/ |
Disallow | /admin.php |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.homebrewtalk.com/sitemap.php |