thebeertimes.com
robots.txt
Robots Exclusion Standard data for thebeertimes.com
Resource Scan
Scan Details
| Site Domain | thebeertimes.com |
| Base Domain | thebeertimes.com |
| Scan Status | Ok |
| Last Scan | 2024-06-02T10:24:06+00:00 |
| Next Scan | 2024-06-09T10:24:06+00:00 |
Last Scan
| Scanned | 2024-06-02T10:24:06+00:00 |
| URL | https://thebeertimes.com/robots.txt |
| Domain IPs | 104.21.76.128, 172.67.195.121, 2606:4700:3035::ac43:c379, 2606:4700:3037::6815:4c80 |
| Response IP | 104.21.76.128 |
| Found | Yes |
| Hash | 2af4852faf12f1894c3461ddb0a29a8a3649998cfb71b17981042b121de143fe |
| SimHash | 2a0c2858e939 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /*/trackback/ |
| Disallow | /*/attachment/ |
| Disallow | /author/ |
| Disallow | *?replytocom |
| Disallow | /tag/*/page/ |
| Disallow | /tag/*/feed/ |
| Disallow | /comments/ |
| Disallow | /xmlrpc.php |
| Disallow | /?attachment_id* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thebeertimes.com/sitemap_index.xml |
Warnings
- 4 invalid lines.