beerintheevening.com
robots.txt
Robots Exclusion Standard data for beerintheevening.com
Resource Scan
Scan Details
| Site Domain | beerintheevening.com |
| Base Domain | beerintheevening.com |
| Scan Status | Ok |
| Last Scan | 2024-11-18T13:23:13+00:00 |
| Next Scan | 2024-11-25T13:23:13+00:00 |
Last Scan
| Scanned | 2024-11-18T13:23:13+00:00 |
| URL | https://beerintheevening.com/robots.txt |
| Redirect | https://www.beerintheevening.com/robots.txt |
| Redirect Domain | www.beerintheevening.com |
| Redirect Base | beerintheevening.com |
| Domain IPs | 104.21.14.178, 172.67.160.30, 2606:4700:3034::6815:eb2, 2606:4700:3035::ac43:a01e |
| Redirect IPs | 104.21.14.178, 172.67.160.30, 2606:4700:3034::6815:eb2, 2606:4700:3035::ac43:a01e |
| Response IP | 172.67.160.30 |
| Found | Yes |
| Hash | 8da9570e69f8c01db978adb4fe8c207b81df71a5d64957c8854781ffcb54790e |
| SimHash | 9a055106fa11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pda |
| Disallow | /pubs/mail |
| Disallow | /pubs/show_s.shtml |
| Disallow | /pubs/most_wanted.shtml |
| Disallow | /pubs/report_comment.shtml |
| Disallow | /pubs/results.shtml/near/ |
| Disallow | /pubs/results.shtml/pc/ |
| Disallow | /pubs/add_to |
| Disallow | /crawls/add_to |
| Disallow | /cgi-bin/tfl |
| Disallow | /cgi-bin/my_ |
| Disallow | /cgi-bin/map_link |
| Disallow | /services/register.shtml? |
| Disallow | /members/ |