beerintheevening.com
robots.txt
Robots Exclusion Standard data for beerintheevening.com
Resource Scan
Scan Details
| Site Domain | beerintheevening.com |
| Base Domain | beerintheevening.com |
| Scan Status | Ok |
| Last Scan | 2024-05-11T23:57:39+00:00 |
| Next Scan | 2024-05-18T23:57:39+00:00 |
Last Scan
| Scanned | 2024-05-11T23:57:39+00:00 |
| URL | https://beerintheevening.com/robots.txt |
| Redirect | https://www.beerintheevening.com/robots.txt |
| Redirect Domain | www.beerintheevening.com |
| Redirect Base | beerintheevening.com |
| Domain IPs | 104.26.0.31, 104.26.1.31, 172.67.75.107, 2606:4700:20::681a:11f, 2606:4700:20::681a:1f, 2606:4700:20::ac43:4b6b |
| Redirect IPs | 104.26.0.31, 104.26.1.31, 172.67.75.107, 2606:4700:20::681a:11f, 2606:4700:20::681a:1f, 2606:4700:20::ac43:4b6b |
| Response IP | 172.67.75.107 |
| Found | Yes |
| Hash | 8da9570e69f8c01db978adb4fe8c207b81df71a5d64957c8854781ffcb54790e |
| SimHash | 9a055106fa11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pda |
| Disallow | /pubs/mail |
| Disallow | /pubs/show_s.shtml |
| Disallow | /pubs/most_wanted.shtml |
| Disallow | /pubs/report_comment.shtml |
| Disallow | /pubs/results.shtml/near/ |
| Disallow | /pubs/results.shtml/pc/ |
| Disallow | /pubs/add_to |
| Disallow | /crawls/add_to |
| Disallow | /cgi-bin/tfl |
| Disallow | /cgi-bin/my_ |
| Disallow | /cgi-bin/map_link |
| Disallow | /services/register.shtml? |
| Disallow | /members/ |