gofishing.co.uk
robots.txt
Robots Exclusion Standard data for gofishing.co.uk
Resource Scan
Scan Details
| Site Domain | gofishing.co.uk |
| Base Domain | gofishing.co.uk |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-30T11:38:44+00:00 |
| Next Scan | 2024-11-29T11:38:44+00:00 |
Last Successful Scan
| Scanned | 2024-01-12T08:08:51+00:00 |
| URL | http://gofishing.co.uk/robots.txt |
| Redirect | https://www.anglingtimes.co.uk/robots.txt |
| Redirect Domain | www.anglingtimes.co.uk |
| Redirect Base | anglingtimes.co.uk |
| Domain IPs | 2a00:18e0:5:2:7577:4e4d:413b:f507, 2a00:18e0:5:3:dfe2:c743:85aa:61bc, 5.22.145.121, 5.22.145.16 |
| Redirect IPs | 108.156.60.126, 108.156.60.27, 108.156.60.36, 108.156.60.96 |
| Response IP | 108.138.26.119 |
| Found | Yes |
| Hash | 1772239e9bf148f877be181423c83d5023b1a5292a5dd55f9c65bbefd67a1f29 |
| SimHash | 3d455444c192 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /*itm_source%3Dbibblio |
| Disallow | /*itm_source%3DBibblio |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.anglingtimes.co.uk/sitemap_index.xml |