thinkfish.co.uk
robots.txt
Robots Exclusion Standard data for thinkfish.co.uk
Resource Scan
Scan Details
Site Domain | thinkfish.co.uk |
Base Domain | thinkfish.co.uk |
Scan Status | Ok |
Last Scan | 2024-10-06T19:58:13+00:00 |
Next Scan | 2024-10-13T19:58:13+00:00 |
Last Scan
Scanned | 2024-10-06T19:58:13+00:00 |
URL | https://thinkfish.co.uk/robots.txt |
Redirect | https://www.thinkfish.co.uk/robots.txt |
Redirect Domain | www.thinkfish.co.uk |
Redirect Base | thinkfish.co.uk |
Domain IPs | 104.21.14.252, 172.67.160.215, 2606:4700:3030::6815:efc, 2606:4700:3034::ac43:a0d7 |
Redirect IPs | 104.21.14.252, 172.67.160.215, 2606:4700:3030::6815:efc, 2606:4700:3034::ac43:a0d7 |
Response IP | 104.21.14.252 |
Found | Yes |
Hash | bf136ce36bd98878286fa5708c6dee4c6fbfd7b88bbc013994646ddcdf975d68 |
SimHash | 005861408972 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /legal.html |
Disallow | /contact.html |
Disallow | /advertiser.php |
Disallow | /forsale.html |
Disallow | /forsale2.html |
Disallow | /forums/index.php?action=profile* |
Disallow | /forums/index.php?action=register |
Disallow | /forums/index.php?action=calendar* |
Disallow | /forums/login/ |
Disallow | /forums/help/ |
Warnings
- 2 invalid lines.
Comments