fish-bros.co.uk
robots.txt
Robots Exclusion Standard data for fish-bros.co.uk
Resource Scan
Scan Details
| Site Domain | fish-bros.co.uk |
| Base Domain | fish-bros.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-07T06:37:19+00:00 |
| Next Scan | 2024-12-07T06:37:19+00:00 |
Last Scan
| Scanned | 2024-11-07T06:37:19+00:00 |
| URL | https://www.fish-bros.co.uk/robots.txt |
| Domain IPs | 108.156.133.100, 108.156.133.113, 108.156.133.64, 108.156.133.96, 2600:9000:2755:4200:1f:3977:20c0:93a1, 2600:9000:2755:5e00:1f:3977:20c0:93a1, 2600:9000:2755:6e00:1f:3977:20c0:93a1, 2600:9000:2755:7200:1f:3977:20c0:93a1, 2600:9000:2755:7600:1f:3977:20c0:93a1, 2600:9000:2755:a600:1f:3977:20c0:93a1, 2600:9000:2755:da00:1f:3977:20c0:93a1, 2600:9000:2755:e00:1f:3977:20c0:93a1 |
| Response IP | 108.156.133.96 |
| Found | Yes |
| Hash | df9ec550d52058368d654dc6bd2d08ce4c3d3cb5869d88348b0de34969de0f40 |
| SimHash | 8b0dda43edc2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */online-deposits/* |
| Disallow | */site/* |
| Disallow | */enquiry/* |
| Disallow | */new-car-variants/* |
| Disallow | */book-a-test-drive/* |
| Disallow | */api/* |
| Disallow | */ajax/* |
| Disallow | */search/* |
| Disallow | *order%3D* |
| Disallow | */vehicle-search/* |
| Disallow | */new-car-configurator/* |
| Disallow | */data-preferences/* |
| Disallow | */online-payments/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fish-bros.co.uk/sitemap.xml.gz |
Comments