planet-x-bikes.co.uk
robots.txt
Robots Exclusion Standard data for planet-x-bikes.co.uk
Resource Scan
Scan Details
| Site Domain | planet-x-bikes.co.uk |
| Base Domain | planet-x-bikes.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-10-17T09:07:30+00:00 |
| Next Scan | 2026-01-15T09:07:30+00:00 |
Last Successful Scan
| Scanned | 2024-11-28T20:59:10+00:00 |
| URL | https://www.planet-x-bikes.co.uk/robots.txt |
| Domain IPs | 104.21.1.80, 172.67.128.212, 2606:4700:3035::6815:150, 2606:4700:3036::ac43:80d4 |
| Response IP | 172.67.128.212 |
| Found | Yes |
| Hash | 6490a47f0edb5635e872c69d87adfc0af4910685d2927198b71404097ab4989e |
| SimHash | 6431762bc6de |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /support/ | - |
| Disallow | /setup/ | - |
| Disallow | /conf/ | - |
| Disallow | /cgi-bin/ | Keep out of cgi |
| Disallow | /stock/ | - |