cycle.travel
robots.txt
Robots Exclusion Standard data for cycle.travel
Resource Scan
Scan Details
Site Domain | cycle.travel |
Base Domain | cycle.travel |
Scan Status | Ok |
Last Scan | 2024-09-25T14:56:50+00:00 |
Next Scan | 2024-10-25T14:56:50+00:00 |
Last Scan
Scanned | 2024-09-25T14:56:50+00:00 |
URL | https://cycle.travel/robots.txt |
Domain IPs | 104.21.93.86, 172.67.207.160, 2606:4700:3030::6815:5d56, 2606:4700:3037::ac43:cfa0 |
Response IP | 172.67.207.160 |
Found | Yes |
Hash | f28c7cf96498743b0fca9c89adbf4d135e810aa1e1f428863eb90965f28f10e6 |
SimHash | 291180048bdb |
Groups
*
Rule | Path |
---|---|
Disallow | /map/*/gpx |
Disallow | /map/*/polyline |
Disallow | /map/*/data |
Disallow | /map/*?get= |
Disallow | /map/?lat* |
Comments