cycle.travel
robots.txt

Robots Exclusion Standard data for cycle.travel

Resource Scan

Scan Details

Site Domain cycle.travel
Base Domain cycle.travel
Scan Status Ok
Last Scan2024-09-25T14:56:50+00:00
Next Scan 2024-10-25T14:56:50+00:00

Last Scan

Scanned2024-09-25T14:56:50+00:00
URL https://cycle.travel/robots.txt
Domain IPs 104.21.93.86, 172.67.207.160, 2606:4700:3030::6815:5d56, 2606:4700:3037::ac43:cfa0
Response IP 172.67.207.160
Found Yes
Hash f28c7cf96498743b0fca9c89adbf4d135e810aa1e1f428863eb90965f28f10e6
SimHash 291180048bdb

Groups

*

Rule Path
Disallow /map/*/gpx
Disallow /map/*/polyline
Disallow /map/*/data
Disallow /map/*?get=
Disallow /map/?lat*

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Comments

  • see https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt
  • also <meta name="robots" content="noindex,nofollow" />
  • <meta name="googlebot" content="noindex" />