cyclecanada.com
robots.txt

Robots Exclusion Standard data for cyclecanada.com

Resource Scan

Scan Details

Site Domain cyclecanada.com
Base Domain cyclecanada.com
Scan Status Ok
Last Scan2024-06-12T06:03:10+00:00
Next Scan 2024-07-12T06:03:10+00:00

Last Scan

Scanned2024-06-12T06:03:10+00:00
URL https://cyclecanada.com/robots.txt
Redirect https://www.cyclecanada.com/robots.txt
Redirect Domain www.cyclecanada.com
Redirect Base cyclecanada.com
Domain IPs 103.26.141.146
Redirect IPs 103.26.141.146
Response IP 103.26.141.146
Found Yes
Hash aaa3300beafa7e524769f5cf8dcd1fed4926f5bfd7b85d45d69c2f2cb634159a
SimHash 155ec33a44e2

Groups

urlspy

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

extractor pro

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /quidnunc/
Disallow /Family/
Disallow /PDF/Bear_Safety_Guide.pdf
Disallow /Centcc/
Disallow /store/*%26filter
Disallow /store/*%26limit
Disallow /store/*%26sort
Disallow /store/*?route=account%2F
Disallow /store/*?route=affiliate%2F
Disallow /store/*?route=checkout%2F
Disallow /store/*?route=product%2Fsearch
Disallow /store/cycle-canada-tours/Post-registration-options-tour-vert
Disallow /store/cycle-canada-tours/post-registration-options-p%27tit-train
Disallow /store/cycle-canada-tours/BiQue-Ride-Single-Supplement
Disallow /store/cycle-canada-tours/tour-arctic-single-supplement-option
Disallow /store/cycle-canada-tours/tour-gaspe-single-supplement
Disallow /store/cycle-canada-tours/Tour-pacific-single-supplement
Disallow /store/*?route=product%2Fwishlist