buycycle.com
robots.txt

Robots Exclusion Standard data for buycycle.com

Resource Scan

Scan Details

Site Domain buycycle.com
Base Domain buycycle.com
Scan Status Ok
Last Scan2026-01-09T18:26:47+00:00
Next Scan 2026-02-08T18:26:47+00:00

Last Scan

Scanned2026-01-09T18:26:47+00:00
URL https://buycycle.com/robots.txt
Domain IPs 104.26.0.205, 104.26.1.205, 172.67.74.91, 2606:4700:20::681a:1cd, 2606:4700:20::681a:cd, 2606:4700:20::ac43:4a5b
Response IP 172.67.74.91
Found Yes
Hash 6f31b09c1aa50d5e788b5283a9b7b9dda7c8dfe2611d8b5832213a378273fdbe
SimHash 24bdbf41e5e1

Groups

*

Rule Path Comment
Disallow */sell/*/ sell funnel\
Disallow */profile/ User profiles\
Disallow */storage/*/ Storage\
Disallow */cart* Cart
Disallow */payment/*/ Payment
Disallow */checkout/ -
Disallow */cart/ -
Disallow /*rsc%3D -
Disallow */de-be -
Disallow */en-at -
Disallow */en-be -
Disallow */en-ch -
Disallow */en-cz -
Disallow */en-ee -
Disallow */en-es -
Disallow */en-fr -
Disallow */en-it -
Disallow */en-lv -
Disallow */en-mc -
Disallow */en-nl -
Disallow */en-pt -
Disallow */fr-mc -
Disallow */it-mc -
Disallow /cdn-cgi/ -
Disallow /cdn-cgi/bm/cv/ -
Disallow /cdn-cgi/challenge-platform/ -
Disallow /cdn-cgi/images/trace/ -
Disallow /cdn-cgi/rum -
Disallow /cdn-cgi/scripts/ -
Disallow /cdn-cgi/styles/ -
Disallow /cdn-fpw/sxg/ -
Disallow /*https%3A//www.googleoptimize.com/optimize.js?id=OPT-* -

Comments

  • to match all preceding language country folders
  • cloudflare