Log In Sign Up

chainreactioncycles.com
robots.txt

Robots Exclusion Standard data for chainreactioncycles.com

Resource Scan

Scan Details

Site Domain chainreactioncycles.com
Base Domain chainreactioncycles.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-31T21:31:57+00:00
Next Scan 2024-08-29T21:31:57+00:00

Last Successful Scan

Scanned2023-04-15T21:20:19+00:00
URL https://chainreactioncycles.com/robots.txt
Redirect https://www.chainreactioncycles.com/robots.txt
Redirect Domain www.chainreactioncycles.com
Redirect Base chainreactioncycles.com
Domain IPs 104.16.156.86, 104.16.157.86
Redirect IPs 104.16.156.86, 104.16.157.86
Response IP 104.16.157.86
Found Yes
Hash 77c0785f19ef0d35981b15d2ff507f334c4edf3f7e18fc26df5958dccffbad8d
SimHash 066bd749ee9a

Groups

*

Rule Path
Disallow /secure/*
Disallow /*/*/secure/*
Disallow /mobile/secure/*
Disallow /*/*/mobile/secure/*
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /*.gif$
Disallow /*.png$
Disallow /wishlist
Disallow /*/*/wishlist
Disallow /checkout
Disallow /*/*/checkout
Disallow /myaccount
Disallow /*/*/myaccount
Disallow /basket
Disallow /*/*/basket
Disallow /pagenotfound
Disallow /*/*/pagenotfound
Disallow /account
Disallow /*/*/account
Allow /newitems$
Disallow /newitems
Allow /*/*/newitems$
Disallow /*/*/newitems
Allow /bestsellers$
Disallow /bestsellers
Allow /*/*/bestsellers$
Disallow /*/*/bestsellers
Allow /toprated$
Disallow /toprated
Allow /*/*/toprated$
Disallow /*/*/toprated
Allow /clearance$
Disallow /clearance
Allow /*/*/clearance$
Disallow /*/*/clearance
Disallow /mobile/wishlist
Disallow /mobile/*/*/wishlist
Disallow /mobile/checkout
Disallow /mobile/*/*/checkout
Disallow /mobile/myaccount
Disallow /mobile/*/*/myaccount
Disallow /mobile/basket
Disallow /mobile/*/*/basket
Disallow /mobile/pagenotfound
Disallow /mobile/*/*/pagenotfound
Disallow /mobile/account
Disallow /mobile/*/*/account
Allow /mobile/newitems$
Disallow /mobile/newitems
Allow /mobile/*/*/newitems$
Disallow /mobile/*/*/newitems
Allow /mobile/bestsellers$
Disallow /mobile/bestsellers
Allow /mobile/*/*/bestsellers$
Disallow /mobile/*/*/bestsellers
Allow /mobile/toprated$
Disallow /mobile/toprated
Allow /mobile/*/*/toprated$
Disallow /mobile/*/*/toprated
Allow /mobile/clearance$
Disallow /mobile/clearance
Allow /mobile/*/*/clearance$
Disallow /mobile/*/*/clearance
Disallow /mobile/catalog/catgoryBrandLanding.jsp
Disallow /mobile/*/*/catalog/catgoryBrandLanding.jsp
Disallow /mobile/catalog/disciplineBrandLanding.jsp
Disallow /mobile/*/*/catalog/disciplineBrandLanding.jsp
Disallow /mobile/catalog/brand.jsp
Disallow /mobile/*/*/catalog/brand.jsp
Disallow /mobile/allbrands
Disallow /mobile/*/*/allbrands
Disallow /mobile/browse/frag/viewOptionsAsList.jsp
Disallow /mobile/*/*/browse/frag/viewOptionsAsList.jsp
Disallow /mobile/*/optionsasalist
Disallow /mobile/*/*/*/optionsasalist
Disallow /mobile/account/frag/forgotPassword.jsp
Disallow /mobile/*/*/account/frag/forgotPassword.jsp
Disallow /mobile/forgotpassword
Disallow /mobile/*/*/forgotpassword
Disallow /r-pm
Disallow /*/*/r-pm
Disallow /mobile/r-pm
Disallow /mobile/*/*/r-pm
Allow /r-pm/blackfriday
Allow /mobile/r-pm/blackfriday
Disallow /*?f=
Disallow /*%26f%3D
Disallow /s?
Disallow *jsessionid*
Disallow /*?mx
Disallow /*%26mx
Disallow *static/variant/a/*
Disallow /*?q=
Disallow /*?_DARGS=
Disallow /*?keywordRedirectTerm=
Disallow /*/*/*/r-pm/bikes102017
Disallow /*/r-pm/bikes102017
Disallow */mtb/
Disallow */road/
Disallow */city/
Disallow */bmx/
Disallow */run/
Disallow */tri/
Disallow */vtt/
Disallow */%D0%BC%D1%82%D0%B1/
Disallow */carretera/
Disallow */route/
Disallow */%E3%83%AD%E3%83%BC%E3%83%89/
Disallow */estrada/
Disallow */%D1%88%D0%BE%D1%81%D1%81%D0%B5/
Disallow */strada/
Disallow */ciudad/
Disallow */ville/
Disallow */%E3%82%B7%E3%83%86%E3%82%A3%E3%83%90%E3%82%A4%E3%82%AF/
Disallow */stadt/
Disallow */%D0%B3%D0%BE%D1%80%D0%BE%D0%B4/
Disallow */bici-citta/
Disallow */%D0%B1mx/
Disallow */course-a-pied/
Disallow */%E3%83%A9%E3%83%B3%E3%83%8B%E3%83%B3%E3%82%B0/
Disallow */laufsport/
Disallow */atletismo/
Disallow */%D0%B1%D0%B5%D0%B3/
Disallow */corsa/
Disallow */%E3%83%88%E3%83%A9%E3%82%A4%E3%82%A2%E3%82%B9%E3%83%AD%E3%83%B3/
Disallow */%D1%82%D1%80%D0%B8%D0%B0%D1%82%D0%BB%D0%BE%D0%BD/
Disallow */triathlon/
Disallow */ag/
Disallow */ai/
Disallow */am/
Disallow */aw/
Disallow */az/
Disallow */ba/
Disallow */bf/
Disallow */bi/
Disallow */bs/
Disallow */cm/
Disallow */cr/
Disallow */cv/
Disallow */dz/
Disallow */eg/
Disallow */fj/
Disallow */fk/
Disallow */fo/
Disallow */gd/
Disallow */ge/
Disallow */gf/
Disallow */gn/
Disallow */gp/
Disallow */gu/
Disallow */gw/
Disallow */gy/
Disallow */jm/
Disallow */jo/
Disallow */ke/
Disallow */ky/
Disallow */ma/
Disallow */me/
Disallow */mg/
Disallow */mq/
Disallow */mr/
Disallow */ms/
Disallow */np/
Disallow */pa/
Disallow */pd/
Disallow */pk/
Disallow */py/
Disallow */pz/
Disallow */rs/
Disallow */td/
Disallow */tj/
Disallow */tm/
Disallow */tt/
Disallow */uc/
Disallow */vg/
Disallow */vu/
Disallow */ws/
Disallow */zm/
Disallow */al/
Disallow */ad/
Disallow */ao/
Disallow */ar/
Disallow */bh/
Disallow */bb/
Disallow */by/
Disallow */bm/
Disallow */bw/
Disallow */bn/
Disallow */bg/
Disallow */kh/
Disallow */cl/
Disallow */co/
Disallow */fc/
Disallow */hr/
Disallow */cy/
Disallow */cz/
Disallow */ee/
Disallow */pf/
Disallow */gi/
Disallow */gl/
Disallow */gg/
Disallow */hu/
Disallow */in/
Disallow */id/
Disallow */il/
Disallow */je/
Disallow */kz/
Disallow */kr/
Disallow */kw/
Disallow */kg/
Disallow */lv/
Disallow */li/
Disallow */lt/
Disallow */lu/
Disallow */mo/
Disallow */mk/
Disallow */my/
Disallow */mt/
Disallow */mu/
Disallow */mx/
Disallow */md/
Disallow */mc/
Disallow */na/
Disallow */nc/
Disallow */om/
Disallow */pe/
Disallow */ph/
Disallow */pl/
Disallow */qa/
Disallow */re/
Disallow */sm/
Disallow */sa/
Disallow */ia/
Disallow */sc/
Disallow */ii/
Disallow */sk/
Disallow */si/
Disallow */eb/
Disallow */ey/
Disallow */th/
Disallow */tr/
Disallow */ae/
Disallow */uz/
Disallow */vn/
Disallow */gb/
Disallow */za/
Disallow */ro/
Disallow */tw/
Disallow */is/
Disallow */pr/
Disallow */cn/
Disallow */se/
Disallow */sg/
Allow */sg/en/*/rp-prod*
Disallow */nz/
Disallow */nl/
Disallow */no/
Disallow */fi/
Disallow */hk/
Allow */hk/en/*/rp-prod*
Disallow */dk/
Disallow */gr/
Disallow */be/
Disallow */ch/
Disallow */us/es/
Disallow */us/fr/
Disallow */us/de/
Disallow */us/it/
Disallow */us/ja/
Disallow */us/ru/
Disallow */us/pt/
Disallow */au/es/
Disallow */au/fr/
Disallow */au/de/
Disallow */au/it/
Disallow */au/ja/
Disallow */au/ru/
Disallow */au/pt/
Disallow */ie/es/
Disallow */ie/fr/
Disallow */ie/de/
Disallow */ie/it/
Disallow */ie/ja/
Disallow */ie/ru/
Disallow */ie/pt/
Disallow */ca/es/
Disallow */ca/de/
Disallow */ca/it/
Disallow */ca/ja/
Disallow */ca/ru/
Disallow */ca/pt/
Disallow */es/fr/
Disallow */es/de/
Disallow */es/it/
Disallow */es/ja/
Disallow */es/ru/
Disallow */es/pt/
Disallow */es/en/
Disallow */jp/fr/
Disallow */jp/de/
Disallow */jp/it/
Disallow */jp/ru/
Disallow */jp/pt/
Disallow */jp/en/
Disallow */br/es/
Disallow */br/fr/
Disallow */br/de/
Disallow */br/it/
Disallow */br/ja/
Disallow */br/ru/
Disallow */br/en/
Disallow */ua/es/
Disallow */ua/fr/
Disallow */ua/de/
Disallow */ua/it/
Disallow */ua/ja/
Disallow */ua/en/
Disallow */ua/pt/
Disallow */fr/es/
Disallow */fr/en/
Disallow */fr/de/
Disallow */fr/it/
Disallow */fr/ja/
Disallow */fr/ru/
Disallow */fr/pt/
Disallow */pt/es/
Disallow */pt/fr/
Disallow */pt/de/
Disallow */pt/it/
Disallow */pt/ja/
Disallow */pt/ru/
Disallow */pt/en/
Disallow */de/es/
Disallow */de/fr/
Disallow */de/en/
Disallow */de/it/
Disallow */de/ja/
Disallow */de/ru/
Disallow */de/pt/
Disallow */it/es/
Disallow */it/fr/
Disallow */it/en/
Disallow */it/de/
Disallow */it/ja/
Disallow */it/ru/
Disallow */it/pt/
Disallow */ru/es/
Disallow */ru/fr/
Disallow */ru/en/
Disallow */ru/de/
Disallow */ru/ja/
Disallow */ru/it/
Disallow */ru/pt/
Allow /r-pm/shimano105
Allow /r-pm/shimanoxtr
Allow /r-pm/shimanoxt
Allow /r-pm/shimanoslx
Allow /r-pm/shimanodeore
Allow /r-pm/shimanoduraace
Allow /r-pm/shimanoultegra
Allow /r-pm/shimanotiagra
Allow /*/*/r-pm/shimano105
Allow /*/*/r-pm/shimanoxtr
Allow /*/*/r-pm/shimanoxt
Allow /*/*/r-pm/shimanoslx
Allow /*/*/r-pm/shimanodeore
Allow /*/*/r-pm/shimanoduraace
Allow /*/*/r-pm/shimanoultegra
Allow /*/*/r-pm/shimanotiagra

ahrefsbot
icc-crawler
icc-crawler/2.0
semrushbot
halebot
exabot
seokicks-robot
fatbot
blexbot

Rule Path
Disallow /

offeroftheday.co.uk
internetmemory.net
coccoc
popscreen
mj12bot
heritrix
steeler
dotbot
vebot
istellabot
domainreanimator
telegrambot
issuecrawler
tineye-bot
snoopy
twengabot
grapeshotcrawler
magpie-crawler
mediatoolkitbot
sistrix
idgcrawler
paperlibot
semvisubot
hatena antenna
bot for jce

Rule Path
Disallow /

yandex

Rule Path
Allow /ru/ru/
Allow /us/en/
Allow /gb/en/
Disallow /*/en/
Disallow /*/de/
Disallow /*/es/
Disallow /*/fr/
Disallow /*/it/
Disallow /*/jp/
Disallow /*/pt/
Disallow /-*
Disallow /*/*/-*
Disallow /*/*/thechaingang-*
Disallow /mobile/-*
Disallow /*/*/*crc-app-0*-p-app1$
Back to top

Other Records

Field Value
sitemap https://www.chainreactioncycles.com/products.xml.gz
sitemap https://www.chainreactioncycles.com/categories.xml.gz
sitemap https://www.chainreactioncycles.com/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/us/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/fr/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/es/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/au/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/ca/fr/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/ca/en/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/it/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/jp/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/de/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/ie/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/ru/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/pt/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/br/country-sitemap-index.xml.gz
sitemap https://www.chainreactioncycles.com/ua/country-sitemap-index.xml.gz
Back to top

Comments

  • CRCSPRT-2216
  • Disallow Crawlers
  • Disallow CRCSPRT-2079
  • Sitemap Entries
Back to top