coingecko.com
robots.txt

Robots Exclusion Standard data for coingecko.com

Resource Scan

Scan Details

Site Domain coingecko.com
Base Domain coingecko.com
Scan Status Ok
Last Scan2024-11-11T10:16:00+00:00
Next Scan 2024-11-18T10:16:00+00:00

Last Scan

Scanned2024-11-11T10:16:00+00:00
URL https://coingecko.com/robots.txt
Redirect https://www.coingecko.com/robots.txt
Redirect Domain www.coingecko.com
Redirect Base coingecko.com
Domain IPs 104.18.4.118, 104.18.5.118, 2606:4700::6812:476, 2606:4700::6812:576
Redirect IPs 104.18.4.118, 104.18.5.118, 2606:4700::6812:476, 2606:4700::6812:576
Response IP 104.18.5.118
Found Yes
Hash 46e28a43171f8f6e24765df9dd50bcfd059f72d73d1939c95f01485d4347c42d
SimHash 87082e068c35

Groups

*

Rule Path
Disallow /api_doc
Disallow /api/documentations/v3
Disallow /resource_redirect
Disallow /request
Disallow /newsletter
Disallow /cdn-cgi/
Disallow /*/search
Disallow /*/search/bang
Disallow /*/social_tab$
Disallow /*/widgets_tab$
Disallow /*/developer_tab$
Disallow /*sentiment_votes
Disallow /*/markets_tab$
Disallow /*/news_guides$
Disallow /*/render_hashing_algorithm_selector
Disallow /*/show_more_tickers
Disallow /*/analysis_tab
Disallow /*/render_platform_selector
Disallow /omniauth
Disallow /ahoy/visits
Disallow /geckoterminal/token_is_valid
Disallow /*/portfolios/
Disallow /*/alerts
Disallow *.xls$
Disallow *.csv$
Disallow */news/load_more
Disallow /*/compare-cryptocurrencies?coins
Disallow /*/widget_component
Disallow /*/render_category_selector
Disallow /ar/%D9%85%D9%83%D9%88%D9%86%D8%A7%D8%AA_
Disallow /de/widgetkomponente
Disallow /es/componente_del_widget
Disallow /fr/composant_widget
Disallow /id/komponen_widget
Disallow /it/componente_widget
Disallow /ja/%E3%82%A6%E3%82%A3%E3%82%B8%E3%82%A7%E3%83%83%E3%83%88%E3%82%B3%E3%83%B3%E3%83%9D%E3%83%BC%E3%83%8D%E3%83%B3%E3%83%88
Disallow /ko/%EC%9C%84%EC%A0%AF%EC%BB%B4%ED%8F%AC%EB%84%8C%ED%8A%B8
Disallow /pl/element_wid%C5%BCetu
Disallow /pt/componente_do_dispositivo
Disallow /ru/%D0%92%D0%B8%D0%B4%D0%B6%D0%B5%D1%82_%D0%BA%D0%BE%D0%BC%D0%BF%D0%BE%D0%BD%D0%B5%D0%BD%D1%82
Disallow /th/%E0%B8%AA%E0%B9%88%E0%B8%A7%E0%B8%99%E0%B8%9B%E0%B8%A3%E0%B8%B0%E0%B8%81%E0%B8%AD%E0%B8%9A_widget
Disallow /tr/widget_bile%C5%9Feni
Disallow /vi/ti%E1%BB%87n_%C3%ADch_widget
Disallow /zh-tw/%E5%B7%A5%E5%85%B7%E7%B5%84%E4%BB%B6
Disallow /zh/%E5%B7%A5%E5%85%B7%E7%BB%84%E4%BB%B6
Disallow /account/candy
Disallow /account/my-rewards
Disallow */developers/
Disallow /account/subscriptions
Disallow /account/security
Disallow /apk
Disallow /*/*/*/bch$
Disallow /*/*/*/bits$
Disallow /*/*/*/dot$
Disallow /*/*/*/eos$
Disallow /*/*/*/link$
Disallow /*/*/*/ltc$
Disallow /*/*/*/sats$
Disallow /*/*/*/xag$
Disallow /*/*/*/xau$
Disallow /*/*/*/xdr$
Disallow /*/*/*/xlm$
Disallow /*/*/*/xrp$
Disallow /*/*/*/yfi$
Disallow *?ref=wticker
Disallow *?depth=
Disallow *?sort_by=
Disallow *?top=
Disallow *?time=
Disallow *?TRUE
Disallow /*/historical_data*?*end=
Disallow /*/historical_data*?*start=
Disallow *search%3D
Disallow /accounts*.json$
Disallow /premium/*?locale=
Disallow */candy?*category=
Disallow */candy?*order=
Disallow */show_more_rewards
Disallow /account/rewards/mocaverse/
Disallow /coins/price_percentage_change?ids=
Disallow *?0.
Disallow *?noop=
Disallow *?_branch_match_id=
Disallow *uniqifyingToken%3D
Disallow *?embed=
Disallow *savik%3D
Disallow *?CompareVariant=
Disallow *?qd4mE3DR=
Disallow */markets/spot
Disallow */markets/futures
Disallow */markets/perpetuals
Disallow /categories/market_cap_percentage_change?ids=
Disallow */show_more_tickers?
Disallow */more_guides
Disallow */more_news
Disallow */more_currency_articles
Disallow */show_more_articles
Disallow */show_more_posts
Disallow */show_more_nft_articles
Allow */historical_data/

Other Records

Field Value
sitemap https://www.coingecko.com/sitemap.xml
sitemap https://www.coingecko.com/sitemaps/currency/sitemap.xml
sitemap https://www.coingecko.com/sitemaps/categories/sitemap.xml
sitemap https://www.coingecko.com/sitemaps/nft/sitemap.xml
sitemap https://www.coingecko.com/sitemaps/posts/sitemap.xml
sitemap https://www.coingecko.com/sitemaps/exchanges/sitemap.xml
sitemap https://www.coingecko.com/sitemaps/products/sitemap.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: