Log In Sign Up

ranker.com
robots.txt

Robots Exclusion Standard data for ranker.com

Resource Scan

Scan Details

Site Domain ranker.com
Base Domain ranker.com
Scan Status Ok
Last Scan2024-06-28T14:26:51+00:00
Next Scan 2024-07-05T14:26:51+00:00

Last Scan

Scanned2024-06-28T14:26:51+00:00
URL https://ranker.com/robots.txt
Redirect https://www.ranker.com/robots.txt
Redirect Domain www.ranker.com
Redirect Base ranker.com
Domain IPs 151.101.131.11, 151.101.195.11, 151.101.3.11, 151.101.67.11
Redirect IPs 151.101.131.11, 151.101.195.11, 151.101.3.11, 151.101.67.11
Response IP 199.232.47.11
Found Yes
Hash c9ab9352dc9fc47aed6e0a2fdabe23d0010d3e78822341d1f3b5f7b30eb89cda
SimHash f45b913b2735

Groups

*

Rule Path
Disallow /app
Disallow /commentary
Disallow /listcommentary
Disallow /extlink
Disallow /node
Disallow /suggestions
Disallow /list/rerank.htm
Disallow /widget
Disallow /pics
Disallow /review
Disallow /amp
Disallow /*US_CENSUS_NAME*
Allow /app/faq.htm

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.ranker.com/sitemaps/list/sitemap-list-index.xml
sitemap https://www.ranker.com/sitemaps/user/sitemap-user-index.xml
sitemap https://www.ranker.com/sitemaps/google-news/sitemap-google-news-index.xml
sitemap https://www.ranker.com/sitemaps/collection/sitemap-collection-index.xml
Back to top

Comments

  • Ranker content is made available for your personal, non-commercial
  • use subject to our Terms of Service here: https://www.ranker.com/terms
  • Use of any device, tool, or process designed to data mine or scrape the
  • content using automated means is prohibited without prior written permission
  • from Ranker, Inc.
  • Prohibited uses include but are not limited to:
  • (1) text and data mining activities under Art. 4 of the EU Directive on
  • Copyright in the Digital Single Market;
  • (2) the development of any software, machine learning, artificial
  • intelligence (AI), and/or large language models (LLMs);
  • (3) creating or providing archived or cached data sets containing our
  • content to others; and/or
  • (4) any commercial purposes.
  • Contact https://business.ranker.com/contact for assistance.
  • Sitemap files
Back to top