Log In Sign Up

outranking.io
robots.txt

Robots Exclusion Standard data for outranking.io

Resource Scan

Scan Details

Site Domain outranking.io
Base Domain outranking.io
Scan Status Ok
Last Scan2024-09-20T11:51:11+00:00
Next Scan 2024-10-20T11:51:11+00:00

Last Scan

Scanned2024-09-20T11:51:11+00:00
URL https://outranking.io/robots.txt
Redirect https://www.outranking.io/robots.txt
Redirect Domain www.outranking.io
Redirect Base outranking.io
Domain IPs 35.212.126.23
Redirect IPs 35.212.126.23
Response IP 35.212.126.23
Found Yes
Hash 4e9a3537f329dd9dedc9f5c86a044a330052e495136063d7d093dd1855cc2472
SimHash ca8664c08ca3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-json/
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Disallow /elementskit-content
Disallow */tag/*
Disallow */tags/*
Disallow */author/*
Disallow /feed/
Disallow /feeds/
Disallow /*/feed/
Disallow /*/feed/rss/
Disallow /search/
Disallow /s?=
Disallow */*?*
Disallow */?via=*
Disallow */?livechat=*
Disallow */?ref=*
Disallow */?hubs_content*
Disallow */?page_id=*
Disallow */?utm_source=*
Disallow */*thankyou*
Disallow */*thank-you*
Disallow */thankyou/*
Disallow */thankyou*
Disallow */thankYou*
Disallow */login/*
Disallow */register/*
Disallow */auth/login/*
Disallow */print/*
Disallow */printpage/*
Disallow */?print=*
Disallow */?printpage=*
Disallow /error/
Disallow */captcha/*
Disallow */admin/*
Disallow */administrator/*
Disallow */user/*
Disallow */users/*
Disallow */cache/*
Disallow */log/*
Disallow /cgi-bin/

dotbot
dotbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix
sistrix crawler
sistrix

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

httrack

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

python-requests

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.outranking.io/sitemap.xml
Back to top

Comments

  • Standard Wordpress URLs
  • Non-standard & Other Wordpress URLs
  • Prevent search engines from indexing the site's feed URLs
  • Search URLs
  • Other URLs
  • OTHER POSSIBLE URLS FOR FUTURE
  • Prevent Crawling for Thank You Pages
  • Prevent Crawling for Login & Register
  • Prevent Crawling Print Pages
  • Prevent Error Crawling for Templates
  • Prevent Crawling for Captcha
  • Prevent Crawling for Admin
  • Prevent Crawling for User
  • Prevent Crawling for cache and log
  • Prevent Crawling for CGI
  • SITEMAPS
  • PREVENT BAD BOTS TO CRAWL
  • http://www.opensiteexplorer.org/dotbot
  • http://help.sogou.com/homepage/search-engine/add-crawl.html
  • http://www.exalead.com
  • https://www.youdao.com/help/webmaster/spider/
  • https://megaindex.com/crawler
  • https://napoveda.seznam.cz/en/fulltext-search/crawling/
  • https://cliqz.com/company/cliqz-bot
  • https://www.gigablast.com/spider.html
  • http://openlinkprofiler.org/bot
  • https://developers.ezooms.com/ezooms/ezooms-bot
  • https://scoutjet.com/
  • http://webmeup-crawler.com/
  • Disallow: Sistrix
  • Disallow: SEOkicks-Robot
  • http://www.searchmetrics.com
  • http://www.domaintools.com/webmasters/surveybot.php
  • http://commoncrawl.org/faq/
  • https://domainstats.com/pages/our-bot
  • http://www.soso.com/help/webmasters.htm
  • https://teleport.dev/
  • http://www.tenmax.com/teleportpro/
  • https://www.httrack.com/
  • END
Back to top