solarwinds.com
robots.txt

Robots Exclusion Standard data for solarwinds.com

Resource Scan

Scan Details

Site Domain solarwinds.com
Base Domain solarwinds.com
Scan Status Ok
Last Scan2024-06-02T23:49:54+00:00
Next Scan 2024-06-16T23:49:54+00:00

Last Scan

Scanned2024-06-02T23:49:54+00:00
URL https://solarwinds.com/robots.txt
Redirect https://www.solarwinds.com/robots.txt
Redirect Domain www.solarwinds.com
Redirect Base solarwinds.com
Domain IPs 13.107.246.47, 2620:1ec:bdf::59
Redirect IPs 23.59.168.169, 23.59.168.178, 2600:1417:3f::b81c:eb61, 2600:1417:3f::b81c:eb6b
Response IP 23.59.168.169
Found Yes
Hash d3ba9a58d8d6f586b730d172ac8e870ba3484ee8b2d63c7053f00e5c26f3a8fe
SimHash 56f6cb532798

Groups

googlebot
bingbot
deepcrawl
ahrefsbot
*
googlebot
bingbot
deepcrawl
ahrefsbot

Rule Path
Disallow /NetPerfMon/
Disallow /netperfmon/
Disallow /Netperfmon/
Disallow /NetperfMon/
Disallow /cirrusdocs/
Disallow /WorkArea/
Disallow /workarea/
Disallow /resources/tags/
Disallow /recent-searches/
Disallow /search/
Disallow /uploadedFiles/
Disallow /Templates/
Disallow /templates/
Disallow /embedded_in_products/
Disallow /ru/
Disallow /it/
Disallow /search*
Disallow /*/search*
Disallow /*s%3D*
Disallow /*/company/press-releases
Disallow /*/company/in-the-news
Disallow /*/company/awards
Disallow /*downloadURL%3D
Disallow /*InternalSearch/
Disallow /*internalsearch/
Disallow /*sort%3Dtype$
Disallow /*sitecore/
Disallow /*documentation/
Disallow /*/de/
Disallow /*/es/
Disallow /*/pt/
Disallow /*/fr/
Disallow /*/ja/
Disallow /*/zh/
Disallow /*/ru/
Disallow /*/it/
Disallow /*/ko/
Disallow */onlinequotes/partials/show/*

aihitbot
barkrowler
bdcbot
blexbot
blp_bbot
brokenlinkcheck.com
buck
ccbot
cliqzbot
cyencebot
domaincrawler
dow jones searchbot
exabot
extlinksbot
femtosearchbot
fever
garlikcrawler
gigabot
gobuster
grapeshotcrawler
heritrix
istellabot
jersey
jobkicks
libwww-perl
linkdexbot
linkpadbot
ltx71 - (http://ltx71.com/)
lua-resty-http
lumtelbot
magpie-crawler
magus bot
mail.ru_bot
megaindex.ru
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com
nl-crawler
onpagebot
riddler
scoutjet
scrapy
seekport
seznambot
siteimprove
smtbot
uptimerobot
velenpublicwebcrawler
wget
yacybot
yeti
yisouspider
yunsecuritybot
zoominfobot

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit
caliperbot
dotbot
hubspot
mj12bot
rogerbot
semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.solarwinds.com/sitemap.xml
sitemap https://www.solarwinds.com/de/sitemap.xml
sitemap https://www.solarwinds.com/es/sitemap.xml
sitemap https://www.solarwinds.com/fr/sitemap.xml
sitemap https://www.solarwinds.com/pt/sitemap.xml
sitemap https://www.solarwinds.com/ko/sitemap.xml
sitemap https://www.solarwinds.com/ja/sitemap.xml
sitemap https://www.solarwinds.com/zh/sitemap.xml
sitemap https://secure.vidyard.com/sitemaps/sitemap-UUrfDJSe2JNunL_FOX9K7g.xml
sitemap https://secure.vidyard.com/sitemaps/sitemap-gISEwhzqpW0qD78SNKAjyg.xml

Comments

  • -- LAST MODIFIED DATE 05-11-2022 by KC --
  • -- Please refer to the confluence page named 'robots.txt directives' for directive details --
  • -- Unwanted Directories & URL Paths --
  • -- Spam Bots & Other Unwanted Bots --
  • -- SEO Tools & Service - Set Crawl Delay for Optimal Performance --
  • -- XML Sitemap Locations --
  • --------------------------------