solarwinds.net
robots.txt

Robots Exclusion Standard data for solarwinds.net

Resource Scan

Scan Details

Site Domain solarwinds.net
Base Domain solarwinds.net
Scan Status Ok
Last Scan2024-11-02T16:22:46+00:00
Next Scan 2024-11-16T16:22:46+00:00

Last Scan

Scanned2024-11-02T16:22:46+00:00
URL https://solarwinds.net/robots.txt
Redirect https://www.solarwinds.com/robots.txt
Redirect Domain www.solarwinds.com
Redirect Base solarwinds.com
Domain IPs 13.107.246.47, 2620:1ec:bdf::73
Redirect IPs 23.215.7.20, 23.215.7.27, 2600:1413:1::173b:a882
Response IP 96.17.180.51
Found Yes
Hash 3718d5da4e5ba0bfd4d46f9cc4a5de4c40cd3b38bfac56260c454c5a4670ae8a
SimHash 56f6cb732f88

Groups

googlebot
bingbot
deepcrawl
ahrefsbot
*
googlebot
bingbot
deepcrawl
ahrefsbot

Rule Path
Disallow /NetPerfMon/
Disallow /netperfmon/
Disallow /Netperfmon/
Disallow /NetperfMon/
Disallow /cirrusdocs/
Disallow /WorkArea/
Disallow /workarea/
Disallow /resources/tags/
Disallow /recent-searches/
Disallow /search/
Disallow /uploadedFiles/
Disallow /Templates/
Disallow /templates/
Disallow /embedded_in_products/
Disallow /ru/
Disallow /it/
Disallow /search*
Disallow /*/search*
Disallow /*s%3D*
Disallow /*/company/press-releases
Disallow /*/company/in-the-news
Disallow /*/company/awards
Disallow /*downloadURL%3D
Disallow /*InternalSearch/
Disallow /*internalsearch/
Disallow /*sort%3Dtype$
Disallow /*sitecore/
Disallow /*documentation/
Disallow /*/de/
Disallow /*/es/
Disallow /*/pt/
Disallow /*/fr/
Disallow /*/ja/
Disallow /*/zh/
Disallow /*/ru/
Disallow /*/it/
Disallow /*/ko/
Disallow */onlinequotes/partials/show/*
Disallow /api/

aihitbot
barkrowler
bdcbot
blexbot
blp_bbot
brokenlinkcheck.com
buck
ccbot
cliqzbot
cyencebot
domaincrawler
dow jones searchbot
exabot
extlinksbot
femtosearchbot
fever
garlikcrawler
gigabot
gobuster
grapeshotcrawler
heritrix
istellabot
jersey
jobkicks
libwww-perl
linkdexbot
linkpadbot
ltx71 - (http://ltx71.com/)
lua-resty-http
lumtelbot
magpie-crawler
magus bot
mail.ru_bot
megaindex.ru
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com
nl-crawler
onpagebot
riddler
scoutjet
scrapy
seekport
seznambot
siteimprove
smtbot
uptimerobot
velenpublicwebcrawler
wget
yacybot
yeti
yisouspider
yunsecuritybot
zoominfobot

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit
caliperbot
dotbot
hubspot
mj12bot
rogerbot
semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.solarwinds.com/sitemap.xml
sitemap https://www.solarwinds.com/de/sitemap.xml
sitemap https://www.solarwinds.com/es/sitemap.xml
sitemap https://www.solarwinds.com/fr/sitemap.xml
sitemap https://www.solarwinds.com/pt/sitemap.xml
sitemap https://www.solarwinds.com/ko/sitemap.xml
sitemap https://www.solarwinds.com/ja/sitemap.xml
sitemap https://www.solarwinds.com/zh/sitemap.xml

Comments

  • -- LAST MODIFIED DATE 05-11-2022 by KC --
  • -- Please refer to the confluence page named 'robots.txt directives' for directive details --
  • -- Unwanted Directories & URL Paths --
  • -- Spam Bots & Other Unwanted Bots --
  • -- SEO Tools & Service - Set Crawl Delay for Optimal Performance --
  • -- XML Sitemap Locations --
  • --------------------------------