support.solarwinds.com
robots.txt

Robots Exclusion Standard data for support.solarwinds.com

Resource Scan

Scan Details

Site Domain support.solarwinds.com
Base Domain solarwinds.com
Scan Status Ok
Last Scan2024-09-18T19:52:44+00:00
Next Scan 2024-10-02T19:52:44+00:00

Last Scan

Scanned2024-09-18T19:52:44+00:00
URL https://support.solarwinds.com/robots.txt
Redirect https://support.solarwinds.com/SuccessCenter/robots.txt
Domain IPs 23.215.7.20, 23.215.7.27
Response IP 96.17.180.44
Found Yes
Hash 0a0343cd59be7e46becd46ea744ad8a16edd19125b5618dcf73526ba184733da
SimHash 445ece10a6a0

Groups

*

Rule Path
Disallow /s/global-search/
Disallow /file-asset/
Disallow /login/
Disallow /topic/

aihitbot
barkrowler
bdcbot
blexbot
blp_bbot
brokenlinkcheck.com
buck
ccbot
cliqzbot
cyencebot
domaincrawler
dow jones searchbot
exabot
extlinksbot
femtosearchbot
fever
garlikcrawler
gigabot
gobuster
grapeshotcrawler
heritrix
istellabot
jersey
jobkicks
libwww-perl
linkdexbot
linkpadbot
ltx71 - (http://ltx71.com/)
lua-resty-http
lumtelbot
magpie-crawler
magus bot
mail.ru_bot
megaindex.ru
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com
nl-crawler
onpagebot
riddler
scoutjet
scrapy
seekport
seznambot
siteimprove
smtbot
uptimerobot
velenpublicwebcrawler
wget
yacybot
yeti
yisouspider
yunsecuritybot
zoominfobot

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit
caliperbot
dotbot
hubspot
mj12bot
rogerbot
semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://support.solarwinds.com/SuccessCenter/s/sitemap.xml
sitemap https://support.solarwinds.com/SuccessCenter/s/sitemap-view-1.xml
sitemap https://support.solarwinds.com/SuccessCenter/s/sitemap-topicarticle-1.xml