starwind.com
robots.txt

Robots Exclusion Standard data for starwind.com

Resource Scan

Scan Details

Site Domain starwind.com
Base Domain starwind.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-08T03:18:57+00:00
Next Scan 2026-03-08T03:18:57+00:00

Last Successful Scan

Scanned2025-07-17T22:29:14+00:00
URL https://starwind.com/robots.txt
Redirect https://www.starwindsoftware.com/robots.txt
Redirect Domain www.starwindsoftware.com
Redirect Base starwindsoftware.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 172.66.41.15, 172.66.42.241, 2606:4700:3108::ac42:290f, 2606:4700:3108::ac42:2af1
Response IP 172.66.42.241
Found Yes
Hash 4bbe89cb48e64a3520208d89933e9f6cc2fa39dbbfd0e969bc06099fc4fcd04b
SimHash a28718175f35

Groups

twitterbot
*

Rule Path
Disallow /manager/
Disallow /assets/components/
Disallow /core/
Disallow /connectors/
Disallow /c_portal/
Disallow /ci/
Disallow /keygenerator/
Disallow /lic/
Disallow /old_new_admin/
Disallow /resadmin/
Disallow /scripts/
Disallow /t/
Disallow /tmp/
Disallow /tmplink/
Disallow /updatetracker/
Disallow /search
Disallow /js-v2/hide-link.js
Disallow /fortest/
Disallow /fordev
Disallow /blog/wp-login.php
Disallow /blog/wp-register.php
Disallow /blog/xmlrpc.php
Disallow /blog/template.html
Disallow /blog/wp-admin
Disallow /blog/archive
Disallow /blog/?feed=
Disallow /blog/?s=
Disallow /blog/tag/
Disallow /resource-library/whitepapers/starwind-hyperconverged-appliance-datasheet-uk.pdf
Allow /resource-library/wp-includes
Allow /resource-library/wp-content
Disallow /resource-library/wp-login.php
Disallow /resource-library/wp-register.php
Disallow /resource-library/xmlrpc.php
Disallow /resource-library/template.html
Disallow /resource-library/wp-admin
Disallow /resource-library/content_block
Disallow /resource-library/category
Disallow /resource-library/archive
Disallow /resource-library/?feed=
Disallow /resource-library/?s=
Disallow /resource-library-test/
Disallow /resource-library/tag/
Disallow /best-practices/wp-admin
Allow /best-practices/wp-includes
Disallow /best-practices/wp-login.php
Disallow /best-practices/wp-register.php
Disallow /best-practices/xmlrpc.php
Disallow /best-practices/template.html
Disallow /best-practices/wp-content
Allow /best-practices/wp-content/uploads/
Disallow /best-practices/category
Disallow /best-practices/archive
Disallow /best-practices/?feed=
Disallow /best-practices/?s=
Allow /best-practices/wp-content/*.css
Allow /best-practices/wp-content/*.js

crazywebcrawler-spider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.starwindsoftware.com/sitemap.xml
sitemap https://www.starwindsoftware.com/mainsitemap.xml
sitemap https://www.starwindsoftware.com/blog/sitemap.xml
sitemap https://www.starwindsoftware.com/resource-library/sitemap.xml
sitemap https://www.starwindsoftware.com/help/sitemap.xml
sitemap https://www.starwindsoftware.com/v2v-help/sitemap.xml

Warnings

  • `host` is not a known field.