native-instruments.com
robots.txt

Robots Exclusion Standard data for native-instruments.com

Resource Scan

Scan Details

Site Domain native-instruments.com
Base Domain native-instruments.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-21T15:41:21+00:00
Next Scan 2024-10-20T15:41:21+00:00

Last Successful Scan

Scanned2024-05-31T15:39:51+00:00
URL https://native-instruments.com/robots.txt
Redirect https://www.native-instruments.com/robots.txt
Redirect Domain www.native-instruments.com
Redirect Base native-instruments.com
Domain IPs 104.69.163.193
Redirect IPs 23.77.10.23
Response IP 23.41.79.93
Found Yes
Hash e52526741e98865342875d751023f374268b0cc8bec89bf6a1488047bdf88a78
SimHash ade81455ddb3

Groups

*

Rule Path
Disallow /typo3conf/
Disallow /fileadmin/userlib/
Disallow /fileadmin/ni_media/producer/
Allow /typo3conf/ext/*/Resources/Public/
Disallow /en/reaktor-community/reaktor-user-library/*/
Disallow /de/reaktor-community/reaktor-user-library/*/
Disallow /zh/reaktor-community/reaktor-user-library/*/
Disallow /jp/reaktor-community/reaktor-user-library/*/
Disallow /es/reaktor-community/reaktor-user-library/*/
Disallow /fr/reaktor-community/reaktor-user-library/*/
Disallow /en/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/?*
Disallow /de/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/?*
Disallow /jp/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/?*
Disallow /fr/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/?*
Disallow /es/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/?*
Disallow /zh/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/?*
Allow /en/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/
Allow /de/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/
Allow /jp/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/
Allow /fr/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/
Allow /es/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/
Allow /zh/products/komplete/samplers/kontakt-6-player/third-party-sample-libraries/
Disallow /en/login/
Disallow /de/login/
Disallow /fr/login/
Disallow /es/login/
Disallow /jp/login/
Disallow /zh/login/
Disallow /en/account/
Disallow /de/account/
Disallow /fr/account/
Disallow /es/account/
Disallow /jp/account/
Disallow /zh/account/
Disallow /en/shop/
Disallow /de/shop/
Disallow /fr/shop/
Disallow /es/shop/
Disallow /jp/shop/
Disallow /zh/shop/
Disallow /auth/
Disallow /survey/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

duggmirror

Rule Path
Disallow /

yeti

Rule Path
Disallow /
Disallow /bugtracker/
Disallow /stage-bugtracker/
Disallow /dev-bugtracker/
Disallow /forum/members

Other Records

Field Value
sitemap https://www.native-instruments.com/fileadmin/ni_media/sitemaps/DE_sitemaps_Q1_2024.xml
sitemap https://www.native-instruments.com/fileadmin/ni_media/sitemaps/ZH_sitemap_Q1_2024.xml
sitemap https://www.native-instruments.com/fileadmin/ni_media/sitemaps/JP_sitemap_Q1_2024.xml
sitemap https://www.native-instruments.com/fileadmin/ni_media/sitemaps/FR_sitemap_Q1_2024.xml
sitemap https://www.native-instruments.com/fileadmin/ni_media/sitemaps/ES_sitemap_Q1_2024.xml
sitemap https://www.native-instruments.com/fileadmin/ni_media/sitemaps/EN_sitemap_Q1_2024.xml

Comments

  • Disallow /login/ since it is no meaningful content to any SE
  • Disallow /account/ since it is login protected
  • Disallow /shop/ since it is login protected
  • Disallow /auth/ since it is login protected
  • Survey pages
  • slow down msn bot crawling too fast, crawl-delay value in seconds
  • slow down yahoo bot crawling too fast, crawl-delay value in seconds
  • disallow archive.org mirroring spider
  • User-agent: ia_archiver
  • disallow dugg mirroring spider
  • Disallow Yeti
  • Sitemaps
  • bugtracker
  • Forum members