vaneck.com
robots.txt

Robots Exclusion Standard data for vaneck.com

Resource Scan

Scan Details

Site Domain vaneck.com
Base Domain vaneck.com
Scan Status Ok
Last Scan2024-10-12T02:14:20+00:00
Next Scan 2024-11-11T02:14:20+00:00

Last Scan

Scanned2024-10-12T02:14:20+00:00
URL https://vaneck.com/robots.txt
Redirect https://www.vaneck.com/robots.txt
Redirect Domain www.vaneck.com
Redirect Base vaneck.com
Domain IPs 103.41.68.54
Redirect IPs 13.33.88.101, 13.33.88.117, 13.33.88.129, 13.33.88.74
Response IP 13.33.88.74
Found Yes
Hash f947b12c62ed0802181c89e4ca07a4be58e93a36b28921e4e471bb608e69142e
SimHash 0f06c0778c6f

Groups

*

Rule Path Comment
Disallow /admin/* Admin Utilities
Disallow /EktSyncStatus/ -
Disallow /LatestChanges/ -
Disallow /test/ -
Disallow /Workarea/ -
Disallow /Private/ -
Disallow /Private/CMCAXSweepstakes/ -
Disallow /sld/ old content from original ColdFusion site
Disallow /funds/COLX.aspx -
Disallow /library/market-vectors-etfs/colx-fact-sheet-pdf -
Disallow /market-vectors/equity-etfs/colx/holdings/ -
Disallow /market-vectors/equity-etfs/colx/performance-distributions/ -
Disallow /market-vectors/equity-etfs/colx/Securities-Lending/ -
Disallow /equity-etfs/colx/documents/?tab=ch -
Disallow /PremiumDiscountChart.aspx?tkr=COLX -
Disallow /funds/gerj.aspx -
Disallow /library/market-vectors-etfs/gerj-fact-sheet-pdf -
Disallow /market-vectors/equity-etfs/gerj/holdings/ -
Disallow /market-vectors/equity-etfs/gerj/performance-distributions/ -
Disallow /market-vectors/equity-etfs/gerj/Securities-Lending/ -
Disallow /equity-etfs/gerj/documents/?tab=ch -
Disallow /PremiumDiscountChart.aspx?tkr=gerj -
Disallow /library/market-vectors-etfs/latm-fact-sheet-pdf -
Disallow /market-vectors/equity-etfs/latm/holdings/ -
Disallow /market-vectors/equity-etfs/latm/performance-distributions/ -
Disallow /market-vectors/equity-etfs/latm/Securities-Lending/ -
Disallow /equity-etfs/latm/documents/?tab=ch -
Disallow /PremiumDiscountChart.aspx?tkr=latm -
Disallow /funds/rkh.aspx -
Disallow /library/market-vectors-etfs/rkh-fact-sheet-pdf -
Disallow /market-vectors/equity-etfs/rkh/holdings/ -
Disallow /market-vectors/equity-etfs/rkh/performance-distributions/ -
Disallow /market-vectors/equity-etfs/rkh/Securities-Lending/ -
Disallow /equity-etfs/rkh/documents/?tab=ch -
Disallow /PremiumDiscountChart.aspx?tkr=rkh -
Disallow /funds/CHLC.aspx -
Disallow /library/market-vectors-etfs/chlc-fact-sheet-pdf/ -
Disallow /market-vectors/income-etfs/chlc/Documents/ -
Disallow /market-vectors-etfs/chlc-investment-case-pdf/ -
Disallow /FundHoldings.aspx?ticker=CHLC -
Disallow /van-eck-announces-changes-to-market-vectors-etf-product-line-pdf/ -
Disallow /PremiumDiscountChart.aspx?tkr=CHLC&qtr=2013-3 -
Disallow /download-pdf-options/* -
Disallow /mutual-funds/multi-manager-alternatives-fund/class-a/vmaax/ -
Disallow /mutual-funds/multi-manager-alternatives-fund/class-c/vmaax/ -
Disallow /mutual-funds/multi-manager-alternatives-fund/class-i/vmaax/ -
Disallow /mutual-funds/multi-manager-alternatives-fund/class-y/vmaax/ -
Disallow /InsuranceFunds/MultiManagerAlternatives.aspx/ -
Disallow /vaneck-vectors/equity-etfs/idxj/* -
Disallow /funds/IDXJ.aspx/* -
Disallow /vaneck-vectors/equity-etfs/mes/* -
Disallow /funds/mes.aspx/* -
Disallow /etf/income/itml/* -
Disallow /etf/income/itms/* -
Disallow /etf/income/thhy/* -
Disallow /etf/equity/kwt/* -
Disallow /etf/equity/spun/* -
Disallow /etf/income/igem/* -
Disallow /etf/income/prb/* -
Disallow /etf/equity/gnrx/* -
Disallow /etf/equity/plnd/* -
Disallow /mutual-fund/alternatives/lsnax/* -
Disallow /mutual-fund/alternatives/lsnix/* -
Disallow /mutual-fund/alternatives/lsnyx/* -
Disallow /insurance-fund/long-short-equity/ -
Disallow /rsvp-yes/ -
Disallow /rsvp-no/ -
Disallow /home2/* -
Disallow /common/DownloadPdfUsModal* -
Disallow /vaneck-sales/* -
Disallow /globalassets/home/us/sales-materials/* -
Disallow /vaneck-us-lpl-investment-ideas-1h2021.pdf -
Disallow /ml-investment-ideas-2q-2021.pdf -
Disallow /ms-investment-ideas-2q-2021.pdf -
Disallow /rj-investment-ideas-2q-2021.pdf -
Disallow /ubs-investment-ideas-2q-2021.pdf -

Other Records

Field Value
crawl-delay 25

petalbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

Comments

  • robots.txt for http://www.vaneck.com/
  • We put the crawl delay at 25 seconds MOZ policy only allows crawl if delay is within 30 Seconds.
  • Disallow: /funds/latm.aspx