Log In Sign Up

vaneck.com.au
robots.txt

Robots Exclusion Standard data for vaneck.com.au

Resource Scan

Scan Details

Site Domain vaneck.com.au
Base Domain vaneck.com.au
Scan Status Ok
Last Scan2024-05-18T09:26:10+00:00
Next Scan 2024-06-17T09:26:10+00:00

Last Scan

Scanned2024-05-18T09:26:10+00:00
URL https://vaneck.com.au/robots.txt
Redirect https://www.vaneck.com.au/robots.txt
Redirect Domain www.vaneck.com.au
Redirect Base vaneck.com.au
Domain IPs 103.41.68.54
Redirect IPs 52.84.229.23, 52.84.229.73, 52.84.229.75, 52.84.229.98
Response IP 52.84.229.23
Found Yes
Hash fb8889854c1555d553b81033aa21c4f2cf4f0b642a0144c1e87818bd5f408560
SimHash 0d06d0750c6f

Groups

*

Rule Path Comment
Disallow /admin/* Admin Utilities
Disallow /EktSyncStatus/ -
Disallow /LatestChanges/ -
Disallow /test/ -
Disallow /Workarea/ -
Disallow /Private/ -
Disallow /Private/CMCAXSweepstakes/ -
Disallow /sld/ old content from original ColdFusion site
Disallow /funds/COLX.aspx -
Disallow /library/market-vectors-etfs/colx-fact-sheet-pdf -
Disallow /market-vectors/equity-etfs/colx/holdings/ -
Disallow /market-vectors/equity-etfs/colx/performance-distributions/ -
Disallow /market-vectors/equity-etfs/colx/Securities-Lending/ -
Disallow /equity-etfs/colx/documents/?tab=ch -
Disallow /PremiumDiscountChart.aspx?tkr=COLX -
Disallow /funds/gerj.aspx -
Disallow /library/market-vectors-etfs/gerj-fact-sheet-pdf -
Disallow /market-vectors/equity-etfs/gerj/holdings/ -
Disallow /market-vectors/equity-etfs/gerj/performance-distributions/ -
Disallow /market-vectors/equity-etfs/gerj/Securities-Lending/ -
Disallow /equity-etfs/gerj/documents/?tab=ch -
Disallow /PremiumDiscountChart.aspx?tkr=gerj -
Disallow /library/market-vectors-etfs/latm-fact-sheet-pdf -
Disallow /market-vectors/equity-etfs/latm/holdings/ -
Disallow /market-vectors/equity-etfs/latm/performance-distributions/ -
Disallow /market-vectors/equity-etfs/latm/Securities-Lending/ -
Disallow /equity-etfs/latm/documents/?tab=ch -
Disallow /PremiumDiscountChart.aspx?tkr=latm -
Disallow /funds/rkh.aspx -
Disallow /library/market-vectors-etfs/rkh-fact-sheet-pdf -
Disallow /market-vectors/equity-etfs/rkh/holdings/ -
Disallow /market-vectors/equity-etfs/rkh/performance-distributions/ -
Disallow /market-vectors/equity-etfs/rkh/Securities-Lending/ -
Disallow /equity-etfs/rkh/documents/?tab=ch -
Disallow /PremiumDiscountChart.aspx?tkr=rkh -
Disallow /funds/CHLC.aspx -
Disallow /library/market-vectors-etfs/chlc-fact-sheet-pdf/ -
Disallow /market-vectors/income-etfs/chlc/Documents/ -
Disallow /market-vectors-etfs/chlc-investment-case-pdf/ -
Disallow /FundHoldings.aspx?ticker=CHLC -
Disallow /van-eck-announces-changes-to-market-vectors-etf-product-line-pdf/ -
Disallow /PremiumDiscountChart.aspx?tkr=CHLC&qtr=2013-3 -
Disallow /download-pdf-options/* -
Disallow /mutual-funds/multi-manager-alternatives-fund/class-a/vmaax/ -
Disallow /mutual-funds/multi-manager-alternatives-fund/class-c/vmaax/ -
Disallow /mutual-funds/multi-manager-alternatives-fund/class-i/vmaax/ -
Disallow /mutual-funds/multi-manager-alternatives-fund/class-y/vmaax/ -
Disallow /InsuranceFunds/MultiManagerAlternatives.aspx/ -
Disallow /vaneck-vectors/equity-etfs/idxj/* -
Disallow /funds/IDXJ.aspx/* -
Disallow /vaneck-vectors/equity-etfs/mes/* -
Disallow /funds/mes.aspx/* -
Disallow /etf/income/itml/* -
Disallow /etf/income/itms/* -
Disallow /etf/income/thhy/* -
Disallow /etf/equity/kwt/* -
Disallow /etf/equity/spun/* -
Disallow /etf/income/igem/* -
Disallow /etf/income/prb/* -
Disallow /etf/equity/gnrx/* -
Disallow /etf/equity/plnd/* -
Disallow /mutual-fund/alternatives/lsnax/* -
Disallow /mutual-fund/alternatives/lsnix/* -
Disallow /mutual-fund/alternatives/lsnyx/* -
Disallow /insurance-fund/long-short-equity/ -
Disallow /rsvp-yes/ -
Disallow /rsvp-no/ -
Disallow /home2/* -
Disallow /common/DownloadPdfUsModal* -
Disallow /vaneck-sales/* -
Disallow /globalassets/home/us/sales-materials/* -
Disallow /vaneck-us-lpl-investment-ideas-1h2021.pdf -
Disallow /ml-investment-ideas-2q-2021.pdf -
Disallow /ms-investment-ideas-2q-2021.pdf -
Disallow /rj-investment-ideas-2q-2021.pdf -
Disallow /ubs-investment-ideas-2q-2021.pdf -

Other Records

Field Value
crawl-delay 25

petalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.vaneck.com.au/sitemap.xml
Back to top

Comments

  • robots.txt for http://www.vaneck.com.au/
  • We put the crawl delay at 25 seconds MOZ policy only allows crawl if delay is within 30 Seconds.
  • Disallow: /funds/latm.aspx
Back to top