eurekareport.com.au
robots.txt

Robots Exclusion Standard data for eurekareport.com.au

Resource Scan

Scan Details

Site Domain eurekareport.com.au
Base Domain eurekareport.com.au
Scan Status Ok
Last Scan2024-11-12T13:56:16+00:00
Next Scan 2024-11-19T13:56:16+00:00

Last Scan

Scanned2024-11-12T13:56:16+00:00
URL https://eurekareport.com.au/robots.txt
Redirect https://www.eurekareport.com.au/robots.txt
Redirect Domain www.eurekareport.com.au
Redirect Base eurekareport.com.au
Domain IPs 20.53.115.182
Redirect IPs 18.155.68.127, 18.155.68.24, 18.155.68.60, 18.155.68.90, 2600:9000:23d2:3200:1a:303a:78c0:93a1, 2600:9000:23d2:4200:1a:303a:78c0:93a1, 2600:9000:23d2:4400:1a:303a:78c0:93a1, 2600:9000:23d2:5a00:1a:303a:78c0:93a1, 2600:9000:23d2:8a00:1a:303a:78c0:93a1, 2600:9000:23d2:a800:1a:303a:78c0:93a1, 2600:9000:23d2:de00:1a:303a:78c0:93a1, 2600:9000:23d2:e400:1a:303a:78c0:93a1
Response IP 18.155.68.60
Found Yes
Hash 36cface486559f840007407f991949e7f973692389c183245ab0bf01a9d54cad
SimHash 1e10385189b5

Groups

*

Rule Path
Disallow /identity/logon?returnUrl*
Disallow /home/_investment-news-articles
Disallow /home/_investment-ideas
Disallow /home/_asx-announcements
Disallow /home/_smh-guide
Disallow /home/_my-investsmart-widget
Disallow /search/_shares
Disallow /search/_Shares
Disallow /search/_announcements
Disallow /search/_Announcements
Disallow /search/_dividends
Disallow /search/_Dividends
Disallow /search/_funds
Disallow /search/_Funds
Disallow /search/_news
Disallow /search/_News
Disallow /investment-news/newsletter/
Disallow /*.asp$
Disallow /*_price-chart
Disallow /portfolio-manager/diversified-portfolios/_getdetails
Disallow /portfolio-manager/diversified-portfolios/_getholdings
Disallow /portfolio-manager/diversified-portfolios/_getdepositswithdrawls
Disallow /portfolio-manager/diversified-portfolios/_gettransactions
Disallow /portfolio-manager/diversified-portfolios/_getdividendsinterest
Disallow /portfolio-manager/diversified-portfolios/_getfees
Disallow /test/throwerror
Disallow /test/version
Disallow /*_related-articles*
Disallow /resources/pdf/*
Disallow /account/*
Disallow /events/registermodel
Disallow /widgets/*
Disallow /callback/*
Disallow /oauth/*

Other Records

Field Value
crawl-delay 20

yandex
baiduspider
baidu
mail.ru_bot/2.0
mail.ru_bot
mail.ru
megaindex.ru/2.0
megaindex.ru
megaindex
vagabondo
exabot
bspider
screaming frog seo spider

Rule Path
Disallow /

twitterbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.eurekareport.com.au/sitemap-er.xml
sitemap https://www.eurekareport.com.au/sitemap-news.xml
sitemap https://www.eurekareport.com.au/sitemap-funds.xml
sitemap https://www.eurekareport.com.au/sitemap-upcoming-floats.xml
sitemap https://www.eurekareport.com.au/sitemap-videos.xml

Comments

  • Certain social media sites are whitelisted to allow crawlers to access page markup