investingnews.com.au
robots.txt

Robots Exclusion Standard data for investingnews.com.au

Resource Scan

Scan Details

Site Domain investingnews.com.au
Base Domain investingnews.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-06T11:13:05+00:00
Next Scan 2024-11-13T11:13:05+00:00

Last Successful Scan

Scanned2024-10-29T01:56:35+00:00
URL https://investingnews.com.au/robots.txt
Redirect https://investingnews.com/robots.txt
Redirect Domain investingnews.com
Redirect Base investingnews.com
Domain IPs 151.101.1.68, 151.101.129.68, 151.101.193.68, 151.101.65.68
Redirect IPs 151.101.1.68, 151.101.129.68, 151.101.193.68, 151.101.65.68
Response IP 151.101.129.68
Found Yes
Hash 11700a6e26da0de0de210046cee5433efe0029e321e54dd7fdfbf6542126aaba
SimHash a90c94280891

Groups

*

Rule Path
Disallow /core/dashboard
Disallow /mnt/*
Disallow /core/v1/polls/*
Disallow /core/*
Disallow /r/*
Disallow /mnt/*

Other Records

Field Value
sitemap https://investingnews.com/sitemap.xml
sitemap https://investingnews.com/sitemap_video.xml
sitemap https://investingnews.com/sitemap_news.xml
sitemap https://investingnews.com/sitemap_tags.xml