objective.com.au
robots.txt

Robots Exclusion Standard data for objective.com.au

Resource Scan

Scan Details

Site Domain objective.com.au
Base Domain objective.com.au
Scan Status Ok
Last Scan2025-10-30T06:15:05+00:00
Next Scan 2025-11-06T06:15:05+00:00

Last Scan

Scanned2025-10-30T06:15:05+00:00
URL https://objective.com.au/robots.txt
Redirect https://www.objective.com.au/robots.txt
Redirect Domain www.objective.com.au
Redirect Base objective.com.au
Domain IPs 162.159.136.54, 162.159.137.54
Redirect IPs 162.159.136.54, 162.159.137.54
Response IP 162.159.136.54
Found Yes
Hash 1672b02320f9f63f7411e815c9f0d93ac9a315a293d4dcb8c9f0e85d3780c0bf
SimHash e03811e66e90

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /staging/

Other Records

Field Value
sitemap https://www.objective.com.au/sitemaps-1-sitemap.xml
sitemap https://nz.objective.com/sitemaps-1-sitemap.xml
sitemap https://www.objective.com/sitemaps-1-sitemap.xml
sitemap https://www.objective.co.uk/sitemaps-1-sitemap.xml
sitemap https://www.objective.sg/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.objective.com.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/