Log In Sign Up

awlsa.com.au
robots.txt

Robots Exclusion Standard data for awlsa.com.au

Resource Scan

Scan Details

Site Domain awlsa.com.au
Base Domain awlsa.com.au
Scan Status Ok
Last Scan2026-02-21T19:35:00+00:00
Next Scan 2026-02-28T19:35:00+00:00

Last Scan

Scanned2026-02-21T19:35:00+00:00
URL https://awlsa.com.au/robots.txt
Redirect https://awl.org.au/robots.txt
Redirect Domain awl.org.au
Redirect Base awl.org.au
Domain IPs 13.54.222.56, 13.54.88.239, 13.55.140.143, 49.236.243.181
Redirect IPs 13.54.222.56, 13.54.88.239, 13.55.140.143
Response IP 13.55.140.143
Found Yes
Hash be7b2c898f09be52967d0a5021694d25b57ab7d5058dd55369f0a2f4ef6df548
SimHash 017019563d92

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Back to top

Other Records

Field Value
sitemap https://awl.org.au/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://awl.org.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top