Log In Sign Up

awl.org.au
robots.txt

Robots Exclusion Standard data for awl.org.au

Resource Scan

Scan Details

Site Domain awl.org.au
Base Domain awl.org.au
Scan Status Ok
Last Scan2026-02-16T17:01:08+00:00
Next Scan 2026-02-23T17:01:08+00:00

Last Scan

Scanned2026-02-16T17:01:08+00:00
URL https://awl.org.au/robots.txt
Domain IPs 13.54.222.56, 13.54.88.239, 13.55.140.143
Response IP 13.54.88.239
Found Yes
Hash be7b2c898f09be52967d0a5021694d25b57ab7d5058dd55369f0a2f4ef6df548
SimHash 017019563d92

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Back to top

Other Records

Field Value
sitemap https://awl.org.au/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://awl.org.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top