sciencealive.net.au
robots.txt

Robots Exclusion Standard data for sciencealive.net.au

Resource Scan

Scan Details

Site Domain sciencealive.net.au
Base Domain sciencealive.net.au
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-10T13:03:40+00:00
Next Scan 2025-10-10T13:03:40+00:00

Last Successful Scan

Scanned2025-08-11T20:14:22+00:00
URL https://sciencealive.net.au/robots.txt
Domain IPs 110.232.143.96, 2400:b800:8::96
Response IP 110.232.143.96
Found Yes
Hash 080126d6075c5e4bc56e902b25a1693cb980959ab6fd87133f24cfee247ab19c
SimHash 21301d5637b7

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.sciencealive.net.au/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.sciencealive.net.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/