aihe.edu.au
robots.txt

Robots Exclusion Standard data for aihe.edu.au

Resource Scan

Scan Details

Site Domain aihe.edu.au
Base Domain aihe.edu.au
Scan Status Ok
Last Scan2025-12-23T10:06:28+00:00
Next Scan 2026-01-22T10:06:28+00:00

Last Scan

Scanned2025-12-23T10:06:28+00:00
URL http://aihe.edu.au/robots.txt
Redirect http://www.aihe.edu.au/robots.txt
Redirect Domain www.aihe.edu.au
Redirect Base aihe.edu.au
Domain IPs 199.34.228.74
Redirect IPs 199.34.228.74
Response IP 199.34.228.74
Found Yes
Hash 897cfc97c53511a2889f05e0c8139eaeba7c806f4c51566cf76006ac714da997
SimHash e244dc3e6eb3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /emergency-ultrasound-echo.html
Disallow /https%3A//aihe.instructure.com/login/canvas
Disallow /non-clickable-page.html
Disallow /certificate-iii-in-individual-support.html
Disallow /certificate-iv-in-ageing-support.html

Other Records

Field Value
sitemap http://www.aihe.edu.au/sitemap.xml