techtransfer.org.au
robots.txt

Robots Exclusion Standard data for techtransfer.org.au

Resource Scan

Scan Details

Site Domain techtransfer.org.au
Base Domain techtransfer.org.au
Scan Status Ok
Last Scan2025-09-13T08:36:54+00:00
Next Scan 2025-10-13T08:36:54+00:00

Last Scan

Scanned2025-09-13T08:36:54+00:00
URL https://www.techtransfer.org.au/robots.txt
Domain IPs 13.35.37.35, 13.35.37.55, 13.35.37.73, 13.35.37.94, 2600:9000:213e:1600:17:8f34:b780:93a1, 2600:9000:213e:3a00:17:8f34:b780:93a1, 2600:9000:213e:4c00:17:8f34:b780:93a1, 2600:9000:213e:8600:17:8f34:b780:93a1, 2600:9000:213e:ca00:17:8f34:b780:93a1, 2600:9000:213e:d400:17:8f34:b780:93a1, 2600:9000:213e:e00:17:8f34:b780:93a1, 2600:9000:213e:e600:17:8f34:b780:93a1
Response IP 13.35.37.55
Found Yes
Hash 6fd3d5432ac6a88bccd60c2190413b0b7f472cdfc4215099046e62a6f03d1078
SimHash 401459c0c7e4

Groups

*

Rule Path Comment
Disallow /* Disallow everything
Allow /public/*/website/favicon.ico -

googlebot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

powermapper

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /setup*

Comments

  • Allow favicon.ico with wildcard for directory segment