teachersguild.nsw.edu.au
robots.txt

Robots Exclusion Standard data for teachersguild.nsw.edu.au

Resource Scan

Scan Details

Site Domain teachersguild.nsw.edu.au
Base Domain teachersguild.nsw.edu.au
Scan Status Ok
Last Scan2024-09-07T18:49:09+00:00
Next Scan 2024-10-07T18:49:09+00:00

Last Scan

Scanned2024-09-07T18:49:09+00:00
URL https://www.teachersguild.nsw.edu.au/robots.txt
Domain IPs 13.225.4.100, 13.225.4.109, 13.225.4.45, 13.225.4.90, 2600:9000:21b4:1200:16:35a5:6c00:93a1, 2600:9000:21b4:2800:16:35a5:6c00:93a1, 2600:9000:21b4:2e00:16:35a5:6c00:93a1, 2600:9000:21b4:5800:16:35a5:6c00:93a1, 2600:9000:21b4:5e00:16:35a5:6c00:93a1, 2600:9000:21b4:8600:16:35a5:6c00:93a1, 2600:9000:21b4:b400:16:35a5:6c00:93a1, 2600:9000:21b4:d800:16:35a5:6c00:93a1
Response IP 13.225.4.100
Found Yes
Hash b4c2624f7e507891ec8cd5e08f2c2834a4ad63e1f9a0b08dfce3177f20813698
SimHash 415459d1c7e4

Groups

*

Rule Path Comment
Disallow /* Disallow everything
Allow /public/*/website/favicon.ico -

googlebot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

powermapper

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

Comments

  • Allow favicon.ico with wildcard for directory segment