teachersguild.nsw.edu.au
robots.txt

Robots Exclusion Standard data for teachersguild.nsw.edu.au

Resource Scan

Scan Details

Site Domain teachersguild.nsw.edu.au
Base Domain teachersguild.nsw.edu.au
Scan Status Ok
Last Scan2024-11-06T18:49:51+00:00
Next Scan 2024-12-06T18:49:51+00:00

Last Scan

Scanned2024-11-06T18:49:51+00:00
URL https://www.teachersguild.nsw.edu.au/robots.txt
Domain IPs 13.225.4.100, 13.225.4.109, 13.225.4.45, 13.225.4.90, 2600:9000:21b4:1e00:16:35a5:6c00:93a1, 2600:9000:21b4:2e00:16:35a5:6c00:93a1, 2600:9000:21b4:5a00:16:35a5:6c00:93a1, 2600:9000:21b4:7800:16:35a5:6c00:93a1, 2600:9000:21b4:9200:16:35a5:6c00:93a1, 2600:9000:21b4:b200:16:35a5:6c00:93a1, 2600:9000:21b4:c800:16:35a5:6c00:93a1, 2600:9000:21b4:d800:16:35a5:6c00:93a1
Response IP 13.225.4.100
Found Yes
Hash b4c2624f7e507891ec8cd5e08f2c2834a4ad63e1f9a0b08dfce3177f20813698
SimHash 415459d1c7e4

Groups

*

Rule Path Comment
Disallow /* Disallow everything
Allow /public/*/website/favicon.ico -

googlebot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

powermapper

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

Comments

  • Allow favicon.ico with wildcard for directory segment