studenthelp.secure.griffith.edu.au
robots.txt

Robots Exclusion Standard data for studenthelp.secure.griffith.edu.au

Resource Scan

Scan Details

Site Domain studenthelp.secure.griffith.edu.au
Base Domain griffith.edu.au
Scan Status Ok
Last Scan2025-09-21T18:40:54+00:00
Next Scan 2025-10-21T18:40:54+00:00

Last Scan

Scanned2025-09-21T18:40:54+00:00
URL https://studenthelp.secure.griffith.edu.au/robots.txt
Domain IPs 129.148.157.195
Response IP 129.148.157.195
Found Yes
Hash b7467eb38cc33b61cdc077936ecf576d4c9d45cd3060ede92b98e73c50641f97
SimHash 2f5ad801c506

Groups

googlebot

Product Comment
googlebot Google # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

msnbot

Product Comment
msnbot MSN # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

slurp

Product Comment
slurp Yahoo! # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

teoma

Product Comment
teoma Ask.com # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

bingbot

Product Comment
bingbot Bing # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

*

Product Comment
* ADDED BY HMS
Rule Path Comment
Disallow / ADDED BY HMS

Other Records

Field Value Comment
sitemap https://studenthelp.secure.griffith.edu.au/ci/sitemap/ ADDED BY HMS