Log In Sign Up

lms.latrobe.edu.au
robots.txt

Robots Exclusion Standard data for lms.latrobe.edu.au

Resource Scan

Scan Details

Site Domain lms.latrobe.edu.au
Base Domain latrobe.edu.au
Scan Status Ok
Last Scan2025-06-18T11:50:41+00:00
Next Scan 2025-07-02T11:50:41+00:00

Last Scan

Scanned2025-06-18T11:50:41+00:00
URL https://lms.latrobe.edu.au/robots.txt
Domain IPs 121.127.32.18, 202.157.180.18
Response IP 202.157.180.18
Found Yes
Hash c833869022ba7d3194e53fefa9ca67fc1742459a20b43843e3219fdc82a7ab3b
SimHash 4815d800e390

Groups

googlebot

Rule Path
Disallow /

googlebot
adsbot-google

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • Example 1: Block only Googlebot
  • Example 2: Block Googlebot and Adsbot
  • Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly)
Back to top