koogle.net.au
robots.txt

Robots Exclusion Standard data for koogle.net.au

Resource Scan

Scan Details

Site Domain koogle.net.au
Base Domain koogle.net.au
Scan Status Ok
Last Scan2025-10-18T20:19:31+00:00
Next Scan 2025-11-01T20:19:31+00:00

Last Scan

Scanned2025-10-18T20:19:31+00:00
URL https://koogle.net.au/robots.txt
Domain IPs 104.21.22.186, 172.67.206.158, 2606:4700:3030::ac43:ce9e, 2606:4700:3032::6815:16ba
Response IP 172.67.206.158
Found Yes
Hash d03c4b6af9b094e41adcf7b9f9d15cf76ff62ea2369f52651fc6811e695c260c
SimHash 6d15a5026692

Groups

*

Rule Path
Disallow /upload_doc/
Disallow /admin/
Disallow /admin/login
Disallow /secure/
Disallow /storage/
Disallow /uploads/
Disallow /emails/

*

Rule Path
Disallow /upload_doc/
Disallow /admin/
Disallow /admin/login
Disallow /secure/
Disallow /storage/
Disallow /uploads/
Disallow /emails/

googlebot

Rule Path
Disallow /upload_doc/
Disallow /admin/

bingbot

Rule Path
Disallow /upload_doc/
Disallow /admin/

duckduckbot

Rule Path
Disallow /upload_doc/
Disallow /admin/

slurp

Rule Path
Disallow /upload_doc/
Disallow /admin/

baiduspider

Rule Path
Disallow /upload_doc/
Disallow /admin/

yandexbot

Rule Path
Disallow /upload_doc/
Disallow /admin/

Comments

  • Prevent indexing of sensitive directories
  • Additional security - block all major search engines