beakon.com.au
robots.txt

Robots Exclusion Standard data for beakon.com.au

Resource Scan

Scan Details

Site Domain beakon.com.au
Base Domain beakon.com.au
Scan Status Ok
Last Scan2025-12-21T21:18:57+00:00
Next Scan 2026-01-20T21:18:57+00:00

Last Scan

Scanned2025-12-21T21:18:57+00:00
URL https://beakon.com.au/robots.txt
Domain IPs 103.26.237.201
Response IP 103.26.237.201
Found Yes
Hash 2a2697d588d34f20b3b700fd6ca8fd407d9c9c8cfb1be3759c52051b547b1e30
SimHash 29c09250cd11

Groups

*

Rule Path
Allow /?display=wide
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /readme.html
Disallow /wp-admin/
Disallow /admin/
Disallow /backend/
Disallow /Backup/
Disallow /login/
Disallow /users/forgot_password/
Disallow /users/verify/
Disallow /users/registration
Disallow /users/change_password
Disallow /*?*
Disallow /Default2.aspx

yahoo-mmcrawler

Rule Path
Disallow /admin/
Disallow /backend/
Disallow /Backup/
Disallow /login/
Disallow /users/forgot_password/
Disallow /users/verify/
Disallow /users/registration
Disallow /users/change_password
Disallow /*?*

msnbot

Rule Path
Disallow /admin/
Disallow /backend/
Disallow /Backup/
Disallow /login/
Disallow /users/forgot_password/
Disallow /users/verify/
Disallow /users/registration
Disallow /users/change_password

fast-webcrawler

Rule Path
Disallow /admin/
Disallow /backend/
Disallow /Backup/
Disallow /login/
Disallow /users/forgot_password/
Disallow /users/verify/
Disallow /users/registration
Disallow /users/change_password

slurp

Rule Path
Disallow /admin/
Disallow /backend/
Disallow /Backup/
Disallow /login/
Disallow /users/forgot_password/
Disallow /users/verify/
Disallow /users/registration
Disallow /users/change_password

lycos_spider_(t-rex)

Rule Path
Disallow /admin/
Disallow /backend/
Disallow /Backup/
Disallow /login/
Disallow /users/forgot_password/
Disallow /users/verify/
Disallow /users/registration
Disallow /users/change_password

Comments

  • Disallow: /wp-includes/
  • FULL access (Yahoo)
  • FULL access (MSN)
  • FULL access (FAST/AllTheWeb)
  • FULL access (Inktomi)
  • FULL access (Lycos)