Log In Sign Up

bowwow.com.au
robots.txt

Robots Exclusion Standard data for bowwow.com.au

Resource Scan

Scan Details

Site Domain bowwow.com.au
Base Domain bowwow.com.au
Scan Status Ok
Last Scan2025-10-24T15:24:52+00:00
Next Scan 2025-10-31T15:24:52+00:00

Last Scan

Scanned2025-10-24T15:24:52+00:00
URL https://bowwow.com.au/robots.txt
Domain IPs 104.21.57.70, 172.67.160.240, 2606:4700:3031::6815:3946, 2606:4700:3035::ac43:a0f0
Response IP 172.67.160.240
Found Yes
Hash 60c99dba4c35ad553a55546a46edb8b611bf3d82f763173901c289aa8b724933
SimHash 6c3c48326cb9

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-plugins/
Disallow /wp-content/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /cgi-bin/
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /*.env$
Disallow /feed/
Disallow /*/feed/
Allow /wp-content/uploads/
Disallow /*.js.map$
Disallow /*.css.map$
Disallow /tag/
Disallow /author/
Disallow /*?replytocom
Disallow /*?s=
Back to top

Other Records

Field Value
sitemap https://bowwow.com.au/sitemap_index.xml
Back to top

Comments

  • Block sensitive or unnecessary directories and files
  • Block all feed URLs (root and nested)
  • Allow image/media indexing
  • Block map files
  • Optional: Reduce duplicate content
  • Sitemap location
Back to top