dogshare.com.au
robots.txt

Robots Exclusion Standard data for dogshare.com.au

Resource Scan

Scan Details

Site Domain dogshare.com.au
Base Domain dogshare.com.au
Scan Status Ok
Last Scan2025-12-24T02:43:38+00:00
Next Scan 2025-12-31T02:43:38+00:00

Last Scan

Scanned2025-12-24T02:43:38+00:00
URL https://dogshare.com.au/robots.txt
Domain IPs 104.21.89.76, 172.67.156.246, 2606:4700:3031::ac43:9cf6, 2606:4700:3036::6815:594c
Response IP 104.21.89.76
Found Yes
Hash d6e23f476dd360164c9a4a42b9cf9459c7f0d3858ba17ef6baa60cbebec68590
SimHash 01401d522793

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.dogshare.com.au/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.dogshare.com.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/