Log In Sign Up

austinpetsalive.org
robots.txt

Robots Exclusion Standard data for austinpetsalive.org

Resource Scan

Scan Details

Site Domain austinpetsalive.org
Base Domain austinpetsalive.org
Scan Status Ok
Last Scan2025-11-15T03:53:17+00:00
Next Scan 2025-12-15T03:53:17+00:00

Last Scan

Scanned2025-11-15T03:53:17+00:00
URL https://www.austinpetsalive.org/robots.txt
Domain IPs 104.21.5.216, 172.67.133.223, 2606:4700:3031::ac43:85df, 2606:4700:3036::6815:5d8
Response IP 172.67.133.223
Found Yes
Hash 491813850c4730da25d20434b1351e81885900bac4f07edc5b8ff61cbad52903
SimHash 05521d460f91

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /chip-in-donation/create
Disallow /chip-in-set-up/
Disallow /resources/clinic
Disallow /resources/dog-resources
Disallow /resources/cat-resources
Disallow /foster/dogs/detail/
Disallow /foster/cats/detail/
Back to top

Other Records

Field Value
sitemap https://www.austinpetsalive.org/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.austinpetsalive.org/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top