Log In Sign Up

buddi.digitalcave.ca
robots.txt

Robots Exclusion Standard data for buddi.digitalcave.ca

Resource Scan

Scan Details

Site Domain buddi.digitalcave.ca
Base Domain digitalcave.ca
Scan Status Ok
Last Scan2025-12-12T23:50:59+00:00
Next Scan 2026-01-11T23:50:59+00:00

Last Scan

Scanned2025-12-12T23:50:59+00:00
URL http://buddi.digitalcave.ca/robots.txt
Domain IPs 70.73.137.113
Response IP 70.73.137.113
Found Yes
Hash 0618f24f221fd8b045de438569650733f91f8b90d7521579e01b875a217b07b6
SimHash b3829a0acd76

Groups

*

Rule Path
Disallow /img
Disallow /builds
Back to top

Comments

  • Tells robots where they cannot go.
  • User-agent: can also specify by name; "*" is for everyone
  • Disallow: disallow if this matches first part of requested path
Back to top