agencycanada.com
robots.txt

Robots Exclusion Standard data for agencycanada.com

Resource Scan

Scan Details

Site Domain agencycanada.com
Base Domain agencycanada.com
Scan Status Ok
Last Scan6/8/2025, 4:04:36 PM
Next Scan 6/15/2025, 4:04:36 PM

Last Scan

Scanned6/8/2025, 4:04:36 PM
URL https://agencycanada.com/robots.txt
Domain IPs 104.21.77.90, 172.67.205.251, 2606:4700:3033::ac43:cdfb, 2606:4700:3035::6815:4d5a
Response IP 172.67.205.251
Found Yes
Hash 8177574ecd7665e2bc61d04c9ffb24825c61c8142374c2a771ebd7bfdfa7c82a
SimHash 6930793277b2

Groups

*

Rule Path
Disallow /cron
Disallow /pages
Disallow /search
Disallow /*/add-review
Disallow /*/edit

Comments

  • www.robotstxt.org/
  • Allow crawling of all content