condos.ca
robots.txt

Robots Exclusion Standard data for condos.ca

Resource Scan

Scan Details

Site Domain condos.ca
Base Domain condos.ca
Scan Status Ok
Last Scan2024-04-24T20:05:13+00:00
Next Scan 2024-05-24T20:05:13+00:00

Last Scan

Scanned2024-04-24T20:05:13+00:00
URL https://condos.ca/robots.txt
Domain IPs 104.26.6.33, 104.26.7.33, 172.67.69.100, 2606:4700:20::681a:621, 2606:4700:20::681a:721, 2606:4700:20::ac43:4564
Response IP 104.26.7.33
Found Yes
Hash 7c658cfffe3084928a5ad119ca1784d68271ed31c68d78c1f88445ee1b96cf67
SimHash ea5cac462d96

Groups

*

Rule Path
Disallow /admin/*
Disallow /signup*
Disallow /login*
Disallow /pricehistory*
Disallow /new-search*

Other Records

Field Value
sitemap https://condos.ca/sitemap.xml
sitemap https://condos.ca/new_listings.xml

Comments

  • Robots text file for crawling condos.ca.