build.ca
robots.txt
Robots Exclusion Standard data for build.ca
Resource Scan
Scan Details
| Site Domain | build.ca |
| Base Domain | build.ca |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-06T14:08:23+00:00 |
| Next Scan | 2024-07-06T14:08:23+00:00 |
Last Successful Scan
| Scanned | 2024-04-15T10:27:32+00:00 |
| URL | https://build.ca/robots.txt |
| Redirect | https://www.build.ca/robots.txt |
| Redirect Domain | www.build.ca |
| Redirect Base | build.ca |
| Domain IPs | 13.248.160.137, 75.2.43.150, 76.223.34.124, 99.83.186.106 |
| Redirect IPs | 184.50.85.132, 184.50.85.147 |
| Response IP | 23.32.29.8 |
| Found | Yes |
| Hash | eb32b917381c413cd0ec36af64c99e00b5b3a24276bc7277334f634c81635e03 |
| SimHash | 1740d5506331 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*catalog*?brands=* |
| Disallow | /catalog*?* |
| Disallow | /search*?* |
| Disallow | /brands*?* |
| Disallow | /catalog*?brands=*&* |
| Disallow | /catalog*?brands=*%2C* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |