brocku.ca
robots.txt
Robots Exclusion Standard data for brocku.ca
Resource Scan
Scan Details
| Site Domain | brocku.ca |
| Base Domain | brocku.ca |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-17T10:12:23+00:00 |
| Next Scan | 2025-10-15T10:12:23+00:00 |
Last Successful Scan
| Scanned | 2025-02-25T03:06:05+00:00 |
| URL | https://brocku.ca/robots.txt |
| Domain IPs | 104.18.30.50, 104.18.31.50, 2606:4700::6812:1e32, 2606:4700::6812:1f32 |
| Response IP | 104.18.30.50 |
| Found | Yes |
| Hash | 4e5d5b7af366eb1b8a3925a3ccfe8cd41fee20397d52b2eb397f76b84c83a844 |
| SimHash | 0904a346a5fa |
Groups
*
| Product | Comment |
|---|---|
| * | Match all bots |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /~webdev/ | Do not index these legacy pages |
| Disallow | /webfm_send/ | Do not index old Drupal Web File manager documents |
| Disallow | /calendar-events/ | Do not index old Drupal calendar posts |
| Disallow | /news/ | Do not index old Drupal news posts |
| Disallow | /node/ | Do not index old Drupal pages |
| Disallow | /adminservices/ | Do not index these legacy pages |