ccl.northwestern.edu
robots.txt
Robots Exclusion Standard data for ccl.northwestern.edu
Resource Scan
Scan Details
| Site Domain | ccl.northwestern.edu |
| Base Domain | northwestern.edu |
| Scan Status | Ok |
| Last Scan | 2025-03-04T16:58:08+00:00 |
| Next Scan | 2025-04-03T16:58:08+00:00 |
Last Scan
| Scanned | 2025-03-04T16:58:08+00:00 |
| URL | https://ccl.northwestern.edu/robots.txt |
| Domain IPs | 129.105.119.160 |
| Response IP | 129.105.119.160 |
| Found | Yes |
| Hash | 7fdb47bf49a02c5fe46f26c6dd02ac9fb4184a3e60bf00e6e10d2541f6cdf3d3 |
| SimHash | a8396622cb07 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /poetry/ |
| Disallow | /netlogo/internal/ |
| Disallow | /cm/internal/ |
| Disallow | /cm/starlogoT/internal/ |
| Disallow | /cgi-bin/ |
| Disallow | /admin/ |
| Disallow | /internal/ |
| Disallow | /login/ |
| Disallow | /emerald-stuff/ |
| Disallow | /checkbot/ |
| Disallow | /internal.html |
| Disallow | /mailman/ |
| Disallow | /icons/ |
| Disallow | /pipermail/ |
| Disallow | /support/ |
| Disallow | /spencer/ |
| Disallow | /video/ |
| Disallow | /workshop/ |
| Disallow | /uri/ |