4u1.ca
robots.txt
Robots Exclusion Standard data for 4u1.ca
Resource Scan
Scan Details
| Site Domain | 4u1.ca |
| Base Domain | 4u1.ca |
| Scan Status | Ok |
| Last Scan | 2025-06-18T16:31:05+00:00 |
| Next Scan | 2025-07-18T16:31:05+00:00 |
Last Scan
| Scanned | 2025-06-18T16:31:05+00:00 |
| URL | https://4u1.ca/robots.txt |
| Domain IPs | 147.79.69.239, 2a02:4780:16:7aed:2d07:6a61:6dbf:8bcf, 2a02:4780:38:4f0e:c152:f7a8:901:50c3, 91.108.106.107 |
| Response IP | 179.61.189.141 |
| Found | Yes |
| Hash | ffc411c8efee5f317ad9cf4f8f893ebeb00676233d1420e556a75c020dc37048 |
| SimHash | 281ee82482d3 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /admin/ |
| Disallow | /blocks/ |
| Disallow | /includes/ |
| Disallow | /lang/ |
| Disallow | /pages/ |
| Disallow | /rss/ |
| Disallow | /templates/ |