math.uwaterloo.ca
robots.txt
Robots Exclusion Standard data for math.uwaterloo.ca
Resource Scan
Scan Details
Site Domain | math.uwaterloo.ca |
Base Domain | uwaterloo.ca |
Scan Status | Ok |
Last Scan | 2025-02-17T07:50:17+00:00 |
Next Scan | 2025-03-19T07:50:17+00:00 |
Last Scan
Scanned | 2025-02-17T07:50:17+00:00 |
URL | https://math.uwaterloo.ca/robots.txt |
Domain IPs | 129.97.206.16 |
Response IP | 129.97.206.16 |
Found | Yes |
Hash | d7c5717ee65ee78be76b590d30a26c94ca39a148d054f8569bf4b52308b3f713 |
SimHash | 2554a301d9bb |
Groups
*
Rule | Path |
---|---|
Allow | /$ |
Allow | /robots.txt |
Allow | /users.html |
Allow | /sitemap.* |
Allow | /tsp/ |
Allow | /~* |
Disallow | /MFCF/mfcfnow/ |
Disallow | /mfcf/mfcfnow/ |
Disallow | /mfcf/internal/ |
Allow | /MFCF/ |
Allow | /mfcf/ |
Disallow | /* |