math.uwaterloo.ca
robots.txt

Robots Exclusion Standard data for math.uwaterloo.ca

Resource Scan

Scan Details

Site Domain math.uwaterloo.ca
Base Domain uwaterloo.ca
Scan Status Ok
Last Scan2025-02-17T07:50:17+00:00
Next Scan 2025-03-19T07:50:17+00:00

Last Scan

Scanned2025-02-17T07:50:17+00:00
URL https://math.uwaterloo.ca/robots.txt
Domain IPs 129.97.206.16
Response IP 129.97.206.16
Found Yes
Hash d7c5717ee65ee78be76b590d30a26c94ca39a148d054f8569bf4b52308b3f713
SimHash 2554a301d9bb

Groups

*

Rule Path
Allow /$
Allow /robots.txt
Allow /users.html
Allow /sitemap.*
Allow /tsp/
Allow /~*
Disallow /MFCF/mfcfnow/
Disallow /mfcf/mfcfnow/
Disallow /mfcf/internal/
Allow /MFCF/
Allow /mfcf/
Disallow /*

w3c-checklink

Rule Path
Disallow