students.aiu.edu
robots.txt
Robots Exclusion Standard data for students.aiu.edu
Resource Scan
Scan Details
Site Domain | students.aiu.edu |
Base Domain | aiu.edu |
Scan Status | Ok |
Last Scan | 2025-04-14T23:54:13+00:00 |
Next Scan | 2025-05-14T23:54:13+00:00 |
Last Scan
Scanned | 2025-04-14T23:54:13+00:00 |
URL | https://students.aiu.edu/robots.txt |
Domain IPs | 4.31.39.141 |
Response IP | 4.31.39.141 |
Found | Yes |
Hash | 956fc7791c32de9904ea5c8d34f96517f2f1ef10680e6e5b17294633effcc785 |
SimHash | bdeacf742b52 |
Groups
*
Rule | Path |
---|---|
Disallow | /University/mockups/* |
Disallow | /university/mockups/* |
Disallow | /University/new-versions/* |
Disallow | /university/new-versions/* |
Disallow | */CaptchaImage.axd?* |
Disallow | */WINDOWS/* |
Disallow | /CountryFlags/ |
Disallow | /Graduation/ |
Disallow | */Links/index.html |
Disallow | /Resources/* |
Disallow | /OutstandingDetail.aspx?AiuUserID=* |
Disallow | /Universidad/* |
Disallow | /universidad/* |
Disallow | /university/* |
Disallow | /University/* |
Disallow | /online/* |
Disallow | /securelogin.html* |
Disallow | /opencourses/ |
Disallow | /Course%20Demo/* |