www.stat.purdue.edu
robots.txt

Robots Exclusion Standard data for www.stat.purdue.edu

Resource Scan

Scan Details

Site Domain www.stat.purdue.edu
Base Domain purdue.edu
Scan Status Ok
Last Scan2025-08-15T15:05:25+00:00
Next Scan 2025-09-14T15:05:25+00:00

Last Scan

Scanned2025-08-15T15:05:25+00:00
URL https://www.stat.purdue.edu/robots.txt
Domain IPs 128.210.141.116
Response IP 128.210.141.116
Found Yes
Hash a059660e1ad91248893a8b8f4d0a4ac880c2174fe19c66f97a7f6c05e08eac52
SimHash f450004867b1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /resources/jobs/jobs.cgi
Disallow /resources/jobs/admin/
Disallow /resources/jobs/data/
Disallow /resources/jobs/files/
Disallow /academic_programs/courses/coursePages/
Disallow /academic_programs/courses/coursePages/spring97/
Disallow /academic_programs/courses/coursePages/fall97/
Disallow /academic_programs/courses/coursePages/spring98/
Disallow /academic_programs/courses/coursePages/summer98/
Disallow /academic_programs/courses/coursePages/fall98/
Disallow /academic_programs/courses/coursePages/spring99/
Disallow /academic_programs/courses/coursePages/summer99/
Disallow /academic_programs/courses/coursePages/fall99/
Disallow /academic_programs/courses/coursePages/spring00/
Disallow /academic_programs/courses/coursePages/summer00/
Disallow /academic_programs/courses/coursePages/fall00/
Disallow /academic_programs/courses/coursePages/spring01/
Disallow /academic_programs/courses/coursePages/summer01/
Disallow /academic_programs/courses/coursePages/fall01/
Disallow /academic_programs/courses/coursePages/spring02/
Disallow /academic_programs/courses/coursePages/summer02/
Disallow /academic_programs/courses/coursePages/fall02/
Disallow /courses/
Disallow /courses/coursePages/spring97/
Disallow /courses/coursePages/fall97/
Disallow /courses/coursePages/spring98/
Disallow /courses/coursePages/summer98/
Disallow /courses/coursePages/fall98/
Disallow /courses/coursePages/spring99/
Disallow /courses/coursePages/summer99/
Disallow /courses/coursePages/fall99/
Disallow /courses/coursePages/spring00/
Disallow /courses/coursePages/summer00/
Disallow /courses/coursePages/fall00/
Disallow /courses/coursePages/spring01/
Disallow /courses/coursePages/summer01/
Disallow /courses/coursePages/fall01/
Disallow /courses/coursePages/spring02/
Disallow /courses/coursePages/summer02/
Disallow /courses/coursePages/fall02/