www.engineering.iastate.edu
robots.txt
Robots Exclusion Standard data for www.engineering.iastate.edu
Resource Scan
Scan Details
Site Domain | www.engineering.iastate.edu |
Base Domain | iastate.edu |
Scan Status | Ok |
Last Scan | 2025-08-23T13:37:36+00:00 |
Next Scan | 2025-09-22T13:37:36+00:00 |
Last Scan
Scanned | 2025-08-23T13:37:36+00:00 |
URL | https://www.engineering.iastate.edu/robots.txt |
Domain IPs | 20.241.39.52 |
Response IP | 20.241.39.52 |
Found | Yes |
Hash | f16e50d43fdca753ce107fea6c124c6fe81c3b7d0598633f011c9fb32e886abe |
SimHash | 1940d9682739 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/ |
Allow | /wp-content/blogs.dir/ |
Allow | /wp-content/cache/ |
Disallow | /?s= |
Disallow | /search/ |
Disallow | /readme.html |
Disallow | /*.txt$ |
Disallow | /*.md$ |
Disallow | /wp-login* |
Disallow | /user/login* |