www.engineering.iastate.edu
robots.txt

Robots Exclusion Standard data for www.engineering.iastate.edu

Resource Scan

Scan Details

Site Domain www.engineering.iastate.edu
Base Domain iastate.edu
Scan Status Ok
Last Scan2025-08-23T13:37:36+00:00
Next Scan 2025-09-22T13:37:36+00:00

Last Scan

Scanned2025-08-23T13:37:36+00:00
URL https://www.engineering.iastate.edu/robots.txt
Domain IPs 20.241.39.52
Response IP 20.241.39.52
Found Yes
Hash f16e50d43fdca753ce107fea6c124c6fe81c3b7d0598633f011c9fb32e886abe
SimHash 1940d9682739

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /wp-content/blogs.dir/
Allow /wp-content/cache/
Disallow /?s=
Disallow /search/
Disallow /readme.html
Disallow /*.txt$
Disallow /*.md$
Disallow /wp-login*
Disallow /user/login*