agron.iastate.edu
robots.txt
Robots Exclusion Standard data for agron.iastate.edu
Resource Scan
Scan Details
| Site Domain | agron.iastate.edu |
| Base Domain | iastate.edu |
| Scan Status | Ok |
| Last Scan | 2025-08-17T19:05:09+00:00 |
| Next Scan | 2025-09-16T19:05:09+00:00 |
Last Scan
| Scanned | 2025-08-17T19:05:09+00:00 |
| URL | https://agron.iastate.edu/robots.txt |
| Domain IPs | 20.241.39.52 |
| Response IP | 20.241.39.52 |
| Found | Yes |
| Hash | f16e50d43fdca753ce107fea6c124c6fe81c3b7d0598633f011c9fb32e886abe |
| SimHash | 1940d9682739 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads/ |
| Allow | /wp-content/blogs.dir/ |
| Allow | /wp-content/cache/ |
| Disallow | /?s= |
| Disallow | /search/ |
| Disallow | /readme.html |
| Disallow | /*.txt$ |
| Disallow | /*.md$ |
| Disallow | /wp-login* |
| Disallow | /user/login* |