mypennstate.psu.edu
robots.txt
Robots Exclusion Standard data for mypennstate.psu.edu
Resource Scan
Scan Details
| Site Domain | mypennstate.psu.edu |
| Base Domain | psu.edu |
| Scan Status | Ok |
| Last Scan | 2025-06-01T19:15:05+00:00 |
| Next Scan | 2025-07-01T19:15:05+00:00 |
Last Scan
| Scanned | 2025-06-01T19:15:05+00:00 |
| URL | https://mypennstate.psu.edu/robots.txt |
| Domain IPs | 128.118.5.135 |
| Response IP | 128.118.5.135 |
| Found | Yes |
| Hash | 8ba82609b66646edc587312693aa03798df8c6721a728d03cdafeee4fa54e87f |
| SimHash | be0a4822eb71 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /config/ |
| Disallow | /handlers/ |
| Disallow | /includes/ |
| Disallow | /interceptors/ |
| Disallow | /layouts/ |
| Disallow | /logs/ |
| Disallow | /model/ |
| Disallow | /plugins/ |
| Disallow | /views/ |
| Disallow | / |