bulletins.psu.edu
robots.txt
Robots Exclusion Standard data for bulletins.psu.edu
Resource Scan
Scan Details
Site Domain | bulletins.psu.edu |
Base Domain | psu.edu |
Scan Status | Ok |
Last Scan | 2025-03-03T21:45:59+00:00 |
Next Scan | 2025-04-02T21:45:59+00:00 |
Last Scan
Scanned | 2025-03-03T21:45:59+00:00 |
URL | https://bulletins.psu.edu/robots.txt |
Domain IPs | 12.175.6.47 |
Response IP | 12.175.6.47 |
Found | Yes |
Hash | 170cd69a22e9465eb08b75436ad1bb0d9f2fc1b5c00d9162b96147cc68530bb4 |
SimHash | 8c4d74e53197 |
Groups
*
Rule | Path |
---|---|
Disallow | /archive/ |
Disallow | /admin/ |
Disallow | /azindex/ |
Disallow | /catalogcontents/ |
Disallow | /cim/ |
Disallow | /clmail/ |
Disallow | /courseleaf/ |
Disallow | /css/ |
Disallow | /dbleaf/ |
Disallow | /depts/ |
Disallow | /fonts/ |
Disallow | /gallery/ |
Disallow | /images/ |
Disallow | /js/ |
Disallow | /mig/ |
Disallow | /migration/ |
Disallow | /navbar/ |
Disallow | /pagewiz/ |
Disallow | /responseform/ |
Disallow | /ribbit/ |
Disallow | /sam/ |
Disallow | /search/ |
Disallow | /shared/ |
Disallow | /styles/ |
Disallow | /tmp/ |
Disallow | /wiztest/ |
Disallow | /xsearch/ |
Disallow | /undergraduate-borrowed/ |
Disallow | /undergraduate-borrowed/index.html |
Disallow | /pdf/ |
Disallow | /courseadmin/ |
Disallow | /programadmin/ |
Disallow | /prospectusadmin/ |
Other Records
Field | Value |
---|---|
sitemap | https://bulletins.psu.edu/sitemap.xml |