scranton.edu
robots.txt
Robots Exclusion Standard data for scranton.edu
Resource Scan
Scan Details
Site Domain | scranton.edu |
Base Domain | scranton.edu |
Scan Status | Ok |
Last Scan | 2024-08-30T23:21:50+00:00 |
Next Scan | 2024-09-29T23:21:50+00:00 |
Last Scan
Scanned | 2024-08-30T23:21:50+00:00 |
URL | https://scranton.edu/robots.txt |
Redirect | https://www.scranton.edu/robots.txt |
Redirect Domain | www.scranton.edu |
Redirect Base | scranton.edu |
Domain IPs | 134.198.4.85 |
Redirect IPs | 134.198.4.85 |
Response IP | 134.198.4.85 |
Found | Yes |
Hash | 44af123698a48934a770b72f59c00a5f737c7bbbeab2f535052f631eb217052f |
SimHash | 291d5336e694 |
Groups
*
Rule | Path |
---|---|
Disallow | /_private/ |
Disallow | /1assets/ |
Disallow | /about/diversity-inclusion/assets/widgets |
Disallow | /academics/pcps/assets/widgets/ |
Disallow | /academics/pcps/education/index |
Disallow | /activecampus/ |
Disallow | /alumni/widgets/ |
Disallow | /archive/ |
Disallow | /cgi-bin/ |
Disallow | /cms_structures/ |
Disallow | /development/athletics-fund/assets/widgets/ |
Disallow | /press/pages/ |
Disallow | /pir/its/ |
Disallow | /pir/lms-evaluation/ |
Disallow | /pir/asset-management/ |
Disallow | /pir/Banner/ |
Disallow | /pir/banner-support/ |
Disallow | /pir/network-infrastructure/ |
Disallow | /pir/on-the-horizon/ |
Disallow | /pir/pmo/ |
Disallow | /pir/royaldrive/ |
Disallow | /pir/information-security/ |
Disallow | /pir/itda/ |
Disallow | /pir/lms/ |
Disallow | /transition/pdf/ |
Disallow | /widgets/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.scranton.edu/sitemap.xml |