dsu.edu
robots.txt
Robots Exclusion Standard data for dsu.edu
Resource Scan
Scan Details
| Site Domain | dsu.edu |
| Base Domain | dsu.edu |
| Scan Status | Ok |
| Last Scan | 2024-10-24T19:57:40+00:00 |
| Next Scan | 2024-11-23T19:57:40+00:00 |
Last Scan
| Scanned | 2024-10-24T19:57:40+00:00 |
| URL | https://dsu.edu/robots.txt |
| Domain IPs | 23.99.192.132 |
| Response IP | 23.99.192.132 |
| Found | Yes |
| Hash | 1f021aa0d3548002929c91a4efd16636c7ee66f5bcf6f819ffdf86fd73fa57ab |
| SimHash | 48045854e913 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
*
| Rule | Path |
|---|---|
| Disallow | /about-dsu/Collegevaluesonline.com |
| Disallow | /events/idig |
| Disallow | /news/industry-advisory-board-reaches-five-year-mark |
| Disallow | /news/dsu-named-safest-sd-campus |
| Disallow | /academics/degrees-and-programs/finance-bba |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dsu.edu/sitemap.xml |
| sitemap | https://dsu.edu/news/sitemap.xml |
| sitemap | https://dsu.edu/calendar/sitemap.xml |
Comments