dukegroups.com
robots.txt
Robots Exclusion Standard data for dukegroups.com
Resource Scan
Scan Details
| Site Domain | dukegroups.com |
| Base Domain | dukegroups.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-08-04T07:38:10+00:00 |
| Next Scan | 2025-11-02T07:38:10+00:00 |
Last Successful Scan
| Scanned | 2024-07-04T05:59:31+00:00 |
| URL | https://dukegroups.com/robots.txt |
| Domain IPs | 2600:1f18:4fe:be10:ab6c:fe2f:30d0:7aa4, 2600:1f18:4fe:be11:76ba:f690:2099:89f8, 3.208.148.206, 54.235.162.76 |
| Response IP | 3.208.148.206 |
| Found | Yes |
| Hash | 916bf5f925f86fb394a2a96b3f70949da87a4b479cded09e7374f2ca56f4a41a |
| SimHash | b80534e6e383 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /upload/ |
| Disallow | /student_docs/ |
| Disallow | /downloads/ |
| Disallow | /mobile_ws/v17/ |
| Disallow | /mobile_ws/v18/ |
| Disallow | /*ajax_widget_new |