questromcommon.bu.edu
robots.txt
Robots Exclusion Standard data for questromcommon.bu.edu
Resource Scan
Scan Details
Site Domain | questromcommon.bu.edu |
Base Domain | bu.edu |
Scan Status | Ok |
Last Scan | 2024-06-21T12:50:26+00:00 |
Next Scan | 2024-07-05T12:50:26+00:00 |
Last Scan
Scanned | 2024-06-21T12:50:26+00:00 |
URL | https://questromcommon.bu.edu/robots.txt |
Domain IPs | 2600:1f18:4fe:be10:6129:deda:c206:a3a6, 2600:1f18:4fe:be11:f472:7e7d:1e64:a2e1, 3.89.11.108, 54.84.65.206 |
Response IP | 3.89.11.108 |
Found | Yes |
Hash | 916bf5f925f86fb394a2a96b3f70949da87a4b479cded09e7374f2ca56f4a41a |
SimHash | b80534e6e383 |
Groups
*
Rule | Path |
---|---|
Disallow | /upload/ |
Disallow | /student_docs/ |
Disallow | /downloads/ |
Disallow | /mobile_ws/v17/ |
Disallow | /mobile_ws/v18/ |
Disallow | /*ajax_widget_new |