questromcommon.bu.edu
robots.txt
Robots Exclusion Standard data for questromcommon.bu.edu
Resource Scan
Scan Details
Site Domain | questromcommon.bu.edu |
Base Domain | bu.edu |
Scan Status | Ok |
Last Scan | 2024-06-07T12:50:20+00:00 |
Next Scan | 2024-06-21T12:50:20+00:00 |
Last Scan
Scanned | 2024-06-07T12:50:20+00:00 |
URL | https://questromcommon.bu.edu/robots.txt |
Domain IPs | 18.213.70.84, 2600:1f18:4fe:be10:865:25ea:30fc:2575, 2600:1f18:4fe:be11:534b:bc83:e125:5950, 44.214.54.15 |
Response IP | 44.214.54.15 |
Found | Yes |
Hash | 916bf5f925f86fb394a2a96b3f70949da87a4b479cded09e7374f2ca56f4a41a |
SimHash | b80534e6e383 |
Groups
*
Rule | Path |
---|---|
Disallow | /upload/ |
Disallow | /student_docs/ |
Disallow | /downloads/ |
Disallow | /mobile_ws/v17/ |
Disallow | /mobile_ws/v18/ |
Disallow | /*ajax_widget_new |