Asynchronous Multibody Framework Plus (AMBF+)
- Supervisors: Prof. Mathias Unberath & Prof. Russell Taylor
- Institution: Laboratory for Computational Sensing & Robotics, Johns Hopkins University
Asynchronous Multibody Framework Plus (AMBF+) is an open-sourced simulation framework that simultaneously generates data for downstream algorithm development and allows users to practice their surgical skills. It can generate data viz. stereo RGB images, depth, segmentation maps, object pose, etc. We developed a virtual drilling simulator for lateral skull-base surgery to demonstrate a use-case of AMBF+. It enables users to modify the patient anatomy actively using a virtual surgical drill. AMBF+ integrates visual (stereoscopic display on a virtual reality [VR] device) and haptic feedback that offers immersive surgical simulation.
- I conceived and established the initial prototype for a virtual drilling simulator, allowing users to interactively practice drilling volumetric data, specifically in anatomy
- I conceptualized and implemented the algorithm for drill-shaft collisions, delivering haptic feedback to users regarding the virtual surgical drill shaft's interaction with anatomical structures
- I implemented safety features to display warning messages when drilling near critical anatomy regions, enabled real-time saving and loading of simulation states, and facilitated recording and replaying of drill movements within the simulator.
Publication
Munawar, A., Li, Z., Kunjam, P., Nagururu, N., Ding, A.S., Kazanzides, P.,
Looi, T., Creighton, F.X., Taylor, R.H. and Unberath, M., “Virtual reality
for synergistic surgical training and data generation.” Computer Methods in
Biomechanics and Biomedical Engineering: Imaging & Visualization (2021): 1-9.
Outstanding Paper Award
[GitHub]
[PDF]
[DOI]
All images © 2021 Taylor & Francis