Robotics, augmented reality (AR) and artificial intelligence (AI) are expected to have a major impact on the future of surgery. The use of AR through a head-mounted display for surgical navigation has been proven feasible and useful in phantom studies and clinical studies, but the current state of technology retains some limitations. The goal of the AIM project is to develop AR-based surgical navigation that allows intraoperative measurements and the on-the-fly update of preoperative imaging information during craniomaxillofacial, orthopedic and neurosurgery. It also includes the development of a dedicated training module for this novel surgical device.
Computer-assisted surgical systems based on robotics, AR and AI are useful in pre-operative planning, surgical navigation, and intraoperative measurements. In a previous work, a prototype was created running on the HoloLens platform. However, the device doesn’t allow intraoperative changes to the preoperative surgical plan, nor does it account for changing patient anatomy. In addition, a training platform is required to ensure safe and accurate operation of the solution.
The AIM project aims to extend the functionality of this AR navigation solution by adding intraoperative measurement capabilities. It will do so by investigating innovative surface reconstruction technologies, which will provide continuous high-resolution measurements at high frame rates during surgery – without the need to interrupt the procedure.
In addition to developing dynamic AR navigation, the AIM consortium will:
As a result of these research outcomes, the consortium partners – which include players in the fields of preoperative planning, surgical AR workflows, surgical training, and custom AR development – will be able to broaden their offerings and deepen their fields of expertise. This will lead to safer, faster surgeries and AR opportunities not only in medicine, but in construction and interior design as well.
“The goal of the AIM project is to develop dynamic AR-based navigation that allows intraoperative measurements and on-the-fly update of preoperative imaging information, during craniomaxillofacial, orthopedic and neurosurgery. It also includes the development of a dedicated training module.”
Automated Intraoperative Measurements for AR-guided surgery.
Bolucap is an imec.icon research project funded by imec and Agentschap innoveren & ondernemen.
It started on 01.06.2020 and is set to run until 31.05.2022.