AIM
/AIM

AIM

Automated Intraoperative Measurements for AR-guided surgery

Smart health logo

Robotics, augmented reality (AR) and artificial intelligence (AI) are expected to have a major impact on the future of surgery. The use of AR through a head-mounted display for surgical navigation has been proven feasible and useful in phantom studies and clinical studies, but the current state of technology retains some limitations. The goal of the AIM project is to develop AR-based surgical navigation that allows intraoperative measurements and the on-the-fly update of preoperative imaging information during craniomaxillofacial, orthopedic and neurosurgery. It also includes the development of a dedicated training module for this novel surgical device.

Building on promising prototypes

Computer-assisted surgical systems based on robotics, AR and AI are useful in pre-operative planning, surgical navigation, and intraoperative measurements. In a previous work, a prototype was created running on the HoloLens platform. However, the device doesn’t allow intraoperative changes to the preoperative surgical plan, nor does it account for changing patient anatomy. In addition, a training platform is required to ensure safe and accurate operation of the solution.

On-the-fly visualization tailored to the procedure

The AIM project aims to extend the functionality of this AR navigation solution by adding intraoperative measurement capabilities. It will do so by investigating innovative surface reconstruction technologies, which will provide continuous high-resolution measurements at high frame rates during surgery – without the need to interrupt the procedure.

Three core surgical use cases, 6 goals

In addition to developing dynamic AR navigation, the AIM consortium will:

  • expand know-how regarding surface-scanning technologies;
  • create a software developer kit that syncs AR headsets and external sensors;
  • develop novel algorithms for on-the-fly interoperative measurements;
  • design a novel preoperative planning tool for orthognathic surgery;
  • develop AR applications for cranio-maxillofacial surgery, orthopedic surgery and neurosurgery;
  • create a dedicated training program for the use of surgical AR.

Driving computer-assisted surgery forward

As a result of these research outcomes, the consortium partners – which include players in the fields of preoperative planning, surgical AR workflows, surgical training, and custom AR development – will be able to broaden their offerings and deepen their fields of expertise. This will lead to safer, faster surgeries and AR opportunities not only in medicine, but in construction and interior design as well.

“The goal of the AIM project is to develop dynamic AR-based navigation that allows intraoperative measurements and on-the-fly update of preoperative imaging information, during craniomaxillofacial, orthopedic and neurosurgery. It also includes the development of a dedicated training module.”

AIM

Automated Intraoperative Measurements for AR-guided surgery.

Bolucap is an imec.icon research project funded by imec and Agentschap innoveren & ondernemen.

It started on 01.06.2020 and is set to run until 31.05.2022.

Project information

Industry

  • Materialise
  • Orsi Academy
  • Cronos - Incito – InspireX

Research

  • imec - ETRO-MIT – VUB
  • VUB - C4N – Neur
  • VUB - BEFY – ORTHO

Contact

  • Project lead: Christophe Van Dijck
  • Research lead: Jef Vandemeulebroucke
  • Proposal Manager: Jef Vandemeulebroucke
  • Innovation manager: Deben Lamon