AIM

Building on promising prototypes

Computer-assisted surgical systems based on robotics, AR and AI are useful in pre-operative planning, surgical navigation, and intraoperative measurements. In a previous work, a prototype was created running on the HoloLens platform. However, the device doesn’t allow intraoperative changes to the preoperative surgical plan, nor does it account for changing patient anatomy. In addition, a training platform is required to ensure safe and accurate operation of the solution.

On-the-fly visualization tailored to the procedure

The AIM project aims to extend the functionality of this AR navigation solution by adding intraoperative measurement capabilities. It will do so by investigating innovative surface reconstruction technologies, which will provide continuous high-resolution measurements at high frame rates during surgery – without the need to interrupt the procedure.

Three core surgical use cases, 6 goals

In addition to developing dynamic AR navigation, the AIM consortium will:

• expand know-how regarding surface-scanning technologies;
• create a software developer kit that syncs AR headsets and external sensors;
• develop novel algorithms for on-the-fly interoperative measurements;
• design a novel preoperative planning tool for orthognathic surgery;
• develop AR applications for cranio-maxillofacial surgery, orthopedic surgery and neurosurgery;
• create a dedicated training program for the use of surgical AR.

Driving computer-assisted surgery forward

As a result of these research outcomes, the consortium partners – which include players in the fields of preoperative planning, surgical AR workflows, surgical training, and custom AR development – will be able to broaden their offerings and deepen their fields of expertise. This will lead to safer, faster surgeries and AR opportunities not only in medicine, but in construction and interior design as well.

“The goal of the AIM project is to develop dynamic AR-based navigation that allows intraoperative measurements and on-the-fly update of preoperative imaging information, during craniomaxillofacial, orthopedic and neurosurgery. It also includes the development of a dedicated training module.”