Belgian world first: Surgeon receives support from voice-controlled AI assistant

During a surgical conference in Ghent, a voice-controlled AI assistant was presented that supports doctors in real time during robotic surgery. The system monitors the procedure and combines different AI models that analyse information and make it available in the operating theatre. The technology was presented as a world first.
The so-called 'AI co-pilot' was developed within Mantyx, a spin-off of Orsi Academy, and works as a voice-controlled assistant that continuously provides relevant information. During an operation, surgeons can use voice commands to call up medical images, navigate through scans or request additional context without leaving their position at the surgical robot. The system also understands the context of the procedure and automatically selects the correct images, for example, of the exact location of a tumour.
“We bring all the information together and make it immediately available in the operating theatre, so that the surgeon has to search less or think less about where the information is,” explained developer Pieter De Backer.
The technology continuously analyses the operation and recognises which phase the surgeon is in. Based on this, the system can display relevant information at the right moment. “It's not a dumb assistant that just performs tasks, but a system that understands context,” declared De Backer.
In addition to providing support during the procedure itself, the technology also offers concrete benefits for hospitals. For example, the AI can automatically estimate how much longer an operation will take. This enables more efficient planning of operating theatres and helps to better communicate waiting times to patients and staff.
“This is an assistant, not a replacement for the surgeon"
For the time being, the AI co-pilot does not make any medical decisions that have a direct impact on the patient. “This is an assistant, not a replacement for the surgeon. Safety and validation are paramount.”
The technology is seen as an important step towards further integration of artificial intelligence in the operating theatre. Further validation and certification should pave the way for broader application in clinical practice.
#FlandersNewsService | Presentation of an AI assistant for surgeons © BELGA PHOTO JONAS DHOLLANDER + © BELGA VIDEO JONAS D'HOLLANDER
Related news