Algorithmic Integration and Quantification of Endoscopic and 3D TEE Images in Mitral Valve Surgery

Abstract
Minimally invasive surgery is the state-of-the-art approach for repairing the mitral valve, which controls the blood flow into the left heart chamber. The surgeons rely on camera and sensor technologies to support visualization, navigation, and measurement. As patients are connected to the cardio-pulmonary bypass, the anatomy is severely deformed by the altered pressure conditions. We developed a technique that combines stereo-endoscopic video with three-dimensional transesophageal echocardiography (3D TEE) to improve anatomic visualization and measurement accuracy during mitral valve repairs. Our methodology includes stereo camera calibration, image segmentation, and 3D model reconstruction. Anatomical landmarks are used to align the imaging modalities. This approach allows the visualization of pre-operatively determined mitral valve properties, e.g., overlaying heat maps in stereo endoscopic data. Our validation results showed high precision and accuracy within an error range of 0.5 ± 0.1 mm. The effectiveness of the heatmap visualization in complex prolapse cases varied. Integrating stereoscopic and 3D TEE promises greater precision in mitral valve repairs. In the future, this approach can also be used to visualize local tissue properties or the optimal locations of implants.
Description

CCS Concepts: Computing methodologies → Image segmentation; Matching; Reconstruction; Interest point and salient region detections; Shape inference

        
@inproceedings{
10.2312:vcbm.20241185
, booktitle = {
Eurographics Workshop on Visual Computing for Biology and Medicine
}, editor = {
Garrison, Laura
and
Jönsson, Daniel
}, title = {{
Algorithmic Integration and Quantification of Endoscopic and 3D TEE Images in Mitral Valve Surgery
}}, author = {
Ivantsits, Matthias
and
Huellebrand, Markus
and
Walczak, Lars
and
Welz, Juri
and
Greve, Dustin
and
Wamala, Isaac
and
Suendermann, Simon
and
Kempfert, Jörg
and
Falk, Volkmar
and
Hennemuth, Anja
}, year = {
2024
}, publisher = {
The Eurographics Association
}, ISSN = {
2070-5786
}, ISBN = {
978-3-03868-244-8
}, DOI = {
10.2312/vcbm.20241185
} }
Citation