Using Augmented Reality Guidance for Structural Heart Disease (NewYork Presbyterian Hospital)
Sun-Joo Jang, Research Associate, Dalio Institute of Cardiovascular Imaging, department of Radiology, at Weill Cornell Medicine / NewYork Presbyterian Hospital
Abstract:
Transcatheter septal puncture is an important procedure for the success of left-sided structural heart interventions, including left atrial appendage occlusion devices and transcatheter mitral valve repair therapy. Although a transcatheter septal puncture is generally safe under image guidance, serious complications can occur, including accidental puncture of the aorta or pericardial tamponade. Augmented reality (AR) as a 3D enhanced visualization technology can better guide transseptal puncture procedures than views on conventional 2D screens. Here, we demonstrate a fully interactive method to guide cardiac interventions based on pre-procedural and intra-procedural imaging with an AR holographic system and deep learning algorithms. Pre-procedural cardiac CT was used as a patient-specific 3D image data for rendering a patient’s heart and co-registered with 3D catheter positions obtained by Deep Learning-based image segmentation algorithm from 2D X-ray images. The AR guidance system showed high success rate for registration, low registration error, and clinically acceptable computational cost. Final 3D images were reconstructed in the augmented reality environment within the Microsoft HoloLens headset
Add comment