CMAR: a pipeline for cross-modal alignment and 3d reconstruction of coronary arteries based on key bifurcation vessel measurements

Integrating the advantages of coronary angiography (CAG) and intravascular ultrasound (IVUS) images can significantly enhance the effectiveness of diagnosing coronary artery disease. However, current techniques for aligning CAG and IVUS rely solely on the manual determination of IVUS. To address this issue, this paper introduces an innovative 3D intelligent reconstruction pipeline for coronary arteries based on CAG and IVUS. The pipeline introduces three main innovations: (i) The introduction of a label-text guided multi-task network model for classification and segmentation. This model facilitates end-to-end detection of blood vessel bifurcation and vascular wall segmentation, enhancing segmentation accuracy and calculating bifurcation width information by determining the number of bifurcated blood vessel frames. (ii) The proposal of an improved IVUS 3D reconstruction algorithm that integrates dual boundary extraction, dual line segment patch area extraction, and the moving filter-based 3D smoothing algorithm into the reconstruction processing flow. This method not only presents branch information in the 3D reconstruction of blood vessels but also highlights plaque areas, improving the visual impact of the reconstruction. (iii) The introduction of a registration algorithm for key branches of blood vessels based on CAG and IVUS. This algorithm aligns CAG and IVUS using key branch information extracted from CAG, achieving intelligent alignment and reconstruction without manual intervention. Experimental results demonstrate that this algorithm effectively aligns CAG and IVUS, assisting doctors in intuitively assessing and locating vascular plaque information, thereby making a significant contribution to the auxiliary diagnosis of coronary heart disease.