Published January 30, 2025 | Version 1.0
Model Open

Deep Learning Models for Segmentation of Atherosclerotic Plaque Features in OCT Images

  • 1. ROR icon Pompeu Fabra University
  • 2. Symfa
  • 3. ROR icon Siberian State Medical University
  • 4. Research Institute for Complex Issues of Cardiovascular Diseases

Description

Introduction: We present a collection of deep learning models developed for the automated segmentation and quantification of plaque morphological features (PMFs) of atherosclerotic plaques in optical coherence tomography (OCT) images. These models enable precise delineation of plaque features such as the vascular lumen (LM), fibrous cap (FC), lipid core (LC), and vasa vasorum (VV), providing critical insights into plaque composition and vulnerability, which are essential for cardiovascular diagnostics and intervention planning.

Dataset: The dataset utilized in this study consists of OCT images obtained from 103 patients across multiple cardiovascular research centers. It includes 25,698 annotated slices representing plaque morphological features. The annotations highlight the lumen, fibrous cap, lipid core, and vasa vasorum, with verification by expert cardiologists to ensure accuracy and consistency. The dataset's diversity in imaging conditions and patient demographics ensures robust model evaluation. For detailed information about the dataset, please refer to the dataset documentation at https://doi.org/10.5281/zenodo.14478209.

Model Description: We employed nine advanced deep learning architectures — U-Net, U-Net++, DeepLabV3, DeepLabV3+, FPN, LinkNet, PSPNet, PAN, and MA-Net — to address the segmentation of atherosclerotic plaque features. To enhance performance, we applied a hybrid segmentation strategy, which involves designing specialized models for each plaque feature based on their prevalence and complexity:

  • Lumen Segmentation: A single-class model trained exclusively for the lumen, leveraging its high representation in the dataset.
  • Fibrous Cap and Lipid Core Segmentation: A two-class model trained jointly on these features due to their shared morphological characteristics and moderate dataset representation.
  • Vasa Vasorum Segmentation: A separate single-class model focused on this rare feature to better capture its unique characteristics.

Extensive hyperparameter optimization using Bayesian techniques, combined with augmentation strategies like perspective distortion and brightness adjustments, enhanced the robustness of the models.

Results: The models exhibited varying levels of accuracy across features. U-Net++ excelled in lumen segmentation, achieving a Dice Similarity Coefficient (DSC) of 0.987. This performance reflects the advantage of a single-class model dedicated to the lumen, leveraging its high representation in the dataset to capture clear and distinct boundaries effectively.

For fibrous cap and lipid core segmentation, LinkNet performed strongly with DSCs of 0.736 and 0.751, respectively. These results highlight the effectiveness of a two-class model trained jointly on these features, allowing it to better handle their shared morphological characteristics, such as overlapping and intricate boundaries.

The segmentation of vasa vasorum, a rare and subtle feature, was tackled using a dedicated single-class U-Net model, achieving a DSC of 0.610. Despite the inherent challenges due to its sparse representation in the dataset, this approach ensured focused learning on the vasa vasorum's unique structure, yielding promising results.

An ensemble approach combining U-Net++, LinkNet, and U-Net further improved overall segmentation accuracy, achieving an average DSC of 0.882. These results demonstrate the effectiveness of tailoring model architectures and strategies to the specific requirements of each plaque feature. Performance metrics, including precision, recall, and IoU, are detailed in Table 1, with training dynamics and segmentation outcomes visualized in Figures 1 and Figure 2.

Access to the Study: Further information about this study, including curated source code, dataset details, and trained models, can be accessed through the following repositories:

 

Table 1. Segmentation performance metrics for each plaque morphological feature, averaged over 5 folds during cross-validation.

PMF

Precision

Recall

F1

IoU

DSC

Lumen

0.986

0.988

0.987

0.975

0.987

Fibrous cap

0.737

0.784

0.736

0.608

0.736

Lipid core

0.815

0.772

0.751

0.639

0.751

Vasa vasorum

0.664

0.630

0.610

0.511

0.610

 

Files

Figure 2. Ground truth and model predictions.png

Files (1.3 GB)

Name Size Download all
md5:031a6b9055bb1ed1e0d2422be8aee18a
1.3 MB Preview Download
md5:8a47c8983bd62f3dfebefb7c45ae9669
2.1 MB Preview Download
md5:1a8a20bf453d1db54c10dff2a2ba97c2
1.3 GB Preview Download

Additional details

Related works

Is part of
Journal article: 10.1016/j.compbiomed.2025.111061 (DOI)

Funding

Russian Science Foundation
Development of an automated deep learning system for detecting unstable plaques in optical coherence tomography 23-75-10009

Software

Repository URL
https://github.com/ViacheslavDanilov/oct_segmentation
Programming language
Python
Development Status
Active