Published June 13, 2024 | Version v1
Dataset Open

Dataset for: Multiple-type distress detection in asphalt concrete pavement using infrared thermography and deep learning

  • 1. ROR icon University of Illinois Urbana-Champaign
  • 2. ROR icon University of Georgia

Description

This is the dataset for the following paper: 

Fangyu Liu, Jian Liu, Linbing Wang, and Imad L. Al-Qadi. "Multiple-type distress detection in asphalt concrete pavement using infrared thermography and deep learning." Automation in Construction 161 (2024): 105355. https://doi.org/10.1016/j.autcon.2024.105355.

Data component:

  • 01-Visible images: this folder includes fully visible images
  • 02-Infrared images: this folder includes fully infrared images
  • 03-Fusion(25IRT) images: this folder includes fusion images (25% infrared + 75% visible)
  • 04-Fusion(50IRT) images: this folder includes fusion images (50% infrared + 50% visible)
  • 05-Fusion(75IRT) images: this folder includes fusion images (75% infrared + 25% visible)
  • 06-Annotations: this folder includes annotations (xml files) based on PASCAL VOC (PASCAL Visual Object Classes Challenge) styles.

Abstract

Artificial intelligence, particularly Convolutional Neural Network (CNN), has emerged as a highly effective methodology for detecting pavement distresses. This study aimed to apply infrared thermography (IRT) and deep learning to multiple-type distress detection. The dataset encompassed five image types (visible images, infrared images, and fusion images with varying infrared ratios) along with five distress types (longitudinal cracking, transverse cracking, fatigue cracking, edge cracking, and potholes). Four CNN object detection models underwent training and evaluation on the dataset, employing transfer learning. Evaluation metrics encompassed accuracy, complexity (model and computation), and memory usage. Eigen-CAM was employed to interpret the performance of CNN models across diverse image and distress types. The study delved into the impact of image types on multiple-type distress detection and also explored the potential of infrared thermography for pavement distress detection, including multiple-type distress detection, crack severity classification, and crack segmentation. Results indicated that fusion images (25IRT) achieved the highest accuracy across all four CNN models, closely followed by visible images and fusion images (50IRT). YOLOv5 demonstrated the highest accuracy for all image types except fusion images (50IRT). Fatigue cracking consistently exhibited the highest accuracy across all image types and CNN models, surpassing longitudinal cracking and edge cracking, which performed similarly and significantly outperformed transverse cracking and potholes. YOLOv5 provided clear visual explanations (Eigen-CAM) across all image types. In conclusion, fusion images could be an accurate, efficient, and reliable alternative solution for pavement distress detection.

Files

Multiple-type distress detection in asphalt concrete pavement using infrared thermography and deep learning.zip

Additional details

References

  • Fangyu Liu, Jian Liu, Linbing Wang, and Imad L. Al-Qadi. "Multiple-type distress detection in asphalt concrete pavement using infrared thermography and deep learning." Automation in Construction 161 (2024): 105355. https://doi.org/10.1016/j.autcon.2024.105355.