Published March 5, 2026 | Version v1

A Structure-Preserving Diffusion-Based Zero-Shot Learning Framework for Multimodal Magnetic Flux Leakage Signal Analysis

  • 1. Ma an shan University

Description

This repository contains the complete PyTorch implementation of the ZSSPDM framework proposed in the research paper "A Structure-Preserving Diffusion-Based Zero-Shot Learning Framework for Multimodal Magnetic Flux Leakage Signal Analysis".

Abstract

Addressing the core challenges of weak defect signatures and difficult unknown defect identification in magnetic flux leakage (MFL) inspection of large-bore pipelines, this study proposes an intelligent detection method that integrates a Zero-Shot Structure-Preserving Diffusion Model (ZSSPDM) and cross-modal attention fusion. A Structure-Preserving Diffusion Model (SPDM) is designed to explicitly preserve defect edges and geometric structures during denoising via triple constraints—gradient consistency loss, morphological similarity loss, and frequency-domain regularization—enhancing the signal-to-noise ratio (SNR) of original MFL signals from 12.3 dB to 24.1 dB for high-quality feature input. A gated multi-head cross-modal attention network is constructed, taking MFL signals as queries to dynamically integrate ultrasonic testing (UT) and infrared (IR) features, mitigating inter-modal redundancy and conflicts while achieving a macro F1-score of 0.93 on known defect classes, outperforming early and late fusion strategies. A zero-shot recognizer based on visual-semantic dual-stream embedding is developed, establishing a semantic attribute space (geometry, depth level, causal type, directionality) and leveraging contrastive learning to enable knowledge transfer between known and unknown classes. On a test set containing four unseen defect categories, the method achieves a Zero-Shot Learning (ZSL) Accuracy of 0.84 and an H-Mean of 0.88, surpassing mainstream models such as GLEE and TransMIL. Cross-material and cross-pipeline tests demonstrate an average ZSL Accuracy of 0.81, confirming strong generalization and engineering applicability. This work provides a high-precision, robust solution for intelligent pipeline inspection, with significant advantages in signal enhancement, multimodal fusion, and zero-shot generalization.

Files

README.md

Files (99.8 kB)

Name Size Download all
md5:f487f76679c3e139fe5b5882b172a7de
2.5 kB Download
md5:c3f4281b956779fedb356dafa66eeb32
3.7 kB Download
md5:d096c421e161fc940670c11ef6373c24
9.4 kB Download
md5:bb0f7e239bad8f79ddf7a0f117243958
19.0 kB Download
md5:727545085e9da196b9cf0efff6b856a4
8.3 kB Preview Download
md5:e77624d05e4662351a7a8b8652975b36
335 Bytes Preview Download
md5:eaa77c9573155d4fce4ed8604a1a9723
19.7 kB Download
md5:2cb0076a0e468f42ecb5342ec1bee877
10.3 kB Download
md5:1c72d0340e550cc35acae533bf85ff2b
6.6 kB Download
md5:509782ffb215f44eab2b82d4eb3582b2
20.0 kB Download

Additional details

Dates

Submitted
2026