Published December 4, 2023 | Version v1
Conference paper Open

Advancing Audio Phylogeny: A Neural Network Approach for Transformation Detection

  • 1. ROR icon Fraunhofer Institute for Digital Media Technology

Description

In this study we propose a novel approach to audio phylogeny, i.e. the detection of relationships and transformations within a set of near-duplicate audio items, by leveraging a deep neural network for efficiency and extensibility. Unlike existing methods, our approach detects transformations between nodes in one step, and the transformation set can be expanded by retraining the neural network without excessive computational costs. We evaluated our method against the state of the art using a self-created and publicly released dataset, observing a superior performance in reconstructing phylogenetic trees and heightened transformation detection accuracy. Moreover, the ability to detect a wide range of transformations and to extend the transformation set make the approach suitable for various applications.

 

To appear in the upcoming proceedings of the 2023 IEEE International Workshop of Information Forensics and Security (WIFS).

Files

WIFS_2023___phylogeny_preprint.pdf

Files (711.7 kB)

Name Size Download all
md5:6f5177f4d5196f8b7c0fd6377e6a950b
711.7 kB Preview Download

Additional details

Funding

vera.ai – vera.ai: VERification Assisted by Artificial Intelligence 101070093
European Commission
AI4Media – A European Excellence Centre for Media, Society and Democracy 951911
European Commission