Published September 30, 2024 | Version v1
Conference paper Open

Evolution of Detection Performance throughout the Online Lifespan of Synthetic Images

Description

Synthetic images disseminated online significantly differ from those used during the training and evaluation of the state-of-the-art detectors. In this work, we analyze the performance of synthetic image detectors as deceptive synthetic images evolve throughout their online lifespan. Our study reveals that, despite advancements in the field, current state-of-the-art detectors struggle to distinguish between synthetic and real images in the wild. Moreover, we show that the time elapsed since the initial online appearance of a synthetic image negatively affects the performance of most detectors. Ultimately, by employing a retrieval-assisted detection approach, we demonstrate the feasibility to maintain initial detection performance throughout the whole online lifespan of an image and enhance the average detection efficacy across several state-of-the-art detectors by 6.7% and 7.8% for balanced accuracy and AUC metrics, respectively.

We provide the FOSID dataset into the fosid.zip file.

Files

fosid.zip

Files (122.8 MB)

Name Size Download all
md5:9bb55587704f780dee8538cb9687313d
119.0 MB Preview Download
md5:70601b3c565dece1b647ce3f5a747f62
3.8 MB Preview Download

Additional details

Funding

European Commission
vera.ai - vera.ai: VERification Assisted by Artificial Intelligence 101070093