Planned intervention: On Wednesday April 3rd 05:30 UTC Zenodo will be unavailable for up to 2-10 minutes to perform a storage cluster upgrade.
Published April 27, 2022 | Version v1
Conference paper Open

The MeVer DeepFake Detection Service: Lessons Learnt from Developing and Deploying in the Wild

Description

Enabled by recent improvements in generation methodologies, DeepFakes have become mainstream due to their increasingly better visual quality, the increase in easy-to-use generation tools and the rapid dissemination through social media. This fact poses a severe threat to our societies with the potential to erode social cohesion and influence our democracies. To mitigate the threat, numerous DeepFake detection schemes have been introduced in the literature but very few provide a web service that can be used in the wild. In this paper, we introduce the MeVer DeepFake detection service, a web service detecting deep learning manipulations in images and video. We present the design and implementation of the proposed processing pipeline that involves a model ensemble scheme, and we endow the service with a model card for transparency. Experimental results show that our service performs robustly on the three benchmark datasets while being vulnerable to Adversarial Attacks. Finally, we outline our experience and lessons learned when deploying a research system into production in the hopes that it will be useful to other academic and industry teams.

Notes

This work has been supported by the AI4Media H2020 project, partially funded by the European Commission under contract number 951911, and the US Paris Tech Challenge award, which was funded by the US Department of State Global Engagement Center under contract number SGECPD18CA0024.

Files

2204.12816.pdf

Files (1.9 MB)

Name Size Download all
md5:991b73beafb8c8d757d4b9f9ba0ccfed
1.9 MB Preview Download

Additional details

Related works

Is published in
Conference paper: 10.1145/3512732.3533587 (DOI)
Conference paper: arXiv:2204.12816 (arXiv)

Funding

AI4Media – A European Excellence Centre for Media, Society and Democracy 951911
European Commission