Conference paper Open Access

Deepfake Video Detection with Facial Features and Long-Short Term Memory Deep Networks

Dan-Cristian Stanciu; Bogdan Ionescu

Generative models have evolved immensely in the last few years. GAN-based video and image generation has become very accessible due to open source software available to anyone, and that may pose a threat to society. Deepfakes can be used to intimidate, blackmail certain public figures or to mislead the public. At the same time, with the rising popularity of deepfakes, detection algorithms have also evolved significantly. The majority of those algorithms focus on images rather than to explore the temporal evolution in the video. In this paper, we explore whether the temporal information of the video can be used to increase the performance of state-of-the-art deepfake detection algorithms. We also investigate whether certain facial regions contain more information about the authenticity of the video by using the entire aligned face as input for our model and by only selecting certain facial regions. We use late fusion to combine those results for increased performance. To validate our solution, we experiment on 2 state-of-the-art datasets, namely FaceForensics++ and CelebDF. The results show that using the temporal dimension can greatly enhance the performance of a deep learning model.

Files (357.7 kB)
Name Size
UPB-ISSCS2021n2.pdf
md5:ab801309373ef4302fb0055bab8ff29b
357.7 kB Download
18
12
views
downloads
All versions This version
Views 1818
Downloads 1212
Data volume 4.3 MB4.3 MB
Unique views 1717
Unique downloads 1212

Share

Cite as