Journal article Closed Access

Optical Flow based CNN for detection of unlearnt deepfake manipulations

Roberto Caldelli; Leonardo Galteri; Irene Amerini; Alberto Del Bimbo

A new phenomenon named Deepfakes constitutes a serious threat in video manipulation. AI-based technologies have provided easy-to-use methods to create extremely realistic videos. On the side of multimedia forensics, being able to individuate this kind of fake contents becomes ever more crucial. In this work, a new forensic technique able to detect fake and original video sequences is proposed; it is based on the use of CNNs trained to distinguish possible motion dissimilarities in the temporal structure of a video sequence by exploiting optical flow fields. The results obtained highlight comparable performances with the state-of-the-art methods which, in general, only resort to single video frames. Furthermore, the proposed optical flow based detection scheme also provides a superior robustness in the more realistic cross-forgery operative scenario and can even be combined with frame-based approaches to improve their global effectiveness.

Closed Access

Files are not publicly accessible.

Views 17
Downloads 2
Data volume 91.6 kB
Unique views 14
Unique downloads 1


Cite as