Published August 3, 2025
| Version v1
Preprint
Open
Hybrid RAG-Enhanced Deepfake Detection: A Novel Approach Combining Retrieval-Augmented Generation with Visual Inconsistency Analysis
Description
This research proposes a novel hybrid framework for deepfake detection that integrates Retrieval-Augmented Generation (RAG) with visual inconsistency analysis. The system utilizes a dual verification strategy: contextual verification using ViT and FAISS for semantic similarity, and AI-generated artifact detection using YOLO and SAM. It introduces uncertainty quantification and operates entirely offline for privacy, making it suitable for journalism, law, forensics, and personal content verification. This paper aims to contribute a scalable, interpretable, and privacy-preserving system for combating manipulated media in the age of generative AI.
Files
deepfake_detection_rag_anomaly_karthik_kurra.pdf
Files
(4.4 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:65379f0b5644fbd34108e9754735bab0
|
4.4 MB | Preview Download |
Additional details
References
- Rössler et al., "FaceForensics++," ICCV, 2019.
- Lewis et al., "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks," NeurIPS, 2020.
- Kirillov et al., "Segment Anything," arXiv:2304.02643, 2023.
- Afchar et al., "MesoNet: A Compact Facial Video Forgery Detection Network," IEEE IWIFS, 2018.