Published August 3, 2025 | Version v1
Preprint Open

Hybrid RAG-Enhanced Deepfake Detection: A Novel Approach Combining Retrieval-Augmented Generation with Visual Inconsistency Analysis

  • 1. AI/ML Researcher

Description

This research proposes a novel hybrid framework for deepfake detection that integrates Retrieval-Augmented Generation (RAG) with visual inconsistency analysis. The system utilizes a dual verification strategy: contextual verification using ViT and FAISS for semantic similarity, and AI-generated artifact detection using YOLO and SAM. It introduces uncertainty quantification and operates entirely offline for privacy, making it suitable for journalism, law, forensics, and personal content verification. This paper aims to contribute a scalable, interpretable, and privacy-preserving system for combating manipulated media in the age of generative AI.

Files

deepfake_detection_rag_anomaly_karthik_kurra.pdf

Files (4.4 MB)

Additional details

References

  • Rössler et al., "FaceForensics++," ICCV, 2019.
  • Lewis et al., "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks," NeurIPS, 2020.
  • Kirillov et al., "Segment Anything," arXiv:2304.02643, 2023.
  • Afchar et al., "MesoNet: A Compact Facial Video Forgery Detection Network," IEEE IWIFS, 2018.