Skip to content

Explore everything

Filter by research area, year and venue. Every filter is in the address bar, so you can share a view as a link.

Deepfakes & multimodalDetection methods Deep Learning for Deepfakes Creation and Detection: A SurveyComprehensive survey of deep learning methods for creating and detecting deepfakes, covering face-swapping and lip-syncing generation techniques (GANs, autoencoders, encoder-decoder pairs), detection approaches (visual artifacts, temporal features, forensics), and challenges in cross-dataset generalization. The paper discusses… Nguyen et al. · arXiv · 2019

Deepfakes & multimodalDetection methods The Emergence of Deepfake Technology: A ReviewThis review analyzes 84 news articles about deepfakes to synthesize understanding of synthetic video technology, its applications, threats, and countermeasures. Deepfakes—hyper-realistic videos created using AI (primarily GANs)—lower the barrier to video forgery and represent a significant threat to trust, elections, and security. Westerlund · Technology Innovation Management Review · 2019

Deepfakes & multimodalPlatforms, policy & society How deepfakes undermine truth and threaten democracyDeepfakes use machine-learning technology to create fabricated audio and video of people doing or saying things they never did. Law professor Danielle Citron explores the dual threats: individual harm (non-consensual sexual deepfakes targeting women, especially minorities and journalists) and societal damage (eroding trust in… Citron · 2019

Deepfakes & multimodalDetection methods FakeCatcher: Detection of Synthetic Portrait Videos using Biological SignalsFakeCatcher detects deepfakes by analyzing biological signals (photoplethysmography—blood flow patterns) extracted from facial regions. The key insight is that generative models fail to preserve spatial coherence and temporal consistency of these signals in authentic videos, making biological signal analysis a powerful forensic tool… Cifci et al. · IEEE Transactions on Pattern Analysis and… · 2019

Datasets & evaluationDeepfakes & multimodal r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News DetectionFakeddit is a large-scale multimodal fake news detection dataset with over 1 million Reddit samples labeled with 2-way, 3-way, and 6-way classification schemes. Multimodal models combining text (BERT) and image (ResNet50) features achieve 86.0% accuracy on 6-way classification, demonstrating the importance of jointly leveraging text and… Nakamura et al. · arXiv · 2019

Deepfakes & multimodalDetection methods FaceForensics++: Learning to Detect Manipulated Facial ImagesFaceForensics++ introduces a large-scale benchmark (1.8+ million manipulated images from 1,000+ videos) for detecting facial manipulations created with four state-of-the-art methods: Face2Face, FaceSwap, DeepFakes, and NeuralTextures. The paper comprehensively evaluates detection methods from stegananalysis to deep learning,… Rössler et al. · arXiv · 2019

Deepfakes & multimodalDetection methods Recurrent Convolutional Strategies for Face Manipulation Detection in VideosThis paper proposes using recurrent convolutional networks to detect face manipulations (Deepfake, Face2Face, FaceSwap) in videos by exploiting temporal discrepancies across frames. Face preprocessing with alignment and bidirectional recurrent networks achieve state-of-the-art on FaceForensics++ with up to 4.55% improvement over prior… Sabir et al. · arXiv · 2019

Bots & coordinated campaignsDeepfakes & multimodal Characterizing the Use of Images in State-Sponsored Information Warfare Operations by Russian Trolls on TwitterLarge-scale analysis of 1.8M images posted by ~3.6K Russian state-sponsored Twitter accounts (IRA-controlled). Russian trolls strategically deployed images and memes to maximize political influence, with political imagery 2+ times more effective than general content. Zannettou et al. · AAAI Conference on Web and Social Media · 2019

LLMs & generative AIDetection methods Defending Against Neural Fake NewsZellers et al. introduce GROVER, a conditional neural text generation model that can both generate and detect neural fake news. The paper shows that humans cannot reliably distinguish GROVER-generated propaganda from real human-written disinformation, rating machine-generated propaganda as more trustworthy (2.42/3 vs 2.19/3 for human… Zellers et al. · NeurIPS · 2019

Deepfakes & multimodalDetection methods MVAE: Multimodal Variational Autoencoder for Fake News DetectionThe paper proposes MVAE, a variational autoencoder that learns shared representations of text and images in social media posts to detect fake news. The model jointly trains an encoder-decoder (to discover correlations across modalities) with a binary classifier. Khattar et al. · World Wide Web Conference · 2019

Spread & networksDeepfakes & multimodal Don't Blame Bots, Fake News Is Spread by HumansA comprehensive talk covering the scale of misinformation campaigns on social media (ranging from Syrian hackers compromising the AP's Twitter account to Russian interference in the 2016 US election), empirical findings on how false news spreads faster than truth, and emerging threats from synthetic media (deepfakes) created via… Aral · 2018

Deepfakes & multimodalDetection methods A Deep Learning Approach for Multimodal Deception DetectionThis paper proposes a multimodal neural model for detecting deception in real-life courtroom trial videos by combining visual features from 3D-CNN, audio features from openSMILE, textual features from CNN on transcripts, and manual micro-expression annotations. The model achieves 96.14% accuracy and ROC-AUC of 0.9799, substantially… Krishnamurthy et al. · arXiv · 2018

Platforms, policy & societyDeepfakes & multimodal The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and MitigationA landmark 2018 report surveying the landscape of potential security threats from malicious uses of AI across three domains—digital, physical, and political security. The work proposes frameworks for forecasting AI-enabled attacks, identifies specific threat scenarios including AI-generated disinformation and deepfakes, and recommends… Brundage et al. · arXiv · 2018

Deepfakes & multimodalDatasets & evaluation MesoNet: A Compact Facial Video Forgery Detection NetworkThis paper proposes two lightweight CNN architectures (Meso-4 and MesoInception-4) to detect facial video forgeries created by Deepfake and Face2Face techniques. Operating at the mesoscopic level of image analysis, the networks achieve 98% detection accuracy for Deepfake and 95% for Face2Face videos under realistic compression conditions. Afchar et al. · arXiv · 2018

Deepfakes & multimodalDetection methods DeepFakes: a New Threat to Face Recognition? Assessment and DetectionGAN-based face-swapping (Deepfakes) pose a significant threat to face recognition systems: VGG and FaceNet achieve false acceptance rates of 85.62% and 95.00% on high-quality Deepfakes. The authors release the first public Deepfake video database (620 videos from 16 subject pairs) and show that image quality metrics with SVM achieve… Korshunov & Marcel · arXiv · 2018

Deepfakes & multimodalDetection methods In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye BlinkingDetects DeepFake videos by exploiting the absence of natural eye blinking patterns in AI-generated faces. Uses a Long-term Recurrent Convolutional Network (LRCN) combining CNN for feature extraction with LSTM-RNN for temporal modeling of eye state, achieving 0.99 AUC on authentic vs. synthesized videos—a forensic signal invisible to the… Li et al. · arXiv · 2018

Deepfakes & multimodalDetection methods Detecting GAN-generated Imagery using Color CuesThis paper identifies two forensic cues to distinguish GAN-generated images from real camera imagery by analyzing how generator networks process color. The first cue exploits overlapping color channel weights in the generator (unlike camera spectral sensitivities); the second leverages the fact that generator normalization suppresses… McCloskey & Albright · arXiv · 2018

Deepfakes & multimodalDetection methods Exposing Deep Fakes Using Inconsistent Head PosesDeepfakes splice a synthesized face into an original image, introducing landmark misalignment errors invisible to the eye but detectable through 3D head pose estimation. The method compares head poses estimated from all facial landmarks versus only the central region; real faces show consistent poses while deepfakes exhibit large… Yang et al. · arXiv · 2018

Detection methodsDeepfakes & multimodal TI-CNN: Convolutional Neural Networks for Fake News DetectionThis paper proposes TI-CNN, a multimodal deep learning model that combines explicit and latent features from both text and images to detect fake news. Through analysis of 20,015 news items, the authors identify distinctive linguistic and visual patterns in fake versus real news, and demonstrate that their unified CNN-based approach… Yang et al. · arXiv · 2018

Deepfakes & multimodalDetection methods Two-Stream Neural Networks for Tampered Face DetectionThe paper proposes a two-stream neural network for detecting face tampering (face swaps) in images. One stream uses GoogLeNet to classify tampered faces by visual artifacts, while the second stream uses steganalysis features with a triplet network to capture low-level noise inconsistencies. Zhou et al. · arXiv · 2018

Deepfakes & multimodalDetection methods EANN: Event Adversarial Neural Networks for Multi-Modal Fake News DetectionThe paper proposes EANN, an adversarial neural network that detects fake news on newly emerged events by learning event-invariant features. An event discriminator forces the multi-modal feature extractor to remove event-specific features while preserving shared patterns across events. Wang et al. · KDD '18: The 24th ACM SIGKDD International… · 2018