Skip to content

Home

GUIDE

A curated reference for researchers working on fake news, misinformation, and disinformation — covering detection methods, propagation dynamics, and the underlying psychology and social science.

Maintained by the Syracuse University DataLab. Every claim on every page traces back to a primary source.

Survey

Entry points for the field: - Thibault et al. (2025) — A Guide to Misinformation Detection Data and Evaluation in KDD '25 — Comprehensive survey of 75 misinformation detection datasets with systematic quality assessment framework evaluating spurious keyword correlations, temporal correlations, and feasibility of veracity assessment. Introduces CDL-MD unified collection and Evaluation Quality Assurance (EQA) framework proposing that evaluation methodology itself must be rigorously validated alongside algorithm design. Key finding: many widely-used datasets contain spurious correlations allowing artificially inflated performance without robust content understanding; over 50% of claims lack sufficient evidence for credible veracity evaluation. Essential reading for anyone designing detection research. - Loth, Kappes & Pahl (2026) — Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems — Updated perspective on generative AI and misinformation research (2024–2026); introduces methodological tools JudgeGPT (human perception evaluation) and RogueGPT (controlled stimulus generation) for measuring deceptive potential and susceptibility under controlled conditions. Documents agentic shift toward autonomous multi-agent campaigns, multimodal misinformation combining text-image-audio-video, and systemic risks to digital ecosystems (epistemic fragmentation, synthetic consensus manufacturing). Synthesizes mitigation strategies including detection, inoculation/prebunking, provenance infrastructure (C2PA), and platform design interventions. - Modzelewski et al. (2026) — MALicious INTent Dataset and Inoculating LLMs for Enhanced Disinformation Detection — Introduces MALINT, the first English-annotated corpus with 1,600 articles labeled for both credibility and five types of malicious intent (undermining institutions, changing political views, undermining international organizations, promoting social stereotypes, promoting anti-scientific views). Evaluates 12 language models on intent classification; proposes Intent-Based Inoculation (IBI), an intent-augmented reasoning method that improves zero-shot LLM disinformation detection by ~9% on MALINT and ~20% on five diverse datasets across six languages (German, French, Polish, Estonian, Russian, Spanish). - Ai et al. (2026) — The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection — Systematic survey documenting the role of LVLMs in multimodal fake news detection; proposes three-branch taxonomy (parameter-frozen, parameter-tuning, reasoning paradigms) reflecting resource trade-offs; introduces five-dimensional framework for multimodal deception (media authenticity, consistency, source credibility, intent, temporal context); benchmarks 15+ LVLM architectures across eight datasets; identifies eight critical research directions including causal reasoning, adversarial robustness, and knowledge-enhanced adaptation. - Raza et al. (2025) — VLDBench: Evaluating Multimodal Disinformation with Regulatory Alignment — Large-scale human-verified benchmark for multimodal disinformation detection: 31,339 news articles paired with images, curated from 58 outlets across 13 categories. Comprehensive evaluation of 9 LLMs and 10 VLMs reveals vision-language models substantially outperform text-only baselines (e.g., LLaMA-3.2-11B-Vision: 74.82% vs. LLaMA-3.2-1B: 70.29%), yet show critical vulnerability to cross-modal attacks combining text and image manipulation. Explicitly aligned with AI governance frameworks (MIT Risk Repository) to operationalize policy-relevant risk dimensions for responsible deployment. - Cao et al. (2023) — A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT in J. ACM — foundational survey of generative AI covering history (GANs to transformers), technical foundations, unimodal and multimodal models, applications across domains, and critical trustworthiness concerns (factuality, security, privacy, fairness); essential context for understanding AI-enabled misinformation generation and detection. - Chang et al. (2023) — A Survey on Evaluation of Large Language Models in J. ACM — comprehensive survey on evaluation methodologies for LLMs across three dimensions (what, where, how to evaluate); encompasses 269 papers on natural language understanding, generation, reasoning, robustness, ethics, bias, factuality, trustworthiness, and domain-specific applications; essential for understanding how to assess LLMs used in misinformation detection and generation. - Liu et al. (2023) — Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models' Alignment — comprehensive survey on LLM trustworthiness across seven dimensions (reliability, safety, fairness, resistance to misuse, explainability, social norms, robustness) with 29 sub-categories; presents taxonomy, measurement studies on multiple LLMs, and case studies demonstrating effectiveness of alignment varies significantly across trustworthiness categories. - Hamborg, Donnay & Gipp (2018) — Automated identification of media bias in news articles: an interdisciplinary literature review in International Journal on Digital Libraries — bridges social science and computer science research on media bias detection; defines nine bias forms (event/source selection, labeling, placement, spin); maps manual analysis methods to computational approaches - Zhou, Xu, Trajcevski & Zhang (2021) — A Survey of Information Cascade Analysis: Models, Predictions, and Recent Advances in ACM Computing Surveys — comprehensive survey of cascade prediction covering 250+ papers; taxonomy of feature-based, generative, and deep learning approaches - Zhou & Zafarani (2020) — A Survey of Fake News in ACM Computing Surveys — concise, authoritative survey of detection methods and opportunities - Shu et al. (2020) — Mining Disinformation and Fake News: Concepts, Methods, and Recent Advancements — comprehensive book chapter covering user engagement, weak supervision approaches, and trending issues

Recently added (2026)

  • Huang et al. — VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation — Multi-dimensional benchmark evaluating how difficult it is to verify LLM-generated false content; finds that high elicitation success doesn't predict low verification complexity, and generated misinformation can be 3×–169× more expensive to verify than human-written content—a critical asymmetry for fact-checking systems.
  • Tsagkarakis, Papadogiannakis & Markatos — Birds of a Feather Flock Together: Network-Based Detection of Coordinated Disinformation Campaigns on Telegram — Graph-based methodology for discovering coordinated disinformation campaigns on Telegram's broadcast channels using only message-sharing patterns, without content analysis. Identified 55 disinformation channels from 18 seed channels; discovered over 86,000 identical message chains replicated across multiple channels, with synchronized posting patterns aligned to major political events. Demonstrates echo-chamber coordination where core channels amplify propaganda while leveraging YouTube and fake-news websites for cross-platform reach.
  • Sánchez-Cortés, Monti & De Francisci Morales — Conspiracy and Environment Communities on Reddit Sort Along Different Demographic Axes — Stratified network analysis of how demographic groups (gender, age, affluence, partisanship) enter conspiracy and environmental communities on Reddit through distinct information pathways. Conspiracy communities exhibit upstream sorting: users self-segregate before entry through ideologically-aligned media (masculine users via right-wing outlets; feminine users via esoteric/spiritual content). Environmental communities exhibit downstream sorting: diverse groups converge on the issue but diverge internally by age/affluence on engagement strategy. Reveals that demographic polarization operates through different mechanisms depending on whether communities are identity-expressive or issue-oriented.
  • AI-Enabled Human Memory Manipulation: Misleading AI-Generated Summaries Distort — Large language models frequently generate erroneous summaries (100% of summaries contained omissions), and misleading AI summaries distort human memory via the classic misinformation effect: only 48.8% of participants correctly recalled a traffic sign after reading a misleading AI summary vs. 83.6% with accurate information. Critically, susceptibility was equivalent regardless of whether participants believed the summary was AI- or human-written.
  • Two Fault Lines: Latent Polarity Geometry in X Community Notes — Analysis of X's Community Notes crowdsourced fact-checking system reveals disagreement is two-dimensional, not one. The platform's one-dimensional bridging algorithm fails on topics with topic-specific disagreement (COVID/vaccines, Ukraine/Russia, institutional trust), causing publication rates to fall from 71.5% to 11.7%. Also documents language-equity gaps: Greek-script notes accumulate fewer ratings and have lower publication rates than global averages.
  • Setting the clock: Evaluating temporal window parameters for coordinated behavior — Systematic evaluation of temporal window parameters for coordinated behavior detection in co-repost networks. Finds that window length is a central modeling parameter: short windows (seconds–minutes) isolate highly synchronized coordination; longer windows (hours–days) reveal slower, diffuse coordination. Window stride has negligible effect. Evaluation on 14 labeled information operation datasets demonstrates temporal windowing is a substantive methodological choice, not an implementation detail.
  • Drowning in AI Slop: How Social Media Platforms (Do Not) Label AI and Deepfake Content under EU law — Empirical audit of platform compliance with EU Digital Services Act requirements for labeling AI-generated and deepfake content. Tested 10 generative AI tools across Instagram, TikTok, X, and YouTube; found platforms label only 36 of 59 uploads (61%), with highly variable rates: Instagram 82%, TikTok 59%, X 41%, YouTube 63%. Systematic gaps in high-risk content (elections, civic discourse, security).
  • Kekatos et al. (2026) — SoK: Formal Methods for Fact-Checking and Information Integrity — Systemization of knowledge surveying 121 works on formal verification techniques (logic, SMT, model checking, theorem proving) applied to fact-checking. Proposes five-level assurance stack (claim, reasoning, system, ecosystem, governance) organizing where formal methods apply. Identifies two critical gaps: translating natural-language claims into machine-checkable form (S4, Construct) and formally updating verdicts when errors are discovered (S8, Correct). Discusses why end-to-end pipeline verification remains unsolved and why fact-checking systems rarely discharge formal warranties of correctness.
  • VietPrism: A Large-Scale Vietnamese Speech and Deepfake Corpus with Diverse — Large-scale Vietnamese speech dataset combining 993.4 hours of bona fide speech from 1,262 speakers with 3.1K hours of synthetically generated audio from four systems. Uniquely provides transcripts, consistent speaker identities, five dialect groups, and naturally occurring Vietnamese–English code-switching (~47% of corpus). Zero-shot evaluation of five multilingual deepfake detectors reveals striking brittleness: DFA-1B EER increases from 16.3% to 33.6% as speaker similarity increases; detector performance varies dramatically across generator–detector pairings and exhibits model-dependent disparities across dialects. Establishes benchmark for trustworthy audio-deepfake detection in multilingual, low-resource settings.
  • To Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speech — Introduces VeriSpeak, a benchmark of 3,879 spoken claims spanning temporal, geographical, and relational facts. Reveals Large Audio Language Models exhibit a consistent text-speech modality gap (13–25 point accuracy drops) despite strong text-only performance. Demonstrates that transcript-based retrieval-augmented verification with chain-of-thought reasoning reaches 86.1% accuracy, highlighting that speech fact-checking requires both speech understanding and grounded reasoning over evidence.
  • Strategic Opinion Manipulation in Multiplex Networks — Game-theoretic model of strategic misreporting on multiplex networks; agents hold private opinions but choose reports strategically per layer, and platforms merge layers into consensus with attention weights. Shows equilibrium consensus reweighted by "tilted centrality" combining network centrality and manipulability. Key finding: whether merging layers helps depends on the square in the manipulability index—merging dilutes manipulation by default but can amplify distortion through re-centralization when agents concentrate extreme opinions on specific layers. Provides closed-form solutions and characterizes platform's optimal attention weights.
  • Why Does Misinformation Propagate Faster? An Algorithmic Perspective on X — Identifies the "engagement fungibility mechanism" in X's score-aggregation layer enabling faster misinformation propagation: fast-engagement signals (likes, retweets) and slow-engagement signals (replies, quotes) treated as interchangeable evidence of quality, allowing low-credibility content to gain amplification advantages. Proposes reflective-threshold gate achieving 8–37% credibility-gap reduction without sacrificing overall engagement; validated across 46 robustness checks.
  • Making AI-Assisted Claims Independently Challengeable: Publication Authority and a Protocol for Falsifiable Publication Records — Publication Authority protocol ensuring AI-assisted claims are independently verifiable and challengeable; introduces PAC-2026 SF-4 specification formalizing six coordinates (evidence, authorization, measurement, lifecycle, surface correspondence) and five design laws (accountability closure, authorization freshness, epistemic non-amplification, semantic surface preservation, continuing challengeability); evaluates against 110,764 reachable states and 76 unsafe configurations using design science methodology
  • Control-Theoretic Content Moderation — Control-theoretic framework for platform-level content moderation; formulates moderation as feedback control with multi-objective loss (harmfulness, activity, engagement); compares fixed-rule, proportional, and control-theoretic strategies (MPC, PID); shows adaptive approaches achieve better balance and faster recovery from shocks
  • How neighbourhood ideology shapes misinformation belief in densely tied social networks — Agent-based contagion model integrating individuals' ideological intensity with claims' ideological alignment, showing that network clustering amplifies the influence of neighbours' ideology on misinformation belief beyond individual predisposition. Simulations across multiple topologies (Erdős-Rényi, Watts-Strogatz, Barabási-Albert, Facebook) and extremist placement strategies reveal that in densely clustered networks, local peer pressure can match personal ideological bias in driving belief adoption; even small populations of ideological extremists significantly increase misinformation adoption among moderates in such networks.
  • A Multi-Stage Agentic Framework for Effective Counter-Narrative Generation and Refinement — Multi-stage agent-based framework for generating and refining counter-narratives to pro-Russian propaganda about Ukraine. Multi-agent system (Generator, Evaluator, Mediator) uses iterative feedback loops and LLM-as-judge scoring to optimize narratives for persuasiveness, emotional engagement, and shareability. Human validation confirms quality improvements; simulated experiments show refined CNs significantly reduce perceived persuasiveness of target propaganda while maintaining safety parity with expert-curated baselines.
  • MMMMM: A Unified Taxonomy for Investigating the Mechanisms of Multilingual MultiModal Misinformation — Unified taxonomy of multimodal misinformation mechanisms across six orthogonal axes (Classification, Image Type, Rhetorical Role, Topic, Emotion, Multimodal Mechanism), grounded in 26,979 real-world Twitter/X instances across seven languages. Operationalizes taxonomy via Vision Language Model annotation pipeline (Qwen 3.5 27B) achieving 79.3% accuracy. Reveals cross-linguistic patterns: Portuguese-language misinformation overuses Decorative mechanisms; Japanese predominantly employs Slanted mechanisms (scientific errors and conspiracies); AI-generated images prevalent in technology/science; vaccination misinformation relies on text-based claims.
  • Social bots weaken activist cohesion — Longitudinal network analysis of Black Lives Matter protests (June 2020) showing bot infiltration erodes human cohesion in activist networks through structural disruption; effects concentrated among movement supporters at both ego-network and community levels; demonstrates threats to digital civic life operate through relational infrastructure, not just messaging.
  • One AI Signal, Many Human Judgments: A Bayesian Cascade Analysis of AI-based Credibility Indicators in Online Information Spread — Extends Bayesian cascade models to analyze how platform-deployed AI credibility indicators reshape sequential user judgments and public consensus; introduces the Gateway condition demarcating when AI predictions dominate cascade direction; empirical calibration with human-subject experiments reveals heterogeneous user weights on AI signals; simulations show over-reliance on weak AI is harmful while diversification and expert review can improve outcomes.
  • A Multi-Branch Feature Fusion Approach for Health Misinformation Detection and Propagation — Multi-branch neural architecture grounded in Elaboration Likelihood Model and Theory of Planned Behaviour for detecting health misinformation and predicting propagation; achieves ROC-AUC of 0.9999 on COVID-19-FNIR and introduces Cognitive Propagation Score, an engagement-independent interpretable metric for prioritizing content when engagement data is unavailable.
  • CoVer: Conflict-Aware Claim Verification — Handles evidence-level and aggregation-level conflicts in social media fact-checking via three-stage pipeline (evidence normalization, factual consensus, support verification); ContraNote dataset from X Community Notes; 86–88.5% accuracy outperforming SOTA baselines
  • Calibrating Small Language Models for Claim Check-Worthiness Detection — Post-hoc calibration (NN-PPI) for small language models on claim check-worthiness detection; applies nearest-neighbor residual correction to recover large LM accuracy from small models (270M–4B parameters); achieves 12–33.80% weighted F1 gains, enabling cost-effective fact-checking at scale
  • Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics — Hybrid EfficientNet-B0 with Swin-Transformer for efficient GAN-based synthetic face detection; achieves 99% accuracy and 99.44% recall with practical computational constraints suitable for standard hardware deployment.
  • Counter-GEO-Bench: Evaluating Defenses Against Information-Distorting Generative Engine Optimization — Defense benchmark for information-distorting generative engine optimization attacks on LLMs; proposes C-GEO Guard contrastive detector
  • Lazy Grounding: Attacking Search Agents with Factual Evidence — Demonstrates "lazy grounding" attacks on retrieval-augmented search agents: injecting factually correct evidence supporting a neighboring question causes agents to misapply this evidence to answer the original question, achieving accuracy drops of 5.9 points on average (up to 17.3 points) without using false or malicious content.
  • Unifying Models of Intergroup Hostility in Online Discourse — Unifies six mechanisms of group-directed hostile rhetoric (boundary construction, threat construction, scapegoating, negative evaluation, dehumanization, action orientation) across competing theories; empirical analysis of 2.86M posts from 2024 U.S. election shows threat-mediated and moral-exclusion pathways are complementary, with regular temporal organization from boundary construction through action orientation appearing last.

Sources by type

See all papers, all articles, all topics, all authors, all datasets, all videos (populated by ingest workflow)

New topics

  • Human Memory — The cognitive systems by which humans encode, store, and retrieve information; central to understanding how misinformation exploits memory's reconstructive vulnerabilities.
  • Misinformation Effect — Classic cognitive psychology phenomenon where exposure to misleading post-event information alters memory for the original event; demonstrated in AI-generated misinformation contexts.
  • Algorithmic bias in content systems — Systematic disparities in how algorithms recommend, moderate, rank, or amplify content, including language bias, participation bias, topic bias, and demographic bias in misinformation systems.
  • Audio Deepfakes — Detection and analysis of AI-generated or manipulated speech audio, including voice cloning and speech synthesis detection; critical for multilingual and low-resource language scenarios.
  • Crowdsourced Fact-Checking — Systems like X's Community Notes that delegate identification and correction of misinformation to crowds of platform users, facing challenges in quality control, disagreement management, and language equity.
  • Speech-Based Fact Verification — Automated verification of claims made in spoken language, combining speech understanding with grounded reasoning over evidence sources.
  • Formal Methods for Fact-Checking — Application of formal verification techniques (logic, SMT, model checking, theorem proving) to fact-checking, addressing the gap between natural language claims and machine-checkable logical forms.
  • Claim Detection — Methods for identifying and extracting claims from text that are subject to fact-checking verification.
  • Fact-Checking Systems — End-to-end systems combining claim detection, evidence retrieval, and verdict generation for automated fact verification.
  • Explanation in Fact-Checking — Generation of human-interpretable explanations and justifications for fact-checking verdicts, essential for transparency and user trust.
  • Recommendation Systems — Algorithmic systems for recommending or ranking content to users; related to misinformation amplification and platform-driven information exposure.
  • Engagement-Based Ranking — Ranking algorithms that prioritize content by user engagement metrics, creating incentives that can amplify both true and false information.
  • Misinformation Campaigns — Coordinated efforts to spread false information at scale, typically involving multiple actors, platforms, and distribution strategies.
  • Telegram — Messaging platform and its role in misinformation spread, coordinated disinformation campaigns, and information ecosystems.

New authors

Massimo Franceschetti, Pan Li, Shuang Gao, Georgios Panayiotou, Debajyoti Mazumder, Mamta, Lorenzo Mannocci, Abhirama Penamakuri, Minh Hoang, Thai Le, Nikolaos Kekatos, Andreas Andreou, Theodoros Nestoridis, Mattea Sim, Charalampos Bratsas, Yael Eiger, Charalampos Dimoulas, Tadayoshi Kohno, Georgios Konstantinidis, Georgios Malogiannis, Andreas Veglis, Raman Ebrahimi, Emmanouil Papadogiannakis, Panteleimon Tsagkarakis, Evangelos Markatos, Hansun Huang, Yutao Wu, Qizhou Wang, Xiang Zheng, Silvia Montaña-Niño, Yige Li, Elif Buse Doyuran, Phoebe Mutch, Xiao Liu, Xingjun Ma, Sarah Erfani, Miguel A. Sánchez-Cortés, Corrado Monti

Foundations

Network and graph algorithms

  • A Decision-Based Heterogeneous Graph Attention Network for Multi-Class Fake (2025) — DHGAT: Decision-based Heterogeneous Graph Attention Network enabling per-node per-layer dynamic selection of optimal neighborhood types for multi-class fake news detection. Models news as heterogeneous graphs with nine edge types derived from speaker metadata (speaker, context, subject, party, job-title, state, KNN-5/6/7); decision network selects best neighborhood type via Gumbel-Softmax; representation network updates embeddings. Evaluated on LIAR (12,836 items, six classes); achieves ~4% accuracy improvement over baselines in label-scarce regimes (10%–30% labeled); custom semantic distance loss exploits ordinal label structure (pants-fire < false < barely-true < half-true < mostly-true < true).
  • Neighborhood-Order Learning Graph Attention Network for Fake News Detection (2025) — NOL-GAT: Addresses a fundamental limitation of standard GNNs (fixed L-hop neighborhoods) by allowing each node to adaptively learn its optimal neighborhood order at every layer via Gumbel-Softmax. Architecture comprises a Hop Network (order selection) and Embedding Network (representation updates). Tested on five fake news datasets (Fake.Br, Fact-checked News, FakeNewsNet, FakeNewsDetection, FakeNewsData) achieving significant improvements in low-label regimes (10%–30% labeled data); outperforms baselines (CO-GNN, L2Q, TGNcl, TextGCN, LSTM-CP-GCN, GATv2) by 5–15% macro-F1.
  • Bridging Thoughts and Words: Graph-Based Intent-Semantic Joint Learning for (2025) — InSIDE: Graph-based intent-semantic joint learning for fake news detection. Models news as two heterogeneous graphs capturing semantic signals (sentence-entity network with local narrative flow and global entity-mediated context) and intent signals (coarse-to-fine hierarchy of purposes/motivations). Dynamic pathway-based alignment via pseudo nodes bridges semantic and intent representations. Achieves consistent improvements across four datasets (up to 9.12% F1 on GossipCop) outperforming intent-agnostic and intent-aware baselines; demonstrates framework adaptability across intent conceptualizations.
  • Mao et al. (2024) — Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniques — comprehensive survey of integrating LLMs with graph representation learning; proposes novel taxonomy decomposing models into primary components (knowledge extractors for attributes, structures, and labels; knowledge organizers as GNN-centric, LLM-centric, or hybrid) and operation techniques (integration strategies at input, hidden, and alignment-based levels; training strategies via pre-training, prompting, and instruction tuning); essential framework for understanding emerging graph foundation models that combine graph structure with semantic information.
  • Vatter, Mayer & Jacobsen (2023) — The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey — comprehensive survey of distributed systems for scalable GNN training, bridging graph processing systems (Pregel, PowerGraph, GraphLab) and DNN training frameworks; systematically categorizes partitioning strategies, sampling techniques, inter-process communication, synchronization modes, and programming abstractions across 20+ systems (DGL, GraphSAINT, DistDGL, etc.); essential for understanding how to scale GNN-based misinformation detection to large social networks.
  • Dai et al. (2023) — A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainability in ACM Computing Surveys — comprehensive survey of trustworthy GNN research covering privacy attacks (membership inference, property inference, reconstruction) and defenses (differential privacy, federated learning, machine unlearning), adversarial robustness methods, fairness approaches to prevent discrimination, and explainability techniques; essential for understanding GNN-based approaches to misinformation detection and their real-world deployment challenges.
  • Fortunato, S. (2009) — Community detection in graphs — comprehensive 103-page survey covering algorithm taxonomy (hierarchical clustering, spectral methods, modularity optimization), theoretical foundations (NP-hardness, quality functions), benchmarking on standard networks, and applications across biological, social, and technological networks; provides foundational theory and methods for network-based approaches to misinformation detection and information diffusion analysis.
  • Cai & Zafarani (2026) — Spectral Analysis of Fake News Propagation — develops spectral view of propagation structure by deriving 35 spectral bounds organized into five categories capturing branching capacity, cascade scale, structural cohesion, propagation span, and diffusion dynamics; shows spectral representations distinguish fake from real news (59.4% accuracy on Weibo22, 33.55% on Twitter16) while providing interpretability through explicit structural-property correspondence; demonstrates fake news exhibits deeper, more unbalanced cascade structures through discrete structural optimization algorithms.

  • Community detection in graphs — 2009 · arXiv

  • The structure and function of complex networks — 2003 · Reviews of Modern Physics
  • The structure and function of complex networks — 2003 · Reviews of Modern Physics

Rumour verification and stance

Stance detection

Shared tasks and benchmarks

  • The Clickbait Challenge 2017: Towards a Regression Model for Clickbait Strength — Clickbait Challenge 2017 shared task with 38,517 graded-scale annotated tweets; 13 submitted systems achieving significant performance gains over prior baselines; reformulates clickbait detection as regression to measure strength rather than binary classification; introduces Webis Clickbait Corpus 2017
  • A Benchmark Study of Machine Learning Models for Online Fake News Detection — Comprehensive empirical benchmark comparing 19 machine learning models (8 traditional, 6 deep learning, 5 pre-trained transformers) on three fake news datasets spanning politics, health, and diverse topics; finding: BERT-based pre-trained models (RoBERTa 96% accuracy on large datasets, >90% with 500 samples) substantially outperform traditional ML and deep learning approaches; practical guidance for practitioners across resource constraints.
  • RumourEval 2019: Determining Rumour Veracity and Support for Rumours — extended shared task with Twitter and Reddit data; two subtasks: (A) SDQC stance classification on 8,574 conversation posts, (B) veracity prediction on 446 rumours; 22 system submissions (70% increase from 2017); best systems employ pre-trained contextual embeddings (BERT, GPT); demonstrates that conversation structure and ensemble approaches advance rumour verification beyond single-task specialization.
  • SemEval-2017 Task 8: RumourEval — benchmark shared task establishing foundation for rumour verification research; defines two subtasks: (a) SDQC stance classification (Support/Deny/Query/Comment) of replies to rumourous claims, and (b) veracity prediction (true/false) of source tweets; provides datasets from 10 events with 297 training threads, 28 test threads, and 1,080 tweets; 13 systems from 4 continents participated; results show stance classification achievable (78% best), but veracity prediction remains hard (below baselines).
  • Kochkina, Liakata & Augenstein (2017) — Turing at SemEval-2017 Task 8: Sequential Approach to Rumour Stance Classification with Branch-LSTM — best-performing system in RumourEval 2017 Subtask A; proposes Branch-LSTM architecture that decomposes conversation trees into linear branches and models them sequentially; achieves 78.4% accuracy using LSTM layers processing tweet sequences with word2vec and hand-crafted lexical/relational features.
  • Thorne et al. (2018) — The Fact Extraction and VERification (FEVER) Shared Task — first shared task combining evidence retrieval and natural language inference for fact verification; 23 teams, 185,445 human-generated claims verified against Wikipedia; best system achieves 64.21% FEVER score; analysis reveals three-stage pipeline architecture (document selection → sentence selection → NLI) is dominant; post-competition evidence augmentation identified 308 new evidence sets and corrected label errors.
  • Da San Martino, Barrón-Cedeño & Nakov (2019) — Findings of the NLP4IF-2019 Shared Task on Fine-Grained Propaganda Detection — shared task on propaganda technique identification in news articles; two subtasks: FLC (fragment-level with 18-way technique classification) and SLC (sentence-level binary); 90 registered teams with 39 submitting predictions; winning systems use fine-tuned BERT achieving 0.63 F1 (SLC) and 0.25 F1 (FLC); corpus of 497 annotated articles with fragment-level annotations enables interpretable propaganda analysis.

Datasets and resources

Media profiling and source credibility

Deception and behavioral detection

  • A Deep Learning Approach for Multimodal Deception Detection — Multimodal neural networks for deception detection using 3D-CNN on video, audio features, textual CNN, and micro-expressions; achieves 96.14% accuracy on courtroom trial videos, substantially outperforming traditional classifiers

Mainstream media dissemination

COVID-19 pandemic infodemic

Synthetic media and deepfakes

  • Mirsky & Lee (2020) — The Creation and Detection of Deepfakes: A Survey — comprehensive 38-page survey covering both creation and detection methodologies; systematically reviews generative architectures (GANs, VAEs, CNNs, RNNs), technical approaches to reenactment/replacement/editing/synthesis, artifact-specific and undirected detection methods; identifies arms race dynamics and current technological limitations.
  • Tolosana et al. (2020) — DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection — comprehensive survey of facial manipulation techniques (entire face synthesis, identity swap, attribute manipulation, expression swap) and detection methods; covers GAN-based generation (StyleGAN, ProGAN), public databases, and state-of-the-art benchmarks showing detection difficulty under cross-domain conditions.
  • Rana et al. (2022) — Deepfake Detection: A Systematic Literature Review — comprehensive SLR of 112 deepfake detection papers (2018–2020) with rigorous methodology; organizes 77% deep learning (primarily CNNs), 18% machine learning, 3% statistical, and 2% blockchain-based techniques; synthesizes datasets (FaceForensics++, DFDC, DeeperForensics); evaluates 100+ detection models and 10+ feature types; finds deep learning achieves 89.7% mean accuracy vs. 85% for traditional ML; identifies standardization gaps in evaluation and future research directions.
  • Ba et al. (2024) — Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection — information-theoretic framework decomposing facial features into disentangled local representations and aggregated global representations using mutual information losses; achieves 0.983 AUC on FaceForensics++, 0.999 AUC on Celeb-DF-V2, 0.939 AUC on DFDC; demonstrates strong cross-dataset generalization (0.818-0.864 AUC on Celeb-DF when trained on FaceForensics++); addresses overfitting limitations of prior region-specific detection methods.
  • Cifci, Demir & Yin (2019) — FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals — detects deepfakes via photoplethysmography (blood flow patterns) by analyzing spatial coherence and temporal consistency of biological signals; achieves 91%+ accuracy on Face Forensics++, CelebDF, and UADFV; introduces "in the wild" Deep Fakes Dataset; demonstrates biological signal inconsistencies as orthogonal detection signal to visual artifacts.
  • Sabir et al. (2019) — Recurrent Convolutional Strategies for Face Manipulation Detection in Videos — recurrent-convolutional networks exploiting temporal discrepancies for detecting Deepfake, Face2Face, and FaceSwap; combines face alignment preprocessing with bidirectional GRU cells operating on frame sequences; achieves 96.9%, 94.35%, and 96.3% accuracy respectively on FaceForensics++, improving prior state-of-the-art by up to 4.55%; shows bidirectional temporal recurrence essential while multi-level recurrence hurts due to limited training data.
  • DeepFakes: a New Threat to Face Recognition? Assessment and Detection — first publicly available GAN-based Deepfake database (620 videos from 16 VidTIMIT subject pairs); demonstrates that VGG and FaceNet face recognition systems achieve FAR of 85.62% and 95.00% on high-quality deepfakes; evaluates detection methods showing audio-visual lip-sync approaches fail entirely while image quality metrics achieve 8.97% EER
  • Zhou et al. (2018) — Two-Stream Neural Networks for Tampered Face Detection — two-stream architecture combining spatial and frequency domain analysis for detecting face tampering and deepfakes.
  • Gehrmann et al. (2019) — GLTR: Statistical Detection and Visualization of Generated Text — statistical approach for detecting automatically generated text using language model probabilities and visualization techniques.
  • Rössler et al. (2019) — FaceForensics++: Learning to Detect Manipulated Facial Images — largest facial forgery benchmark (1.8M+ images from 1K+ videos) with four manipulation methods (Face2Face, FaceSwap, DeepFakes, NeuralTextures); comprehensive evaluation of detection methods from stegananalysis to CNN-based approaches; human baseline (68.7% accuracy) vs. XceptionNet (99.26%); systematic analysis of compression robustness showing significant performance degradation under realistic post-processing.
  • Li, Chang & Lyu (2018) — In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking — detects deepfakes via physiological signal absence (eye blinking); LRCN model combining CNN feature extraction with LSTM temporal modeling achieves 0.99 AUC vs. 0.98 for CNN-only and 0.79 for hand-crafted baselines; exploits fact that deepfake training datasets rarely contain closed-eye images, making natural blink sequences absent from synthesized video.
  • McCloskey & Albright (2018) — Detecting GAN-generated Imagery using Color Cues — forensic detection of GAN-generated images by analyzing generator network architecture; identifies two cues (color channel overlap and saturation suppression) that distinguish GANs from real cameras; saturation-based SVM achieves 0.7 AUC on fully GAN-generated images and 0.61 on face-swapped images.
  • Vaccari & Chadwick (2020) — Deepfakes and Disinformation: Exploring the Impact of Synthetic Political Video on Deception, Uncertainty, and Trust in News — experimental study (N=2,005 UK respondents) on political deepfakes using the widely-circulated Obama/Peele deepfake; finds that deepfakes increase uncertainty about content, and this uncertainty mediates reduced trust in news on social media; deepfakes threaten civic culture through epistemic erosion rather than mass deception; educational interventions showing deepfakes are synthetic can mitigate effects.
  • Fagni et al. (2020) — TweepFake: about detecting deepfake tweets — first public dataset of human vs. machine-generated tweets; 25,572 tweets from 23 bot accounts (GPT-2, RNN, LSTM, Markov, etc.) and 17 human accounts; benchmarks 13 detection methods; finds transformer-based fine-tuned models (RoBERTa) achieve 90% accuracy, character-level encodings effective for short text, but GPT-2 tweets remain challenging (65–80% accuracy).
  • Yang, Li & Lyu (2018) — Exposing Deep Fakes Using Inconsistent Head Poses — forensic detection method exploiting facial landmark misalignment in deepfake generation pipeline; compares 3D head poses estimated from all facial landmarks vs. central region only; real faces show consistent poses (cosine distance <0.02) while deepfakes exhibit large divergence (0.02–0.08); SVM classifier achieves 89.0% AUROC on deepfake videos and 84.3% on diverse face-swap dataset; demonstrates that synthesis errors invisible to human eye are detectable through geometric constraints.
  • Afchar et al. (2018) — MesoNet: A Compact Facial Video Forgery Detection Network — lightweight CNN architectures (Meso-4 and MesoInception-4) for detecting Deepfake and Face2Face forgeries at mesoscopic level; achieves 98% detection accuracy for Deepfake and 95% for Face2Face under realistic compression; introduces first publicly available Deepfake dataset with 175 videos; demonstrates that efficient networks with ~28K parameters match or exceed complex architectures while remaining computationally practical.

Offensive AI & threat modeling

AI safety & governance

  • Mehrabi et al. (2023) — FLIRT: Feedback Loop In-context Red Teaming — Automated red teaming framework using in-context learning to generate adversarial prompts targeting generative models. Red language model generates prompts without fine-tuning; outputs are evaluated for safety, and feedback refines future generations. Proposes multiple attack strategies (FIFO, LIFO, Scoring, Scoring-LIFO) balancing effectiveness vs. diversity; demonstrates 80%+ attack success on vanilla Stable Diffusion and 60%+ on safeguarded variants, substantially outperforming prior manual and weakly-automated approaches. Shows attacks transfer across text-to-image models and extends to text-to-text models (GPT-Neo).
  • Perez et al. (2022) — Discovering Language Model Behaviors with Model-Written Evaluations — proposes using language models to generate high-quality evaluations for testing diverse model behaviors. Generates 154+ datasets testing 154 behaviors across personality, goal-seeking, politics, and ethics. Discovers inverse scaling phenomena where larger models exhibit worse behavior on some safety-relevant tasks (stronger political views, greater desire to avoid shutdown, increased sycophancy). Shows RLHF training amplifies political bias and can create unintended instrumental subgoals. Demonstrates that smaller preference models effectively predict RLHF model behavior, enabling early detection of safety concerns before full deployment.
  • Perez et al. (2022) — Red Teaming Language Models with Language Models — demonstrates automated red teaming to systematically discover harmful behaviors in language models. Uses one LM to generate adversarial test cases probing another LM for offensive replies, data leakage, personal information generation, and distributional biases. Explores zero-shot, few-shot, supervised, and reinforcement learning methods; RL achieves 27-42% offensive reply elicitation rates. Uncovers 1709 training data leakage instances and reveals that models discuss different demographic groups with significantly different offensiveness rates. Foundational work showing language models can complement human red teaming at scale.
  • Bang et al. (2024) — Measuring Political Bias in Large Language Models: What Is Said and How It Is Said — evaluates political bias in LLM-generated content via two-tiered framework separating political stance (extreme anchor comparison) from framing bias (content and style components). Tests 11 open-source LLMs (LLaMa-2, Yi, Vicuna, Falcon, etc.) on 14 politically divisive topics; finds models exhibit liberal bias on social issues (same-sex marriage, climate change, public education), US-centric focus despite global training claims, and nuanced issue-specific biases varying across models. Decomposition of bias into content bias (entity/topic selection) and style bias (lexical polarity) provides explainable measurement beyond left-right spectrum.
  • Goldstein et al. (2023) — Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations — threat assessment of how generative language models could expand the scale and sophistication of influence operations and propaganda campaigns. Uses ABC framework (Actors, Behaviors, Content) to analyze threats; proposes comprehensive mitigation taxonomy across four intervention points (model design & construction, model access, content dissemination, belief formation). Evaluates mitigations for technical feasibility, social feasibility, downside risks, and impact. Identifies critical unknowns about adoption rates, effectiveness, and norm-setting.
  • [[2023-shu-exploitability-instruction-tuning|Shu et al. (2023) — On the Exploitability of Instruction Tuning]] — investigates vulnerabilities in instruction-tuned LLMs to data poisoning attacks via AutoPoison, an automated pipeline generating high-quality poisoned training data; demonstrates content injection and over-refusal attacks that scale to larger models while maintaining fluency; shows instruction tuning's low sample complexity is a double-edged sword enabling both capability learning and behavior hijacking.
  • Evans et al. (2021) — Truthful AI: Developing and Governing AI That Does Not Lie — policy and governance framework for preventing AI systems from generating false or misleading statements. Proposes conceptual distinctions between lies, negligent falsehoods, and truthfulness; describes institutional arrangements for AI truthfulness standards (industry self-regulation, co-regulation, top-down regulation); outlines technical approaches to developing truthful AI. Argues early standards-setting is crucial before AI capabilities in strategic deception exceed human capacity.
  • Wei, Haghtalab & Steinhardt (2023) — Jailbroken: How Does LLM Safety Training Fail? — analyzes fundamental failure modes in safety-trained language models through two mechanisms: competing objectives (where safety training conflicts with pretraining-induced instruction following) and mismatched generalization (where safety training fails to cover capabilities developed during pretraining). Develops 30 jailbreak methods and tests on GPT-4, Claude v1.3, and GPT-3.5 Turbo, finding vulnerabilities persist despite extensive red-teaming. Argues that scaling and additional red-teaming alone cannot resolve fundamental tensions in how LLMs are trained for safety.

Platform governance and regulation

Propagation-based detection

  • Shu, Bernard & Liu (2018) — Studying Fake News via Network Analysis: Detection and Mitigation — comprehensive chapter surveying network properties (echo chambers, filter bubbles, malicious accounts), three homogeneous and three heterogeneous network types, feature learning via network embeddings (NMF, RNNs), detection methods (interaction embedding, temporal diffusion, credibility propagation, knowledge network matching), and mitigation strategies (provenance identification, leader selection, influence minimization, mitigating campaigns).
  • Cheng et al. (2014) — Can Cascades be Predicted? — foundational work showing cascades on social networks are highly predictable (~80% accuracy); temporal features most predictive, followed by structural, resharer, and user features; demonstrates prediction improves with observation window size; reveals fundamental differences between user-initiated and page-initiated cascades.
  • Li et al. (2016) — DeepCas: an End-to-end Predictor of Information Cascades — first end-to-end deep learning approach to cascade size prediction; represents cascade graphs as random walk paths processed through bidirectional GRU with attention mechanisms; automatically learns cascade representations without hand-crafted features; evaluated on Twitter and academic citation cascades.
  • Wang et al. (2017) — Topological Recurrent Neural Network for Diffusion Prediction — novel LSTM architecture for dynamic DAGs; models cascades as diffusion topologies showing information spread over network structure; learns topology-aware sender embeddings capturing both node properties and cascade dynamics; achieves 20–56% relative improvement over DeepCas across three real-world networks.
  • Tacchini et al. (2017) — Some Like it Hoax: Automated Fake News Detection in Social Networks — hoax detection via user interaction patterns on Facebook; proposes that user "likes" encode veracity signals independent of content; two algorithms (logistic regression, harmonic boolean crowdsourcing) achieve >99% and 99.4% accuracy respectively; demonstrates transfer learning across Facebook communities and robustness with minimal labeled training data (<1% of posts); suggests diffusion patterns are a primary detection signal.
  • Ruchansky, Seo, & Liu (2017) — CSI: A Hybrid Deep Model for Fake News Detection — three-module neural network combining text, temporal engagement response patterns, and user group behavior to identify fake news and suspicious users; Capture module uses LSTM on temporal features; Score module learns user suspiciousness from co-engagement patterns; achieves 89.2% accuracy on Twitter, outperforming text-only and propagation-only baselines; demonstrates value of joint modeling with fewer parameters than competing RNN approaches.
  • Castillo, Mendoza & Poblete (2011) — Information Credibility on Twitter — foundational work framing Twitter credibility assessment via user reputation and propagation signals; 2,500+ trending topics, human-labeled for newsworthiness and credibility; shows user features (registration age, followers, activity) and propagation structure (retweet tree depth/breadth) are stronger predictors than text alone; achieves 89% accuracy on newsworthy detection, 86% on credibility classification.
  • Ma, Gao & Wong (2017) — Detect Rumors in Microblog Posts Using Propagation Structure via Kernel Learning — kernel-based approach (PTK/cPTK) measuring structural similarity between propagation trees; soft-matches subtrees to capture high-order patterns; context-sensitive extension considers propagation paths from root; extends to four-class classification (false/true/unverified/non-rumor); achieves 75.0% accuracy on Twitter15 with superior early detection (75% within 24 hours).
  • Ma, Gao & Wong (2018) — Rumor Detection on Twitter with Tree-structured Recursive Neural Networks — applies recursive neural networks (bottom-up and top-down variants) to thread propagation trees; learns joint content-structure representations where local patterns (supportive/questioning replies) signal veracity; achieves 72.3% / 73.7% accuracy on Twitter15/16 with superior early detection (8 hours vs. 36 hours to match baseline).
  • Vosoughi, Roy & Aral (2017) — The Spread of True and False News Online — largest longitudinal study of misinformation diffusion; ~126K verified true/false cascades from Twitter (2006–2017), 3M users, 4.5M shares; falsehood diffuses 6× faster to 1.5K people, reaches depth 19 vs. truth's depth 10 in 1/10 the time; 70% higher retweet likelihood; humans (not bots) responsible; novelty perception key driver.
  • Shu et al. (2019) — Hierarchical Propagation Networks for Fake News Detection — constructs hierarchical propagation networks from both macro-level (retweet cascades) and micro-level (reply conversations) granularity; extracts structural, temporal, and linguistic features showing fake news spreads deeper, contains more bots, has shorter lifespan, and generates more negative sentiment; hierarchical network features (HPNF) achieve F1 > 0.80, outperforming prior macro-level-only approaches.
  • Zhou & Zafarani (2019) — Network-based Fake News Detection: A Pattern-driven Approach — four network-structural patterns (More-Spreader, Farther-Distance, Stronger-Engagement, Denser-Network) across five network levels; 138 interpretable features; RF 0.929/0.932 accuracy/F₁ on PolitiFact without reading content; robust to limited early-stage network information.
  • Monti et al. (2019) — Fake News Detection on Social Media using Geometric Deep Learning — graph convolutional networks on propagation cascades integrating user profiles, activity, social network structure, and spreading patterns; 92.7% ROC AUC on Twitter; user profile and network features are most important (90% AUC combined) while content marginally contributes; enables early detection within 1–2 hours with minimal cascade size (6 tweets).
  • Dou et al. (2021) — User Preference-aware Fake News Detection (UPFD): Combines endogenous user preferences (from historical tweets) with exogenous news propagation patterns via GNNs. Encodes user preferences and news content using BERT/word2vec, builds Twitter retweet cascade graphs, uses GNN message passing to integrate signals; concatenates user engagement and news textual embeddings for classification. Achieves 84.62% accuracy on Politifact and 97.23% on Gossipcop; ablation studies show both user preference and propagation are necessary; demonstrates confirmation bias is a learnable signal in engagement data.
  • Lu & Li (2020) — GCAN: Graph-aware Co-Attention Networks for Explainable Fake News Detection on Social Media — detects fake news on Twitter using only source tweet text and retweet user sequences (no comments, no explicit network topology); models user propagation with CNN and GRU, constructs fully-connected user interaction graphs weighted by feature similarity, applies GCN and dual co-attention mechanism to jointly highlight suspicious users and informative words; achieves 87.67% accuracy on Twitter15 and 90.84% on Twitter16 (18–20% improvement over prior work); demonstrates early detection at 90% accuracy with only 10 retweets; provides interpretable explanations of suspicious user characteristics and dramatic linguistic markers.

  • Belief Evolution Network-based Probability Transformation and Fusion — 2021 · arXiv preprint

  • Causal Understanding of Fake News Dissemination on Social Media — 2021 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining
  • Rumor Detection on Social Media with Bi-Directional Graph Convolutional Networks — 2020 · AAAI 2020

Bot detection

  • Cresci et al. (2016) — DNA-Inspired Online Behavioral Modeling and Its Application to Spambot Detection — encodes user actions as character sequences and applies longest common substring analysis to detect groups of similar accounts; outperforms supervised and unsupervised baselines achieving MCC 0.952 on political bots; demonstrates paradigm shift toward group-level detection of evolved spambots
  • The Paradigm-Shift of Social Spambots: Evidence, Theories, and Tools for the — empirical evidence of a new generation of social spambots that evade all existing detection approaches (Twitter, humans, academic tools); crowdsourced evaluation shows 0.24 accuracy vs 0.91 on traditional bots; paradigm shift toward group-level detection methods
  • Better Safe Than Sorry: an Adversarial Approach to improve Social Bot Detection — proposes GenBot, a genetic algorithm for synthesizing evolved spambots; demonstrates that evolved bots evade state-of-the-art detection (F₁ ≈ 0.26) while revealing an actionable vulnerability (entropy-based signatures); introduces proactive detection paradigm to anticipate and preemptively defend against future bot evolutions
  • A Decade of Social Bot Detection — decade-long longitudinal review (2010–2020) of social bot detection research; systematically catalogs 230+ detectors across two dimensions (individual vs. group detection, methodological approach); documents three "waves" of bot evolution and shift from individual-account to group-level detection approaches; analyzes publication trends showing exponential growth post-2014; argues modern ML detectors fail due to non-stationarity and non-neutrality assumptions
  • Detection of Novel Social Bots by Ensembles of Specialized Classifiers — ensemble of specialized classifiers; shows heterogeneous bot behaviors (spammers, fake followers, political bots) are distinguished by different feature sets; ESC trains per-type classifiers combined via maximum rule; achieves 56% improvement in F1 score for novel bots (47% → 73%); improves cross-domain recall from 42% to 84%; enables efficient adaptation with fewer labeled examples for retraining; deployed in Botometer v4 achieving AUC 0.99
  • Davis et al. (2016) — BotOrNot: A System to Evaluate Social Bots — publicly available web and API service for classifying Twitter accounts as human or bot using 1,000+ features; Random Forest classifier achieves 0.95 AUC on 15k bots and 16k legitimate accounts; served over one million API requests since 2014 launch
  • Arming the public with artificial intelligence to counter social bots — comprehensive review of social bot types, activities, and impact; case study of Botometer bot detection tool; user experience survey (N=731) revealing interpretation challenges; proposes calibration methods (Platt scaling, Complete Automation Probability) to make bot scores interpretable; demonstrates model generalization across diverse bot types
  • Scalable and Generalizable Social Bot Detection through Data Selection — scalable metadata-only bot detection framework using only 20 user features; achieves 900M tweets/day processing speed; compiles 13 labeled datasets (94K bots, 43K humans); demonstrates that strategic data selection (training on curated subset) improves generalization and consistency better than exhaustive training; achieves 0.99 AUC on unseen datasets
  • Shao et al. (2018) — Anatomy of an online misinformation network — network analysis of fact-checking vs. misinformation diffusion during 2016 U.S. election; k-core decomposition reveals strong segregation between claim and fact-check communities; fact-checking nearly disappears in dense network cores dominated by bots and misinformation spreaders; identifies efficient node-removal strategies for disrupting misinformation circulation
  • Shao et al. (2017) — The spread of low-credibility content by social bots — large-scale empirical analysis (14M messages, 400K articles) during 2016 U.S. election; shows only 6% of accounts spreading misinformation are bots but they account for 31% of tweet volume; bots employ early amplification strategy and target influential users; network dismantling analysis shows removing bots is critical for reducing misinformation spread
  • Varol et al. (2017) — Online Human-Bot Interactions: Detection, Estimation, and Characterization — large-scale machine-learning framework extracting 1,150 behavioral features to classify bots from Twitter accounts; evaluates on 14M accounts; estimates 9–15% of active users are bots; clustering analysis reveals behavioral phenotypes; demonstrates concept drift in detection systems
  • Ferrara et al. (2015) — The Rise of Social Bots — foundational survey of social bot phenomenon and detection methods; proposes taxonomy dividing approaches into graph-based detection (network structure), crowd-sourced detection (human judgment), and feature-based detection (behavioral patterns); analyzes characteristics distinguishing bots from humans and discusses arms race between sophistication and detection.
  • Ayoobi, Shahriar & Mukherjee (2023) — The Looming Threat of Fake and LLM-generated LinkedIn Profiles: Challenges and Opportunities for Detection and Prevention — Dataset of 3,600 LinkedIn profiles (1,800 legitimate, 600 human-created fake, 1,200 ChatGPT-generated) and Section and Subsection Tag Embedding (SSTE) method for detection; achieves 95% accuracy distinguishing legitimate from fake profiles, and 70%+ accuracy on unseen ChatGPT-generated profiles despite absence from training; demonstrates that minimal LLM-generated training samples suffice for generalization to diverse LLM outputs.

  • Botometer 101: Social bot practicum for computational social scientists — 2022 · arXiv

  • Detecting and Tracking the Spread of Astroturf Memes in Microblog Streams — 2010 · arXiv

Media manipulation & coordinated campaigns

Fringe communities and internet culture

LLM-generated text detection

Style / content-based detection

Knowledge & fact-checking

Evidence-based detection

  • Popat et al. (2018) — DeClareE: Debunking Fake News and False Claims using Evidence-Aware Deep Learning — end-to-end neural network combining claims and evidence articles via bidirectional LSTMs with claim-specific attention; automatically discovers which web articles support or refute a claim without hand-crafted features; 78.96% accuracy on Snopes, demonstrating the value of external evidence for credibility assessment.
  • Vo & Lee (2021) — Hierarchical Multi-head Attentive Network for Evidence-aware Fake News Detection — proposes MAC with hierarchical multi-head attention at both word and document levels; word-level attention identifies important phrases in claims and evidence; document-level attention weights evidence sources by relevance; jointly optimized with BiLSTM embeddings; achieves 88.7% AUC on Snopes (9.47% improvement over baselines) and 75.8% on PolitiFact; ablation studies demonstrate both attention levels are essential for evidence-aware fact-checking.
  • Jin et al. (2021) — Towards Fine-Grained Reasoning for Fake News Detection — constructs claim-evidence graphs from social media (posts, users, keywords) and uses mutual-reinforcement-based ranking to identify salient evidence; proposes bi-channel kernel graph attention network integrating textual and social signals for fine-grained reasoning; achieves 91.7% F1 on PolitiFact and 86.4% F1 on GossipCop with interpretable explanations of which evidence groups matter most for each prediction.

Multimodal

Source / social context

Susceptibility factors and public health behavior

Moral and behavioral psychology of misinformation

Adversarial & defensive

Early detection

Explainability

Cross-domain & transfer

LLMs & generative-era

Real-world GenAI misuse and threat assessment: - Marchal et al. (2024) — Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data — First empirical taxonomy of real-world GenAI misuse based on 191 documented media incidents (Jan 2023–Mar 2024); identifies 18 distinct tactics across exploitation of GenAI capabilities (impersonation, falsification, content scaling) and technical system attacks; finds most misuse is low-tech and accessible, driven by five goals (opinion manipulation 27%, monetization 21%, fraud 18%, harassment 6%, reach 3.6%); demonstrates GenAI has democratized previously costly tactics for broader pools of actors with minimal technical expertise.

Empirical detection studies: - Su, Cardie & Nakov (2023) — Adapting Fake News Detection to the Era of Large Language Models — Comprehensive evaluation of fake news detectors across three stages: human-written dominance (Human Legacy), mixed human-machine (Transitional Coexistence), and machine-generated dominance. Key finding: detectors trained exclusively on human-written fake news generalize poorly to machine-generated fakes. Recommends training on balanced human-machine data to improve robustness. Benchmarks RoBERTa, BERT, ELECTRA, ALBERT, DeBERTa on GossipCop++ and PolitiFact++ datasets; reveals data distribution shifts caused by LLMs create asymmetric generalization challenges. - Dugan et al. (2022) — Real or Fake Text?: Boundary Detection — Investigates human ability to detect transition points where text shifts from human-written to machine-generated (boundary detection). Introduces RoFT game platform; 21,000+ annotations across four genres show humans achieve 23.4% on first guess (vs. 10% random) and 72.3% with top-3 guesses; larger models harder to detect; genre-specific error patterns; monetary incentives improve learning. - Can LLM-Generated Misinformation Be Detected? — Empirical evidence that LLM-generated misinformation is harder to detect for humans (9.6% vs 40.7% success) and detectors than human-written content with same semantics; builds taxonomy and LLMFake dataset.

Comprehensive surveys: - Combating Misinformation in the Age of LLMs: Opportunities and Challenges — Systematic review of both opportunities (detection, intervention, attribution) and challenges (hallucination, intentional generation) for using LLMs in misinformation research; examines domain-specific threats and countermeasures.

Model evaluation and understanding:

Model alignment and instruction-following: - Askell et al. (2021) — A General Language Assistant as a Laboratory for Alignment — interactive evaluation framework for alignment using helpfulness, honesty, and harmlessness (HHH) criteria; compares prompting, imitation learning, binary discrimination, and ranked preference modeling; finds ranked preference modeling scales better than imitation learning; introduces preference model pre-training (PMP) on public data to improve sample efficiency.

Disinformation generation and safety: - Toxicity in ChatGPT: Analyzing Persona-assigned Language Models — Large-scale systematic analysis of persona-induced toxicity in ChatGPT; shows safety mechanisms can be bypassed via system parameter manipulation; 6× toxicity increase possible; reveals discriminatory bias targeting certain demographic groups, countries, and entity categories - Vykopal et al. (2023) — Disinformation Capabilities of Large Language Models — Comprehensive empirical study of 10 LLMs' ability to generate disinformation news articles across 20 narratives (COVID-19, Russia-Ukraine, health, elections); most models readily agree with dangerous claims; Falcon is sole exception with effective safeguards; ChatGPT shows behavioral safety; existing detectors achieve ~0.8 F1 but struggle per-sample.

Truthfulness and hallucination evaluation: - Ji et al. (2022) — Survey of Hallucination in Natural Language Generation — comprehensive survey of hallucination across six major NLG tasks (abstractive summarization, dialogue generation, QA, data-to-text generation, machine translation, vision-language generation) and LLMs; defines intrinsic and extrinsic hallucinations; reviews metrics (statistical, model-based, human evaluation) and mitigation methods (architecture, training, post-processing, controllable generation); identifies task-specific tolerance differences and open challenges. - Lin, Hilton & Evans (2021) — TruthfulQA: Measuring How Models Mimic Human Falsehoods — benchmark demonstrating larger language models are less truthful; proposes automated metric for evaluating factual accuracy.

Robustness of detectors and adversarial attacks: - Sadasivan et al. (2023) — Can AI-Generated Text be Reliably Detected? — Comprehensive stress-testing of four detector classes (watermarking, neural network-based, zero-shot, retrieval-based) using recursive paraphrasing attacks; reduces watermark detector AUROC from 99.8% to 80.7%, and retrieval-based detectors below 60% accuracy with only modest text quality degradation; establishes theoretical bound on detector AUROC via total variation distance between text distributions, revealing fundamental hardness as LLMs improve. - Mao et al. (2024) — RAIDAR: Generative AI Detection via Rewriting — Detection method leveraging rewriting behavior: LLMs preserve their own generated text while modifying human-written text when asked to rewrite. Measures three structural properties (invariance, equivariance, output uncertainty) from editing distance without requiring internal model access. Achieves 60–95 F1 across diverse domains (news, essays, code, reviews, arXiv) with 29-point improvements over prior methods; robust to adversarial rephrasing attacks even when adversaries know the detection mechanism (up to 93 F1).

Zero-shot detection methods: - Mitchell et al. (2023) — DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature — Identifies that LLM-generated text occupies negative-curvature regions of the log-probability landscape; zero-shot method using random perturbations to estimate Hessian trace; achieves 0.95 AUROC on GPT-2 detection without training data or access to model parameters.

Generation attacks and detection: - Adelani et al. (2019) — Generating Sentiment-Preserving Fake Online Reviews — Demonstrates practical attack using fine-tuned GPT-2 to generate high-quality product reviews; two-step approach (generation + BERT validation) preserves sentiment; shows humans and automated detectors (Grover, GLTR, OpenAI detector) struggle to distinguish generated from authentic reviews; sentiment preservation rates 67–71% with fine-tuning. - Ippolito et al. (2019) — Automatic Detection of Generated Text is Easiest when Humans are Fooled — empirical study contrasting human and automatic detection of GPT-2-generated text across three decoding strategies (top-k, nucleus sampling, untruncated random). Fine-tuned BERT achieves 80%+ accuracy on long (192-token) excerpts versus 71% for trained human raters. Critical finding: detectors trained on one strategy transfer poorly to others (42.5% accuracy drop when trained on top-k and tested on nucleus), whereas humans remain robust. Reveals asymmetric difficulty: detection is easiest when humans are fooled (nucleus sampling) but hardest when humans remain reliable (top-k). - Clark et al. (2021) — All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text — large-scale study (1,170 Amazon Mechanical Turk evaluators) examining humans' ability to assess machine-generated text from GPT2 and GPT3 across three domains (stories, news, recipes). Untrained evaluators achieve 57% accuracy on GPT2 and 50% (chance) on GPT3; three training interventions (instructions, examples, comparisons) improve accuracy modestly, with example-based training reaching 55% overall. Reveals evaluators focus on surface-level features (grammar, spelling, style) rather than content; provides evidence that consistent human evaluation methodology is critical for benchmarking NLG quality and detection systems.

Misinformation generation and ODQA poisoning: - On the Risk of Misinformation Pollution with Large Language Models — Investigates LLM-generated misinformation threat to ODQA systems; demonstrates GPT-3.5 can generate credible false passages that degrade retrieval-based QA performance (14–87% EM drop); proposes misinformation detection, vigilant prompting, and reader ensemble defenses

Real-world impacts & polarization

  • Garimella et al. (2017) — Quantifying Controversy on Social Media — three-stage graph-based pipeline for measuring controversy in social media discussions via conversation topology; proposes multiple network-structure metrics with random-walk-based approach (RWC) most reliably separating controversial from non-controversial topics; validates on Twitter and external datasets.
  • Garimella et al. (2016) — Reducing Controversy by Connecting Opposing Views — algorithmic approach to mitigating echo chambers and polarization via graph-based edge recommendation; uses RWC metric to identify which edges to add; efficient algorithm (ROV) focuses on high-degree hub nodes; extends to ROV-AP incorporating acceptance probability based on user polarity; empirical validation on 10 Twitter controversy datasets.
  • Cinelli et al. (2021) — The echo chamber effect on social media — comparative analysis of 100+ million posts across Twitter, Facebook, Reddit, and Gab; quantifies echo chambers via homophily in interaction networks and bias in information diffusion; shows platform architecture (feed algorithms vs. community-based curation) determines whether homophilic clustering and polarized diffusion emerge; Facebook and Twitter exhibit strong echo chambers while Reddit shows reduced segregation despite polarization.
  • Bail et al. (2018) — Exposure to opposing views on social media can increase political polarization — field experiment on Twitter showing that repeated exposure to opposing political ideology can increase polarization (backfire effect), particularly for Republicans; challenges assumption that "breaking echo chambers" reduces polarization.
  • Soares, Recuero & Zago (2018) — Influencers in Polarized Political Networks on Twitter — social network analysis of Twitter conversations during Brazil's 2016 impeachment process; identifies three influencer types (opinion leaders, informational influencers, activists) and shows that user behavior—especially activist retweeting of in-group messages—actively reinforces echo-chamber structure and polarization beyond algorithmic curation.
  • Wilson & Wiysonge (2020) — Social media and vaccine hesitancy — large-scale cross-national study (137–166 countries) demonstrating causal links between social media activity and public health outcomes; social media organization for offline action predicts vaccine safety skepticism (cross-sectional); foreign disinformation campaigns associated with 2-percentage-point drop in vaccination coverage year-over-year; 15% increase in negative vaccine tweets per point on disinformation scale
  • Mills et al. (2023) — Engagement, User Satisfaction, and the Amplification of Divisive Content on Social Media — pre-registered field experiment comparing Twitter's engagement-based ranking algorithm with reverse-chronological and stated-preference baselines; finds engagement-based ranking amplifies partisan (0.24 SD), emotionally charged, and out-group hostile content beyond what users report preferring; proposes and evaluates stated-preference ranking that reduces harmful amplification while maintaining engagement and satisfaction.

  • Quantifying Political Partisanship for Cross-Platform Analyses — 2026 · arXiv cs.SI

Authors

See all authors — sorted alphabetically.

Topics

See all topics — research themes and methods.

Datasets

See all datasets.

  • NELA-GT-2022 — 1.78M news articles from 361 sources (2022); source-level MBFC labels (factuality 0–5, conspiracy/pseudoscience); 346K embedded tweets; fifth NELA release with stabilized collection; SQLite and JSON formats.
  • NELA-GT-2018 — 713K news articles from 194 sources (2018); engagement-independent collection; source-level labels from 8 assessment sites (NewsGuard, Pew Research, Wikipedia, OpenSources, MBFC, AllSides, BuzzFeed, PolitiFact); multi-dimensional ground truth.
  • NELA-GT-2019 — 1.12M news articles from 260 sources (2019); source-level labels from 7 assessment sites (MBFC, AllSides, PolitiFact, etc.); 3-class aggregated reliability label; SQLite and JSON formats.
  • NELA-GT-2020 — 1.78M news articles from 519 sources (2020); source-level MBFC labels; novel embedded tweets feature (410K tweets); covers COVID-19 and 2020 U.S. election; SQLite and JSON formats.
  • MM-COVID — 3,981 fake news pieces in six languages (English, Spanish, Portuguese, Hindi, French, Italian) with 7,192 tweets; multilingual and multimodal COVID-19 dataset enabling cross-lingual detection research.
  • FakeNewsNet — PolitiFact + GossipCop; news content + Twitter social context; labels from professional fact-checkers.
  • ReCOVery — 2,029 COVID-19 news articles from 60 publishers; publisher-level NewsGuard/MBFC credibility labels; 140,820 tweets; multimodal (text, image, social).
  • CHECKED — 2,104 Weibo microblogs with per-item expert labels (344 fake, 1,760 real); Chinese COVID-19; includes images, video, and full propagation threads.
  • Weibo21 — 9,128 Weibo microblogs (4,488 fake, 4,640 real) across 9 domains (Science, Military, Education, Disasters, Politics, Health, Finance, Entertainment, Society); first multi-domain fake news dataset from a single platform; addresses domain shift for cross-domain detection.
  • Fake And Real News — 10,558 English news articles (binary fake/real); fake articles from 2016 Kaggle election dataset; real articles from AllSides/major outlets; 50% null accuracy.
  • FUBU-EPSTEIN — 54.38M Twitter statuses (Aug 2019–Apr 2023) on the Jeffrey Epstein case; annotated with conspiracy, misinformation, sentiment, toxicity, and moral emotion; 37M-edge social contact graph; public anonymized release on Zenodo.

  • CMU-MisCOV19

  • CoAID
  • COVID-19 Twitter Chatter Dataset
  • DFDC: DeepFake Detection Challenge Dataset
  • Fake News Corpus
  • Fakeddit
  • Media Bias/Fact Check (MBFC)
  • MultiFC
  • OLID
  • Pheme Project
  • SwapMe and FaceSwap Dataset
  • VidTIMIT Deepfake Dataset
  • VLDBench
  • Wang Deepfake Detection Dataset
  • WildFakeBench

Tools & libraries

See all tools (populated by ingest workflow)

Videos & talks

See all videos (populated by ingest workflow)

About & Citation

See how to cite this guide.