Skip to content

Content labeling

Design and deployment of labels to disclose content attributes (e.g., AI-generated, edited, disputed) to users.

Content labeling refers to the design and deployment of visual or textual markers that disclose attributes of digital content to users. Labels serve multiple goals: warning about false or disputed claims, disclosing content provenance (authorship, generation method), signaling content type or sensitivity (sexual, violent, misleading), and enabling user agency by providing transparent information about how content was created or modified.

Labels differ from content removal or demotion: they preserve user access to content while providing contextual information to support informed decision-making. Labeling is less resource-intensive than fact-checking every claim and operates at scale on platforms.

Types of labels

Process-focused labels disclose how content was created:

  • "AI Generated" — content created by a machine learning model
  • "Edited" — content modified from original
  • "Bot-generated" — content produced by automated systems
  • "AI Manipulated" — content modified using AI

Claim-focused labels evaluate content veracity or quality:

  • "Rated false" — fact-checked and found to be false
  • "Disputed" — fact-checkers disagree or insufficient consensus
  • "Lacks context" — missing relevant context that changes meaning
  • "Deepfake" — synthetic video/audio created to deceive

Disclosure labels provide transparency without evaluation:

  • "Paid promotion" — advertising or sponsored content
  • "Label: State media" — disclosure of institutional origin
  • "Synthetic media" — broad labeling of AI-created content

Labeling goals and tradeoffs

Research reveals a critical tension between two distinct labeling objectives:

  1. Process disclosure (what was the content's origin?) — best served by labels explicitly mentioning AI or editing method
  2. Impact disclosure (is the content potentially misleading?) — best served by labels indicating potential harmfulness or falsehood

These goals are not aligned. A single label cannot optimize for both simultaneously. Epstein et al. (2023) demonstrates this tradeoff empirically: "AI Generated" performs well at identifying AI-created content but poorly at identifying misleading content; "Deepfake" performs well at identifying misleading content but people interpret it as inherently falsehood rather than as a process disclosure.

Effectiveness mechanisms

Labels influence user behavior through several psychological mechanisms:

  • Direct correction: Labels provide explicit evaluative information (this is false), triggering belief revision
  • Salience: Labels make content attributes cognitively salient, triggering deliberate reasoning
  • Heuristic use: Users rely on labels as a shortcut for veracity assessment
  • Reputation concerns: Users avoid sharing labeled content to protect personal reputation
  • Trust in source: Label effectiveness depends on user trust in the labeling source (platform, fact-checker, community)

Empirical findings on effectiveness

  • Fact-checking labels: Martel & Rand (2024) meta-analysis of 21 experiments shows warning labels reduce false belief by 27.6% on average and sharing by 24.7%, with effects persisting even among those distrusting fact-checkers.
  • AI-generated content labels: Péloquin-Skulski et al. (2025) shows labeling AI-generated images successfully reduces perceived authenticity but produces unintended spillover: labeled content is less believed, even when true, and unlabeled content appears more authentic by contrast (implied authenticity effect).
  • Implied truth effect: Pennycook et al. (2020) demonstrates that labeling some false claims can increase belief in unlabeled false claims, as users infer that unlabeled content has been verified.

Design considerations

Label effectiveness depends on multiple design factors:

  • Clarity: Whether the label is understood to mean what the policy intends
  • Placement: Proximity to content, size, and salience influence attention
  • Source attribution: Who is making the claim (platform, fact-checker, crowd) affects credibility
  • Specificity: Generic labels ("disputed") vs. specific explanations ("rated false: no evidence for this claim")
  • Visual design: Color, icon, framing affect user response
  • Asymmetry: Selective labeling (warnings on some but not all false claims) creates inference effects

Challenges and limitations

  • Coverage: Fact-checkers and platforms cannot label all misinformation; ~59% of false COVID-19 claims on Twitter went unlabeled
  • Speed: Labels applied after widespread circulation reduce effectiveness
  • Partisan backlash: Labels perceived as biased or politically motivated may trigger reactance
  • Measurement: Labeling effectiveness varies widely by content type, demographic, and context; meta-analyses document substantial heterogeneity
  • Cultural variation: Term interpretation differs across languages and cultures; 2023-epstein-ai-generated-labeling documents that "Artificial" carries different connotations in China vs. Western countries
  • Unintended consequences: Labels intended to reduce belief in false claims may inadvertently increase belief in unlabeled content or reduce belief in true claims when labels target AI-generation rather than falsehood

Policy and platform implementation

Different platforms implement labels with varying designs:

  • Facebook: "Rated false," "Rated partly false," "Missing context" linked to full fact-checks; algorithmically reduced distribution
  • Twitter/X: "Community Notes" with crowdsourced verification; "Fact-checked" labels
  • YouTube: Information panels linking to Wikipedia or fact-checking organizations
  • TikTok: "Fact-checked" labels with external links

Variation in design affects both user comprehension and effectiveness, though research on optimization remains limited.

Key papers

  • Wittenberg et al. (2025) — Two pre-registered experiments (N=7,579) systematically comparing five label types on AI-generated visual misinformation: process-based ("AI-Generated," "Artificial," "Manipulated") versus harm-based ("False," "Misleading"); finds all labels reduce belief but engagement effects differ—process-based labels primarily inform about origin with minimal behavioral impact, while harm-based labels reduce both belief and engagement; demonstrates that labeling goal determines optimal design.
  • 2023-epstein-ai-generated-labeling — Cross-cultural study testing nine labels for AI-generated content; demonstrates process-focused vs. impact-focused labeling goals require different terminology; identifies cultural differences in term interpretation.
  • Péloquin-Skulski et al. (2025) — Tests labeling of AI-generated media; demonstrates intended and unintended consequences; identifies implied authenticity effect where unlabeled content appears more authentic.
  • Martel & Rand (2024) — Meta-analysis of warning labels showing consistent effectiveness across populations including low-trust groups.
  • Epstein et al. (2021) — Tests whether explanations paired with warning labels increase effectiveness; finds explanations increase impact through improved process understanding.
  • Pennycook et al. (2020) — Demonstrates implied truth effect where labeling subset of false claims increases belief in unlabeled false claims.
  • Martel & Rand (2023) — Comprehensive review synthesizing evidence on warning label effectiveness across design variations.

Papers on this topic