David RandContributions
- Directly tests the identity-congruence hypothesis: whether connecting accuracy to conservative identity, patriotism, religious values, and respect for tradition increases both accuracy motivation and accuracy performance
- Demonstrates a dissociation between self-reported accuracy values and actual accuracy judgments in headline evaluation
- Provides empirical evidence that increased accuracy motivation (correlational) does not translate to improved truth discernment (causal)
- Contributes to understanding of the limits of values-based misinformation interventions among politically polarized populations
Method
A two-condition survey experiment randomized 2,009 self-identified conservative Republicans (recruited from MTurk and CloudResearch panels, mean age 41, 51% female, 82% White) to treatment or control. The treatment essay, titled "Truth, an American Value," connected the acceptance of accurate information and rejection of falsehoods to conservative political values—patriotism, respect for tradition, religious purity, and group loyalty. The essay included biblical and patriotic rhetoric emphasizing the moral obligation to seek and defend truth even when it feels uncomfortable. The control essay presented the same length but concerned a neutral, non-political topic (necktie-related facts).
Participants then rated 20 actual news headlines (10 true, 10 false, equally split between politically concordant and discordant) on a 4-point accuracy scale (1 = Not at all accurate, 4 = Very accurate). Headlines varied on both veracity (true/false) and political lean (concordant with Republican ideology vs. discordant).
Separately, participants completed a 12-item "importance of accuracy" scale measuring self-reported value placed on accuracy, including dimensions like importance of rejecting false information and accepting true information even if ideologically incongruent.
Results
Manipulation check (Finding 1): The treatment successfully increased reported value of accuracy (b = 2.08, 95% CI [1.03, 3.13], p < .001, Cohen's d = −0.173), replicating prior work showing identity-consistent framing can boost accuracy motivation.
Null causal effect on accuracy judgments (Finding 2, Finding 3): Despite increasing accuracy value, the treatment had no significant effect on actual headline accuracy ratings. The interaction between treatment and headline veracity was non-significant (b = −0.01, p = .704), and there was no significant three-way interaction with political concordance (b = 0.03, p = .342). These null results held with and without demographic controls.
Correlational evidence (Finding 1): Correlational analysis revealed that participants who reported higher accuracy values were significantly less likely to believe false headlines (b = −0.252, 95% CI [−.288, −.215], p < .001). This positive correlation between motivation and accuracy held even when constraining to the control condition (b = −0.203, p < .001).
Interpretation: The dissociation suggests one of several mechanisms: (1) Accuracy motivation may be only correlational, driven by unmeasured cognitive ability or deliberative capacity; (2) the intervention may have increased demand characteristics or social desirability responding without affecting actual cognition; (3) demand may insufficiently bridge the gap between stated values and actual accuracy judgments.
Notes
Strength: Pre-registered design with a large, well-powered sample; clear, well-motivated intervention rooted in theory; extensive supplementary analyses; data publicly available. The dissociation between self-reported accuracy values and actual performance is a key contribution.
Limitations: Study limited to conservative Republicans; it is unclear whether results generalize to Democrats or mixed ideological samples (though prior evidence suggests similar partisan asymmetries in motivational interventions). The null result on accuracy judgments does not rule out that different or stronger identity-based framing could succeed. The short timeframe (single session) may not capture effects on long-term belief change. The study provides no mechanism for the treatment's failure—whether the problem is insufficient value-translation, demand characteristics, or omitted variables remains unclear.
Theoretical implications: Challenges the motivational account of political misinformation susceptibility; suggests that directional motives (identity protection) may override or operate independently of accuracy motivation even when values are made salient. Consistent with accounts emphasizing lazy rather than biased reasoning, or capacity constraints in deliberation. Also consistent with the "fluency" and "coherence" mechanisms Pennycook and Rand identify as drivers of fake news belief, which may be harder to override with values-framing than with attention-redirection.
Practical implications: Values-congruent messaging, a common approach in persuasion, may not be an effective strategy for combating partisan misinformation. Suggests that interventions targeting accuracy motivation (rather than capacity or attention) may be less promising than those targeting deliberative accuracy assessment.