Dataset quality¶
A foundational but often overlooked aspect of misinformation detection research is the quality of the datasets used to train and evaluate systems. High-quality datasets have reliable labels, representative data distribution, and absence of spurious correlations that would allow models to achieve artificially high performance without learning meaningful patterns.
Quality dimensions¶
Label reliability: How consistent and accurate are the ground truth labels? Differences in annotation guidelines, annotator expertise, inter-annotator agreement rates, and presence of genuinely ambiguous cases all affect label quality.
Representativeness: Does the dataset reflect the real-world distribution of misinformation? Sampling biases (e.g., collecting only from particular outlets or time periods) can make datasets unrepresentative of actual deployment scenarios.
Spurious correlations: Many misinformation datasets contain non-content signals that correlate strongly with the true/false label—specific keywords associated with false claims, temporal patterns in how labels are distributed, or source artifacts—that allow models to achieve high accuracy without learning robust content understanding. Such models often fail to generalize.
Feasibility of evaluation: Can the claims in the dataset actually be credibly assessed for veracity? Some claims are too vague or ambiguous to reasonably fact-check, even with external evidence.
Key papers¶
- Thibault et al. (2025) — A Guide to Misinformation Detection Data and Evaluation: Comprehensive analysis of 75 datasets assessing quality across spurious keyword correlations, temporal correlations, and feasibility dimensions; shows that many widely-used datasets have significant quality issues.
- Pulastya et al. (2021) — Assessing the Quality of the Datasets by Identifying Mislabeled Samples: Proposes automated techniques for identifying mislabeled data points in training datasets.
- Waseem (2016) — Are You a Racist or Am I Seeing Things? Annotator Influence on Hate Speech Detection on Twitter: Demonstrates that annotation quality and annotator expertise significantly impact downstream model performance.
Related topics¶
- Datasets and benchmarks
- Label noise — systematic errors in labels
- Label quality — reliability and consistency of annotations
- Evaluation methodology — proper assessment of dataset and method performance