Skip to content

Inside the bizarre world of internet trolls and propagandists

2019
Open on YouTube

In brief

Journalist Andrew Marantz spent three years investigating propagandists and online extremists, tracing how fringe conspiracy theories and hate speech go viral on social media platforms. He exposes how social media algorithms optimized for engagement enable propagandists to leverage emotion over truth, and documents the pipeline through which alienated users encounter extremist content and become radicalized. He argues that platform architecture, not individual psychology, is the primary driver of online toxicity, and calls for algorithmic reform alongside cultural change—particularly efforts to make decency rather than outrage the default online.

Summary figure for Inside the bizarre world of internet trolls and propagandists

Key claims

  • Propagandists are ordinary people with simple tools: The propagandist Marantz documented was a lawyer using a laptop, phone, and iPad—not a tech prodigy or foreign operative—yet successfully propelled fringe talking points into mainstream political discourse through coordinated social media tactics.
  • Algorithms reward emotion over truth: Social media platforms optimize for engagement (clicks, comments, shares) rather than veracity. Emotional content—positive or negative—drives engagement far more than factual content, creating incentives to spread extreme narratives.
  • Conspiracy theories travel through emotion: When a bomb exploded in New York, the propagandist immediately connected it to immigration despite the suspect being an American citizen—using the emotional moment to promote his pre-existing agenda regardless of factual accuracy.
  • Coordinated hashtag manipulation: Propagandists recruit followers to trend specific hashtags and amplify conspiracy narratives like George Soros's alleged control of global affairs—leveraging the network effect to manufacture artificial consensus.
  • Radicalization pipeline in online communities: Isolated individuals retreat to Reddit, 4chan, and other message boards where extreme content is normalized and positively reinforced. Users start with "ironic" posts, then internalize extremist ideology after repeated exposure and validation.
  • Case study: rapid radicalization trajectory: A young woman moved to a new city, felt alienated, and spent months in extremist online spaces before marching with white supremacists in Charlottesville—illustrating how algorithms and communities can accelerate someone from political disengagement to violent extremism within months.
  • Online-to-offline amplification: Content born in online fringe spaces now appears in mainstream media ads, political speeches, and tweets from elected officials, showing the collapse of boundaries between "fringe" and "mainstream."
  • Smart vs. dumb skepticism: Marantz distinguishes between genuine critical thinking (questioning claims, demanding evidence) and reflexive contrarianism that rejects established truth (flat earth, denialism) as a performance of independence. He warns that many young men adopt the latter under the guise of free thought.
  • Platform responsibility is non-negotiable: Social networks must stop optimizing for maximum emotional engagement if that engagement actively harms society. This is a business decision, not a free speech issue.

Notes

Marantz's three-year ethnographic investigation captures an understudied dimension of online information operations: the role of individual propagandists who, armed with basic social-media literacy and emotional manipulation skills, can achieve massive amplification without state backing or sophisticated technical infrastructure. His insight that propagandists don't necessarily believe their own claims—they are rationally optimizing for attention—reframes radicalization not as ideological conversion but as a game with algorithmic incentives.

The talk's emphasis on algorithm-driven virality rather than individual persuasion shifts responsibility away from individual critical thinking ("just fact-check more") and toward platform architecture. His point that social media platforms distinguish neither between truth and falsehood nor between what's prosocial and antisocial remains acutely relevant: the same affordances that enable good activism enable hate speech and conspiracy.

Marantz is careful to avoid false balance ("let's understand both sides equally") while insisting on understanding propagandist tactics as a precondition for defense. His framework—that we need platform reform, cultural shifts to make decency cool again, and better pathways for at-risk users—offers a multi-level approach that goes beyond individual blame or technological determinism.

Similar papers

Summarized from the full text. Added 2026-11-09 from a submission by reza. Every statement on this page traces back to the source.