DEV Community

Faktoskop.pl
Faktoskop.pl

Posted on

The cynicism trap: when teaching people to spot manipulation backfires


There is a failure mode in media literacy education that I have not seen discussed much, and it is the one I worry about most in the category of tools I work on.

Teach someone to recognise manipulation techniques and one of two things happens. Either they become a better reader, or they become someone who believes nothing. The second outcome is more common than the field acknowledges, and it is arguably worse than the original condition.

Why "trust nothing" is not an improvement

A reader who believes everything is exploitable by anyone. A reader who believes nothing is exploitable by whoever appeals to their existing position, because in the absence of any means of discrimination, prior belief is what remains.

The first reader can at least be corrected by evidence. The second has a general-purpose defence against all evidence: it could be manipulated, sources can be bought, everyone has an agenda. That defence is unfalsifiable and it feels like sophistication.

This is why teaching identification alone is insufficient and possibly harmful. You have given someone a set of tools for dismissing texts and no corresponding tools for accepting them. The natural equilibrium is dismissal.

The asymmetry problem

There is a well-observed effect that makes this worse: people apply critical technique asymmetrically.

The same reader who dismantles an article that contradicts their position will accept a structurally identical article that confirms it. Not through hypocrisy — through the ordinary operation of motivated reasoning. The tools get deployed where deploying them is comfortable.

So teaching more techniques does not straightforwardly help. It gives the reader a larger arsenal to point in the direction they were already pointing.

If that is right, the bottleneck in media literacy is not identification skill. Most people can spot manipulation in texts they disagree with. The missing skill is applying the technique in the direction that costs something — and that is much harder to teach, does not fit a curriculum, and cannot be assessed with a quiz.

What might avoid the trap

I do not have a solution, but I have a design principle that seems to help: describe rather than judge.

If the output of an analysis is "this is misleading", the reader learns to categorise texts as trustworthy or not, and the categories become tribal quickly.

If the output is "these eleven claims have no attributed source", the reader learns something different: that attribution is a property texts have in degrees, that its absence is a specific and checkable thing, and that noticing it is a routine operation rather than a verdict.

The difference matters because the second framing scales to texts the reader agrees with. "Is this misleading?" is a question you ask about opponents. "Which claims here are attributed?" is a question with an answer regardless of who wrote the piece, and asking it about your own side costs less because it does not feel like an accusation.

Making the tool's limits part of the lesson

The other thing that seems to help — and this is counterintuitive from a product perspective — is showing the reader where the method fails.

An analysis tool that always produces a confident assessment teaches that confident assessment is available. One that says "this reading depends on how much text you gave me, and you gave me three paragraphs" teaches something more useful: that structural judgement is contingent, and that contingency is normal rather than a sign of failure.

We publish analyses that reflect poorly on the method alongside the ones that work, at faktoskop.pl. Not as transparency theatre — as the pedagogically important half. A reader who has seen the tool be uncertain has a model of what uncertainty looks like, which is exactly the model that cynicism lacks.

Cynicism is, at bottom, a refusal to hold degrees of confidence. Everything is either trusted or dismissed. Anything that demonstrates a middle state is working against that.

The part I am unsure about

I do not know whether this actually works. It is a design principle derived from a plausible mechanism, not a finding.

It is entirely possible that structural analysis produces its own cynicism — a reader who has counted unattributed claims in forty articles might reasonably conclude that journalism is broken, which is a sophisticated route to the same dead end.

What would settle it is longitudinal data on readers using tools of both kinds, and I am not aware of any.

Question for the community

For those working in education or in trust-and-safety: is there any evidence on whether critical-reading training changes the asymmetry, or only the volume of criticism?

Everything I can find measures whether people can identify techniques after training. Nothing I can find measures whether they identify them in material they agree with — which seems like the only measurement that would tell us if the training worked.

Top comments (0)