A mockup of an over-the-top news headline that reads "ALIENS!". In front of it is a reminder: "If shocking claims in a headline sound unbelievable, then they probably are."

Misinformation literacy

To build resilience towards misinformation

Our Confidence Rating

Likely

Share This Intervention

What It Is

Educational content and interactive tools that teach about common misinformation strategies and fact-checking techniques.

Note on terminology: some refer to these interventions as "prebunking", which we define as content that forewarns and refutes prevalent misinformation narratives. See our Prebunking library item.

Civic Signal Being Amplified

Understand
:
Build civic competence

When To Use It

Proactive

What Is Its Intended Impact

By teaching people about misinformation and fact-checking techniques, they will be better at identifying misinformation and be less susceptible to it.

Evidence That It Works

Evidence That It Works

Several field experiments show encouraging results from educating people about misinformation and fact-checking techniques. We looked at three, discussed below; one that examines an educational game and two that look at educational videos.

Roozenbeek and van der Linden (2019) developed and studied an interactive game called “Bad News”, in which users learn about ways to create misinformation that might appeal to social media users by, for example, impersonating an authoritative figure. Participants were better able to rate misinformation as unreliable after playing the 15-minute game compared to before (average effect size: Cohen’s d = 0.52). While they observed a substantial effect size, a limitation of the study is that there is no control group to compare participants to. (Note: all results we report in this review are statistically significant, unless otherwise stated. We share results in the units reported by study authors.)

In another study, Roozenbeek et al. (2022) looked at the effectiveness of 90-second videos that taught manipulation techniques commonly used in misinformation. YouTube users were shown videos that either taught them about the use of emotional language or false dichotomies. Within 24 hours, users received a YouTube survey asking them to identify the manipulation technique in a headline. Compared to users who did not watch a video, those users were better able to identify the correct technique (Cohen’s h = 0.09).

In a third study, Bor et al., (2020) fielded an experiment in which participants watched 10-15 minute videos produced by civic organizations that highlighted anti-misinformation practices. In the subsequent week, participants who watched one of the videos shared stories from higher quality news outlets on the social media platform Twitter, compared to a control group (β = 0.19). 

Altogether, these experiments suggest that users gain knowledge about misinformation and fact-checking techniques from the educational content and are able to apply that knowledge. The experiment by Bor et al. (2020), most promisingly, shows that such knowledge can reduce how much users share and spread misinformation.

Why It Matters

While the content of misinformation may change based on current events, there are often commonalities in the strategies employed in them. By learning about these strategies and fact-checking techniques, users are better equipped to identify and handle misinformation even if their content differs.

Special Considerations

It should be noted that although there is evidence the educational games and videos above are effective, they are time-intensive interventions requiring users to spend 1.5 to 15 minutes of engagement.

Examples

This intervention entry currently lacks photographic evidence (screencaps, &c.)

Citations

Fake news game confers psychological resistance against online misinformation

Authors

Jon Roozenbeek, Sander van der Linden

Journal

Palgrave Communications

Date Published

June 25, 2019

Paper ID (DOI, arXIV, &c.)

10.1057/s41599-019-0279-9

Psychological inoculation improves resilience against misinformation on social media

Authors

Jon Roozenbeek, Sander Van Der Linden, Beth Goldberg, Steve Rathje, Stephan Lewandowsky

Journal

Science Advances

Date Published

August 24, 2022

Paper ID (DOI, arXIV, &c.)

"Fact-checking" videos reduce belief in misinformation and improve the quality of news shared on Twitter

Authors

Alexander Bor, Mathias Osmundsen, Stig Hebbelstrup Rye Rasmussen, Anja Bechmann, Michael Bang Petersen

Journal

ArXiv

Date Published

Paper ID (DOI, arXIV, &c.)

Citing This Entry

Prosocial Design Network (2024). Digital Intervention Library. Prosocial Design Network [Digital resource]. https://doi.org/10.17605/OSF.IO/Q4RMB

Entry Last Modified

March 5, 2024 1:20 PM
Back to Library