A mockup illustrating two posts in a feed: one is labelled as "misleading" whereas the one beneath it has a less severe label of "Stay informed".

Fact checking labels

Reducing the spread of misleading content

Our Confidence Rating

Tentative

Share This Intervention

What It Is

Any label or text directly pointing out that content is potentially false based on fact-checker assessments

Civic Signal Being Amplified

Understand
:
Show reliable information

When To Use It

Interactive

What Is Its Intended Impact

Reduce belief in and willingness to spread misleading or false content.

Evidence That It Works

Evidence That It Works

Across a number of survey experiment studies, researchers find mixed evidence that labeling misleading content with warnings based on professional fact-checkers' evaluations - for example “Disputed,” “Rated false,” or “False information checked by independent fact-checkers” - can reduce participants' willingness to share misinformation. Labels should also be used carefully as several studies suggest they have potential to backfire.

In one survey experiment, Mena (2020) found subjects were less likely to say they would share false news stories when they were labeled “Disputed by Snopes.com and PolitiFact”. (Note: All effects we include are statistically significant, unless otherwise stated.) Koch et al. (2023) likewise observed that embedding fact-check labels in a survey experiment reduced participants’ intentions of amplying (sharing or liking) flagged content. And Martel & Rand (2023) saw the same pattern in their analysis of 11 survey experiments conducted by their research lab; participants were less likely to say they would share stories that were labeled "False Information. Checked by independent fact-checkers". In a final experiment conducted on Facebook Messenger, however, Offer-Westort et al. (2023) observed no discernable effects of fact-checking labels on subjects' willingness to share false news posts either privately on Messenger or publicly on their Facebook feeds, whereas the researchers did by comparison see significant positive effects of "accuracy nudges". This final study was conducted in both a more ecologically valid setting and with users from the Global South (Nigeria and Kenya), and so calls into question the generalizability of the studies above.

There may be several other limitations to using fact-checking labels. One is the so-called implied truth effect: the presence of warnings on some news headlines implies to some participants that unlabeled content is more likely to be true (Pennycook et al., 2020). In contrast to the implied truth effect, other research suggests that because false news is extremely rare compared to true news, the presence of warnings may actually have the opposite effect, namely increasing general skepticism about all news (Hoes et al., 2023; van der Meer et al., 2023). Taken together, evidence suggests that labels may have negative indirect effects on unlabeled content, but that these effects may depend on the prevalence of false content.

In sum, there is mixed evidence of the effectiveness of fact-checking labels on reducing the spread of misinformation.  Labels may also have the undesirable indirect effect that, depending on the prevalence of fake news, they either increase the credibility of potentially false but unlabeled content (implied truth effect) or increase general skepticism toward all news.

Why It Matters

Since social media users often do not investigate the truth of headlines and claims they see in their feeds, it is helpful to provide users with additional information to reduce the likelihood they will spread false news.

Special Considerations

In this review we focus on the effectiveness of fact-checking labels on reducing the spread of misinformation and find mixed evidence. While not discussed here, there may however be evidence that labels reduce belief in false news (Clayton et al., 2020; Gaozhao, 2021, Porter & Wood, 2022).

Examples

This intervention entry currently lacks photographic evidence (screencaps, &c.)

Citations

Real Solutions for Fake News? Measuring the Effectiveness of General Warnings and Fact‑Check Tags in Reducing Belief in False Stories on Social Media

Authors

Katherine Clayton, Spencer Blair, Jonathan Busam, Samuel Forstner, & al.

Journal

Political Behavior

Date Published

December 15, 2020

Paper ID (DOI, arXIV, &c.)

10.1007/s11109-019-09533-0

The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings

Authors

Gordon Pennycook, Adam Bear, Evan T. Collins, David G. Rand

Journal

Management Sciences

Date Published

February 21, 2020

Paper ID (DOI, arXIV, &c.)

10.2139/ssrn.3035384

Flagging fake news on social media: An experimental study of media consumers' identification of fake news.

Authors

Dongfang Gaozhao

Journal

Government Information Quarterly

Date Published

July 1, 2021

Paper ID (DOI, arXIV, &c.)

https://doi.org/10.1016/j.giq.2021.101591

Cleaning up social media: The effect of warning labels on likelihood of sharing false news on Facebook

Authors

Paul Mena

Journal

Policy & internet

Date Published

July 28, 2019

Paper ID (DOI, arXIV, &c.)

Political Misinformation and Factual Corrections on the Facebook News Feed: Experimental Evidence.

Authors

Ethan Porter and Thomas J. Wood

Journal

The Journal of Politics

Date Published

Paper ID (DOI, arXIV, &c.)

Prominent Misinformation Interventions Reduce Misperceptions but Increase Skepticism

Authors

Emma Hoes, Brian Aitken, Jingwen Zhang, Tomasz Gackowski, and Magdalena Wojcieszak

Journal

ArXiV

Date Published

Paper ID (DOI, arXIV, &c.)

Effects of fact‐checking warning labels and social endorsement cues on climate change fake news credibility and engagement on social media.

Authors

Koch, T. K., Frischlich, L., & Lermer, E.

Journal

Journal of Applied Social Psychology

Date Published

January 19, 2023

Paper ID (DOI, arXIV, &c.)

Misinformation warning labels are widely effective: A review of warning effects and their moderating features.

Authors

Martel, C., & Rand, D. G.

Journal

Current Opinion in Psychology

Date Published

December 1, 2023

Paper ID (DOI, arXIV, &c.)

Battling the coronavirus ‘infodemic’among social media users in Kenya and Nigeria

Authors

Offer-Westort, M., Rosenzweig, L. R., & Athey, S.

Journal

Nature Human Behaviour

Date Published

March 18, 2024

Paper ID (DOI, arXIV, &c.)

Citing This Entry

Prosocial Design Network (2024). Digital Intervention Library. Prosocial Design Network [Digital resource]. https://doi.org/10.17605/OSF.IO/Q4RMB

Entry Last Modified

January 7, 2025 9:57 AM
Back to Library