What It Is
There exist two versions of this intervention which differ by their deployment time. One version, the pre-posting intervention, is used before users post a piece of content in a form that allows replies from the community. It contains a message at the top of the comment forum that includes:
- a welcome
- a reminder of the community rules (with a link to the full set if they are long)
- a mention of how and by whom those rules will be enforced.
The other version, the post-posting intervention, is deployed after users have their content removed because of it breaking the community rules. It is a sticky post on the side of the user’s feed explaining the specific rule that led to the removal.
Civic Signal Being Amplified
When To Use It
What Is Its Intended Impact
With the pre-posting intervention, new users’ comments are more likely to follow the stated norms of the platform or community. While not directly studied, it is reasonable to assume the returning users are more likely to do so as well.
Interestingly, new users who see this are also more likely to post in general, possibly because they are more confident in their ability to say something that adheres to the group/platform norms or because they are more confident that their comments will not elicit abuse.
The post-posting intervention increases rule-breakers’ adherence to the forum rules for the next content posts they contributed to the forum.
Evidence That It Works
Evidence That It Works
Pre-posting intervention
Matias (2019) ran a large-scale field experiment on the Reddit sub (community) r/science in which randomly assigned posts were given an intervention like the one described here. Posts that received the intervention were:
- 8% more likely to have have comments from new users follow the community’s rules
- 70% more likely to have new users comment on the thread
It’s worth noting that the community rules for r/science were unusually strict (for example, during the course of the study, no personal anecdotes were allowed) and deviation from them by newcomers was previously unusually high.
In a related study (Kim et al., 2022) conducted in collaboration with Nextdoor, 312 new groups were randomly assigned either to present users "group guidelines" before joining the group or to present no guidelines. Groups with guidelines had significantly fewer comments reported for abuse (0.3% compared to 0.7%), providing more evidence that posting norms discourages toxic behavior.
Post-posting intervention
Tyler et al. (2021) ran a large-scale field experiment on Facebook. They showed that transparency about the rules, in the form of a sticky note on the feed after users had their content removed, increased their adherence to rules.
Specifically this intervention:
- Decreased recidivism to unwanted content
- Decreased the submitted appeals against the removal
- Increased the overturn rate of appeals submitted
- Increased the transparency users reported regarding the removal process
Why It Matters
Special Considerations
In Matias' (2019) study, the fact that the increase in new users posting is larger than the increase in rule-abiding by new users may paradoxically create a higher overall number of non-rule abiding posts (and therefore a higher workload for moderators).
Further studies could be warranted to disaggregate which parts of this intervention are most effective in producing better norm-adherence or (if desired) increased participation of new users.
Tyler et al.’s (2021) study focused on specific content removal transparency (i.e., content removal due to nudity). Further research would need to generalize the intervention's effect to other topics of removal in online forums.