Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation

@article{Wojcik2022BirdwatchCW,
  title={Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation},
  author={Stefan Wojcik and Sophie Hilgard and Nick Judd and Delia Mocanu and Stephen Ragain and M.B. Fallin Hunzaker and Keith Coleman and Jay Baxter},
  journal={ArXiv},
  year={2022},
  volume={abs/2210.15723}
}
We present an approach for selecting objectively informative and subjectively helpful annotations to social media posts. We draw on data from on an online environment where contributors annotate misinformation and simultaneously rate the contributions of others. Our algorithm uses a matrix-factorization (MF) based approach to identify annotations that appeal broadly across heterogeneous user groups — sometimes referred to as “bridging-based ranking.” We pair these data with a survey experiment… 
1 Citations

"Coherent Mode" for the World's Public Square

It is proposed that Twitter could adapt Birdwatch to produce maps of public opinion, using Twitter’s misinformation problem as a proving ground and activation of a deliberative system and topic selection, population sampling and the role of expert networks.

References

SHOWING 1-10 OF 52 REFERENCES

Fighting misinformation on social media using crowdsourced judgments of news source quality

It is found that laypeople—on average—are quite good at distinguishing between lower- and higher-quality sources, and having algorithms up-rank content from trusted media outlets may be a promising approach for fighting the spread of misinformation on social media.

Informed Crowds Can Effectively Identify Misinformation

The judgments of a panel of sixteen or more crowd workers were better than that of aPanel of three expert journalists, as measured by alignment with a held out journalist’s ratings.

Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteria

This work investigates news credibility assessments by crowds versus experts to understand when and how ratings between them differ, and outlines future research directions to better design crowd processes that are tailored to specific crowds and types of content.

Can The Crowd Identify Misinformation Objectively?: The Effects of Judgment Scale and Assessor's Background

This paper collects thousands of truthfulness assessments over two datasets, and compares expert judgments with crowd judgments, expressed on scales with various granularity levels, and measures the political bias and cognitive background of the workers, and their effect on the reliability of the data provided by the crowd.

The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?

Besides showing that the crowd is able to accurately judge the truthfulness of the statements, this work reports results on many different aspects, including: agreement among workers, the effect of different aggregation functions, of scales transformations, and of workers background / bias.

Birds of a feather don’t fact-check each other: Partisanship and the evaluation of news in Twitter’s Birdwatch crowdsourced fact-checking program

Contextual features – in particular, the partisanship of the users – are far more predictive of judgments than the content of the tweets and evaluations themselves.

Community-Based Fact-Checking on Twitter's Birdwatch Platform

How users interact with Twitter’s “Birdwatch” feature can help social media platforms to formulate guidelines for users on how to write more helpful fact checks and suggests that community-based fact-checking faces challenges regarding opinion speculation and polarization among the user base.

Crowdsourcing Truthfulness: The Impact of Judgment Scale and Assessor Bias

This work looks at how experts and non-expert assess truthfulness of content by focusing on the effect of the adopted judgment scale and of assessors’ own bias on the judgments they perform.

Naïve Learning in Social Networks and the Wisdom of Crowds

It is shown that all opinions in a large society converge to the truth if and only if the influence of the most influential agent vanishes as the society grows.

HawkEye: a robust reputation system for community-based counter-misinformation

HawkEye, a cold-start-aware graph-based recursive algorithm is developed and it is shown that HawkEye is more robust against adversarial manipulation and outperforms Birdwatch in identifying accurate and misleading tweets.
...