Quantifying collective intelligence in human groups

@article{Riedl2021QuantifyingCI,
  title={Quantifying collective intelligence in human groups},
  author={Christoph Riedl and Young Ji Kim and Pranav Gupta and Thomas W. Malone and Anita Williams Woolley},
  journal={Proceedings of the National Academy of Sciences},
  year={2021},
  volume={118}
}
Significance Collective intelligence (CI) is critical to solving many scientific, business, and other problems. We find strong support for a general factor of CI using meta-analytic methods in a dataset comprising 22 studies, including 5,279 individuals in 1,356 groups. CI can predict performance in a range of out-of-sample criterion tasks. CI, in turn, is most strongly predicted by group collaboration process, followed by individual skill and group composition. The proportion of women in a… 

Figures from this paper

Translating Member Ability Into Group Brainstorming Performance: The Role of Collective Intelligence
In investigating how member ability is translated into group brainstorming performance, it was predicted that a group’s collective intelligence (CI) would enable it to capitalize on member ability
Collective Attention and Collective Intelligence: The Role of Hierarchy and Team Gender Composition
Collective intelligence (CI) captures a team’s ability to work together across a wide range of tasks and can vary significantly between teams. Extant work demonstrates that the level of collective
Transactive Systems Model of Collective Intelligence: The Emergence and Regulation of Collective Attention, Memory, and Reasoning.
TLDR
This dissertation argues that collectives facing dynamic, high complexity situations need to be designed for collective intelligence, or the ability to achieve goals in a wide range of environments, and theorizes a Transactive Systems Model of Collective Intelligence, guided by agent-based modeling, and test it with data from open-source software teams.
An Active Inference Model of Collective Intelligence
TLDR
This paper uses the Active Inference Formulation (AIF), a framework for explaining the behavior of any non-equilibrium steady state system at any scale, to posit a minimal agent-based model that simulates the relationship between local individual-level interaction and collective intelligence.
Articulating the Role of Artificial Intelligence in Collective Intelligence: A Transactive Systems Framework
  • Pranav GuptaA. Woolley
  • Computer Science, Biology
    Proceedings of the Human Factors and Ergonomics Society Annual Meeting
  • 2021
TLDR
A socio-cognitive architecture is described that conceptualizes how boundedly rational individuals coordinate their cognitive resources and diverse goals to accomplish joint action and articulates the inter-member processes underlying the emergence of collective memory, attention, and reasoning, which are fundamental to intelligence in any system.
Overcoming Individual Limitations Through Distributed Computation: Rational Information Accumulation in Multigenerational Populations
TLDR
It is shown that information accumulation in multigenerational social networks can be produced by a form of distributed Bayesian inference that allows individuals to benefit from the experience of previous generations while expending little cognitive effort.
Collective Intelligence as Infrastructure for Reducing Broad Global Catastrophic Risks
TLDR
It is argued that improving CI can improve general resilience against a wide variety of risks, and given the priority of GCR mitigation, CI research can benefit from developing concrete, practical applications to global risks.
Beyond IQ: The Importance of Metacognition for the Promotion of Global Wellbeing
Global policy makers increasingly adopt subjective wellbeing as a framework within which to measure and address human development challenges, including policies to mitigate consequential societal
A Test for Evaluating Performance in Human-Computer Systems
TLDR
This work shows how to perform a Turing test for comparing computer performance to that of humans using the ratio of means as a measure of effect size, and shows that 50 human non- programmers using GPT-3 can perform the task about as well as–and less expensively than–the human programmers.
Shaping student confidence and their perception of learning in undergraduate chemistry and biochemistry courses
This study examined factors influencing student confidence and their perception of learning in the context of undergraduate chemistry and biochemistry courses. Anonymous online surveys were used to
...
...

References

SHOWING 1-10 OF 45 REFERENCES
Evidence for a Collective Intelligence Factor in the Performance of Human Groups
TLDR
A psychometric methodology for quantifying a factor termed “collective intelligence” (c), which reflects how well groups perform on a similarly diverse set of group problem-solving tasks, and finds converging evidence of a general collective intelligence factor that explains a group’s performance on a wide variety of tasks.
Collective Intelligence in Computer-Mediated Collaboration Emerges in Different Contexts and Cultures
TLDR
The CI metric provides a generalizable performance measure for groups that is robust to broad changes in media, context, and culture, making it useful for testing the effects of general-purpose collaboration technologies intended to improve group performance.
The Insensitive Ruins It All: Compositional and Compilational Influences of Social Sensitivity on Collective Intelligence in Groups
TLDR
The empirical results indicate that collectively intelligent groups are those in which the least socially sensitive group member has a rather high score on social sensitivity, and (socially sensitive) group members cannot compensate for the lack of social sensitivity of the other group members.
How intermittent breaks in interaction improve collective intelligence
TLDR
It is shown that when social influence is intermittent it provides the benefits of constant social influence without the costs, and storing subjects’ best solutions so that they could be reloaded and possibly modified in subsequent rounds is similar to constantSocial influence.
Not As Smart As We Think: A Study of Collective Intelligence in Virtual Groups
TLDR
The results of this study studied groups that used computer-mediated communication to investigate whether collective intelligence is similar or different when groups work using CMC, suggesting that collective intelligence manifests itself differently depending on context.
The Impact of Cognitive Style Diversity on Implicit Learning in Teams
TLDR
Understanding is advanced of the implications of cognitive diversity for organizations and why some teams demonstrate high levels of team learning in dynamic situations while others do not, and a mechanism guiding the indirect relationship between cognitive style diversity and team learning is identified.
Reading the Mind in the Eyes or Reading between the Lines? Theory of Mind Predicts Collective Intelligence Equally Well Online and Face-To-Face
TLDR
A collective intelligence factor characterizes group performance approximately as well for online groups as for face-to-face groups; and surprisingly, the ToM measure is equally predictive of collective intelligence in both face- to-face and online groups, even though the online groups communicate only via text and never see each other at all.
In Search of Synergy in Small Group Performance
1. Introduction: Mapping the Territory. 2. Tasks: What Groups Do. 3. Idea Generation: Creative Thinking in Groups. 4. Problem Solving: Performing Tasks with Correct Solutions. 5. Judgment Calls:
...
...