Quantifying collective intelligence in human groups.
Ontology highlight
ABSTRACT:
SUBMITTER: Riedl C
PROVIDER: S-EPMC8166150 | biostudies-literature | 2021 May
REPOSITORIES: biostudies-literature
Publications
Quantifying collective intelligence in human groups.
Riedl Christoph C Kim Young Ji YJ Gupta Pranav P Malone Thomas W TW Woolley Anita Williams AW
Proceedings of the National Academy of Sciences of the United States of America 20210501 21
Collective intelligence (CI) is critical to solving many scientific, business, and other problems, but groups often fail to achieve it. Here, we analyze data on group performance from 22 studies, including 5,279 individuals in 1,356 groups. Our results support the conclusion that a robust CI factor characterizes a group's ability to work together across a diverse set of tasks. We further show that CI is predicted by the proportion of women in the group, mediated by average social perceptiveness ...[more]
Similar Datasets
Project description:Collective intelligence refers to the ability of groups to outperform individual decision-makers. At present, relatively little is known about the mechanisms promoting collective intelligence in natural systems. We here test a novel mechanism generating collective intelligence: self-organization according to information quality. We tested this mechanism by performing simulated predator detection experiments using human groups. By continuously tracking the personal information of all members prior to collective decisions, we found that individuals adjusted their response time during collective decisions to the accuracy of their personal information. When individuals possessed accurate personal information, they decided quickly during collective decisions providing accurate information to the other group members. By contrast, when individuals had inaccurate personal information, they waited longer, allowing them to use social information before making a decision. Individuals deciding late during collective decisions had an increased probability of changing their decision leading to increased collective accuracy. Our results thus show that groups can self-organize according to the information accuracy of their members, thereby promoting collective intelligence. Interestingly, we find that individuals flexibly acted both as leader and as follower depending on the quality of their personal information at any particular point in time.
| S-EPMC4807439 | biostudies-literature
Project description:Studies of collective intelligence in animal groups typically overlook potential improvement through learning. Although knowledge accumulation is recognized as a major advantage of group living within the framework of Cumulative Cultural Evolution (CCE), the interplay between CCE and collective intelligence has remained unexplored. Here, we use homing pigeons to investigate whether the repeated removal and replacement of individuals in experimental groups (a key method in testing for CCE) alters the groups' solution efficiency over successive generations. Homing performance improves continuously over generations, and later-generation groups eventually outperform both solo individuals and fixed-membership groups. Homing routes are more similar in consecutive generations within the same chains than between chains, indicating cross-generational knowledge transfer. Our findings thus show that collective intelligence in animal groups can accumulate progressive modifications over time. Furthermore, our results satisfy the main criteria for CCE and suggest potential mechanisms for CCE that do not rely on complex cognition.
| S-EPMC5399285 | biostudies-literature
Project description:An important potential advantage of group-living that has been mostly neglected by life scientists is that individuals in animal groups may cope more effectively with unfamiliar situations. Social interaction can provide a solution to a cognitive problem that is not available to single individuals via two potential mechanisms: (i) individuals can aggregate information, thus augmenting their 'collective cognition', or (ii) interaction with conspecifics can allow individuals to follow specific 'leaders', those experts with information particularly relevant to the decision at hand. However, a-priori, theory-based expectations about which of these decision rules should be preferred are lacking. Using a set of simple models, we present theoretical conditions (involving group size, and diversity of individual information) under which groups should aggregate information, or follow an expert, when faced with a binary choice. We found that, in single-shot decisions, experts are almost always more accurate than the collective across a range of conditions. However, for repeated decisions - where individuals are able to consider the success of previous decision outcomes - the collective's aggregated information is almost always superior. The results improve our understanding of how social animals may process information and make decisions when accuracy is a key component of individual fitness, and provide a solid theoretical framework for future experimental tests where group size, diversity of individual information, and the repeatability of decisions can be measured and manipulated.
| S-EPMC2991365 | biostudies-literature
Project description:The exploration-exploitation dilemma is a recurrent adaptive problem for humans as well as non-human animals. Given a fixed time/energy budget, every individual faces a fundamental trade-off between exploring for better resources and exploiting known resources to optimize overall performance under uncertainty. Colonies of eusocial insects are known to solve this dilemma successfully via evolved coordination mechanisms that function at the collective level. For humans and other non-eusocial species, however, this dilemma operates within individuals as well as between individuals, because group members may be motivated to take excessive advantage of others' exploratory findings through social learning. Thus, even though social learning can reduce collective exploration costs, the emergence of disproportionate "information scroungers" may severely undermine its potential benefits. We investigated experimentally whether social learning opportunities might improve the performance of human participants working on a "multi-armed bandit" problem in groups, where they could learn about each other's past choice behaviors. Results showed that, even though information scroungers emerged frequently in groups, social learning opportunities reduced total group exploration time while increasing harvesting from better options, and consequentially improved collective performance. Surprisingly, enriching social information by allowing participants to observe others' evaluations of chosen options (e.g., Amazon's 5-star rating system) in addition to choice-frequency information had a detrimental impact on performance compared to the simpler situation with only the choice-frequency information. These results indicate that humans groups can handle the fundamental "dual exploration-exploitation dilemmas" successfully, and that social learning about simple choice-frequencies can help produce collective intelligence.
| S-EPMC3995913 | biostudies-literature
Project description:Collective intelligence is the ability of a group to perform more effectively than any individual alone. Diversity among group members is a key condition for the emergence of collective intelligence, but maintaining diversity is challenging in the face of social pressure to imitate one's peers. Through an evolutionary game-theoretic model of collective prediction, we investigate the role that incentives may play in maintaining useful diversity. We show that market-based incentive systems produce herding effects, reduce information available to the group, and restrain collective intelligence. Therefore, we propose an incentive scheme that rewards accurate minority predictions and show that this produces optimal diversity and collective predictive accuracy. We conclude that real world systems should reward those who have shown accuracy when the majority opinion has been in error.
| S-EPMC5441831 | biostudies-literature
Project description:Online social media are increasingly facilitating our social interactions, thereby making available a massive "digital fossil" of human behavior. Discovering and quantifying distinct patterns using these data is important for studying social behavior, although the rapid time-variant nature and large volumes of these data make this task difficult and challenging. In this study, we focused on the emergence of "collective attention" on Twitter, a popular social networking service. We propose a simple method for detecting and measuring the collective attention evoked by various types of events. This method exploits the fact that tweeting activity exhibits a burst-like increase and an irregular oscillation when a particular real-world event occurs; otherwise, it follows regular circadian rhythms. The difference between regular and irregular states in the tweet stream was measured using the Jensen-Shannon divergence, which corresponds to the intensity of collective attention. We then associated irregular incidents with their corresponding events that attracted the attention and elicited responses from large numbers of people, based on the popularity and the enhancement of key terms in posted messages or "tweets." Next, we demonstrate the effectiveness of this method using a large dataset that contained approximately 490 million Japanese tweets by over 400,000 users, in which we identified 60 cases of collective attentions, including one related to the Tohoku-oki earthquake. "Retweet" networks were also investigated to understand collective attention in terms of social interactions. This simple method provides a retrospective summary of collective attention, thereby contributing to the fundamental understanding of social behavior in the digital era.
| S-EPMC3640043 | biostudies-literature
Project description:In recent years, individual and collective human intelligence, defined as the knowledge, skills, reasoning and intuition of individuals and groups, have been used in combination with computer algorithms to solve complex scientific problems. Such approach was successfully used in different research fields such as: structural biology, comparative genomics, macromolecular crystallography and RNA design. Herein we describe an attempt to use a similar approach in small-molecule drug discovery, specifically to drive search strategies of de novo drug design. This is assessed with a case study that consists of a series of public experiments in which participants had to explore the huge chemical space in silico to find predefined compounds by designing molecules and analyzing the score associate with them. Such a process may be seen as an instantaneous surrogate of the classical design-make-test cycles carried out by medicinal chemists during the drug discovery hit to lead phase but not hindered by long synthesis and testing times. We present first findings on (1) assessing human intelligence in chemical space exploration, (2) comparing individual and collective human intelligence performance in this task and (3) contrasting some human and artificial intelligence achievements in de novo drug design.
| S-EPMC8507178 | biostudies-literature
Project description:A major problem resulting from the massive use of social media is the potential spread of incorrect information. Yet, very few studies have investigated the impact of incorrect information on individual and collective decisions. We performed experiments in which participants had to estimate a series of quantities, before and after receiving social information. Unbeknownst to them, we controlled the degree of inaccuracy of the social information through 'virtual influencers', who provided some incorrect information. We find that a large proportion of individuals only partially follow the social information, thus resisting incorrect information. Moreover, incorrect information can help improve group performance more than correct information, when going against a human underestimation bias. We then design a computational model whose predictions are in good agreement with the empirical data, and sheds light on the mechanisms underlying our results. Besides these main findings, we demonstrate that the dispersion of estimates varies a lot between quantities, and must thus be considered when normalizing and aggregating estimates of quantities that are very different in nature. Overall, our results suggest that incorrect information does not necessarily impair the collective wisdom of groups, and can even be used to dampen the negative effects of known cognitive biases.
| S-EPMC7536058 | biostudies-literature
Project description:Collective dynamics emerge from countless individual decisions. Yet, we poorly understand the processes governing dynamically-interacting individuals in human collectives under realistic conditions. We present a naturalistic immersive-reality experiment where groups of participants searched for rewards in different environments, studying how individuals weigh personal and social information and how this shapes individual and collective outcomes. Capturing high-resolution visual-spatial data, behavioral analyses revealed individual-level gains-but group-level losses-of high social information use and spatial proximity in environments with concentrated (vs. distributed) resources. Incentivizing participants at the group (vs. individual) level facilitated adaptation to concentrated environments, buffering apparently excessive scrounging. To infer discrete choices from unconstrained interactions and uncover the underlying decision mechanisms, we developed an unsupervised Social Hidden Markov Decision model. Computational results showed that participants were more sensitive to social information in concentrated environments frequently switching to a social relocation state where they approach successful group members. Group-level incentives reduced participants' overall responsiveness to social information and promoted higher selectivity over time. Finally, mapping group-level spatio-temporal dynamics through time-lagged regressions revealed a collective exploration-exploitation trade-off across different timescales. Our study unravels the processes linking individual-level strategies to emerging collective dynamics, and provides tools to investigate decision-making in freely-interacting collectives.
| S-EPMC10973496 | biostudies-literature
Project description:BACKGROUND:Innovative ways of planning and conducting research have emerged recently, based on the concept of collective intelligence. Collective intelligence is defined as shared intelligence emerging when people are mobilized within or outside an organization to work on a specific task that could result in more innovative outcomes than those when individuals work alone. Crowdsourcing is defined as "the act of taking a job traditionally performed by a designated agent and outsourcing it to an undefined, generally large group of people in the form of an open call." OBJECTIVE:This qualitative study aimed to identify the barriers to mobilizing collective intelligence and ways to overcome these barriers and provide good practice advice for planning and conducting collective intelligence projects across different research disciplines. METHODS:We conducted a multinational online open-ended question survey and semistructured audio-recorded interviews with a purposive sample of researchers who had experience in running collective intelligence projects. The questionnaires had an interactive component, enabling respondents to rate and comment on the advice of their fellow respondents. Data were analyzed thematically, drawing on the framework method. RESULTS:A total of 82 respondents from various research fields participated in the survey (n=65) or interview (n=17). The main barriers identified were the lack of evidence-based guidelines for implementing collective intelligence, complexity in recruiting and engaging the community, and difficulties in disseminating the results of collective intelligence projects. We drew on respondents' experience to provide tips and good practice advice for governance, planning, and conducting collective intelligence projects. Respondents particularly suggested establishing a diverse coordination team to plan and manage collective intelligence projects and setting up common rules of governance for participants in projects. In project planning, respondents provided advice on identifying research problems that could be answered by collective intelligence and identifying communities of participants. They shared tips on preparing the task and interface and organizing communication activities to recruit and engage participants. CONCLUSIONS:Mobilizing collective intelligence through crowdsourcing is an innovative method to increase research efficiency, although there are several barriers to its implementation. We present good practice advice from researchers with experience of collective intelligence across different disciplines to overcome barriers to mobilizing collective intelligence.
| S-EPMC6632103 | biostudies-literature