Browse
Submit Data
Databases
API
Help

Dataset Information

14 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Aggregation mechanisms for crowd predictions.

ABSTRACT: When the information of many individuals is pooled, the resulting aggregate often is a good predictor of unknown quantities or facts. This aggregate predictor frequently outperforms the forecasts of experts or even the best individual forecast included in the aggregation process ("wisdom of crowds"). However, an appropriate aggregation mechanism is considered crucial to reaping the benefits of a "wise crowd". Of the many possible ways to aggregate individual forecasts, we compare (uncensored and censored) arithmetic and geometric mean and median, continuous double auction market prices and sealed bid-offer call market prices in a controlled experiment. We use an asymmetric information structure, where participants know different sub-sets of the total information needed to exactly calculate the asset value to be estimated. We find that prices from continuous double auction markets clearly outperform all alternative approaches for aggregating dispersed information and that information lets only the best-informed participants generate excess returns.

SUBMITTER: Palan S

PROVIDER: S-EPMC7591134 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Aggregation mechanisms for crowd predictions.

Palan Stefan S Huber Jürgen J Senninger Larissa L

Experimental economics 20191109 3

When the information of many individuals is pooled, the resulting aggregate often is a good predictor of unknown quantities or facts. This aggregate predictor frequently outperforms the forecasts of experts or even the best individual forecast included in the aggregation process ("wisdom of crowds"). However, an appropriate aggregation mechanism is considered crucial to reaping the benefits of a "wise crowd". Of the many possible ways to aggregate individual forecasts, we compare (uncensored and ...[more]

PMID: 33132745

Similar Datasets

Accuracy-Risk Trade-Off Due to Social Learning in Crowd-Sourced Financial Predictions.

Project description:A critical question relevant to the increasing importance of crowd-sourced-based finance is how to optimize collective information processing and decision-making. Here, we investigate an often under-studied aspect of the performance of online traders: beyond focusing on just accuracy, what gives rise to the trade-off between risk and accuracy at the collective level? Answers to this question will lead to designing and deploying more effective crowd-sourced financial platforms and to minimizing issues stemming from risk such as implied volatility. To investigate this trade-off, we conducted a large online Wisdom of the Crowd study where 2037 participants predicted the prices of real financial assets (S&P 500, WTI Oil and Gold prices). Using the data collected, we modeled the belief update process of participants using models inspired by Bayesian models of cognition. We show that subsets of predictions chosen based on their belief update strategies lie on a Pareto frontier between accuracy and risk, mediated by social learning. We also observe that social learning led to superior accuracy during one of our rounds that occurred during the high market uncertainty of the Brexit vote.

| S-EPMC8307866 | biostudies-literature

Using meta-predictions to identify experts in the crowd when past performance is unknown.

Project description:A common approach to improving probabilistic forecasts is to identify and leverage the forecasts from experts in the crowd based on forecasters' performance on prior questions with known outcomes. However, such information is often unavailable to decision-makers on many forecasting problems, and thus it can be difficult to identify and leverage expertise. In the current paper, we propose a novel algorithm for aggregating probabilistic forecasts using forecasters' meta-predictions about what other forecasters will predict. We test the performance of an extremised version of our algorithm against current forecasting approaches in the literature and show that our algorithm significantly outperforms all other approaches on a large collection of 500 binary decision problems varying in five levels of difficulty. The success of our algorithm demonstrates the potential of using meta-predictions to leverage latent expertise in environments where forecasters' expertise cannot otherwise be easily identified.

| S-EPMC7182234 | biostudies-literature

Humans in the Loop: Incorporating Expert and Crowd-Sourced Knowledge for Predictions Using Survey Data.

Project description:Survey data sets are often wider than they are long. This high ratio of variables to observations raises concerns about overfitting during prediction, making informed variable selection important. Recent applications in computer science have sought to incorporate human knowledge into machine-learning methods to address these problems. The authors implement such a "human-in-the-loop" approach in the Fragile Families Challenge. The authors use surveys to elicit knowledge from experts and laypeople about the importance of different variables to different outcomes. This strategy offers the option to subset the data before prediction or to incorporate human knowledge as scores in prediction models, or both together. The authors find that human intervention is not obviously helpful. Human-informed subsetting reduces predictive performance, and considered alone, approaches incorporating scores perform marginally worse than approaches that do not. However, incorporating human knowledge may still improve predictive performance, and future research should consider new ways of doing so.

| S-EPMC8112737 | biostudies-literature

Elicitation and aggregation of multimodal estimates improve wisdom of crowd effects on ordering tasks.

Project description:We present a wisdom of crowds study where participants are asked to order a small set of images based on the number of dots they contain and then to guess the respective number of dots in each image. We test two input elicitation interfaces-one elicits the two modalities of estimates jointly and the other independently. We show that the latter interface yields higher quality estimates, even though the multimodal estimates tend to be more self-contradictory. The inputs are aggregated via optimization and voting-rule based methods to estimate the true ordering of a larger universal set of images. We demonstrate that the quality of collective estimates from the simpler yet more computationally-efficient voting methods is comparable to that achieved by the more complex optimization model. Lastly, we find that using multiple modalities of estimates from one group yields better collective estimates compared to mixing numerical estimates from one group with the ordinal estimates from a different group.

| S-EPMC10834972 | biostudies-literature

Crowd Sourcing: Do Peer Crowd Prototypes Match Reality?

Project description:During the transition into high school, adolescents sort large sets of unfamiliar peers into prototypical peer crowds thought to share similar values, behaviors, and interests (e.g., Jocks). Often, such sorting is based solely on appearance. This study investigates the accuracy of this sorting process in relation to actual characteristics using video and survey data from a longitudinal sample of U.S. youths who attended high school in the mid- to late-2000s. To simulate this sorting process, we asked same-birth-cohort strangers to view short videos of youths at age 15 and to classify those strangers into likely crowd membership. We then compared the classifications they made to how adolescents characterized themselves at that same time point. Results show that peer crowd classification predicts aspects of unknown peers' mental health, academic achievement, extracurricular involvement, social status, and risk-taking behaviors.

| S-EPMC9281431 | biostudies-literature

Structure and Aggregation Mechanisms in Amyloids.

Project description:The aggregation of a polypeptide chain into amyloid fibrils and their accumulation and deposition into insoluble plaques and intracellular inclusions is the hallmark of several misfolding diseases known as amyloidoses. Alzheimer's, Parkinson's and Huntington's diseases are some of the approximately 50 amyloid diseases described to date. The identification and characterization of the molecular species critical for amyloid formation and disease development have been the focus of intense scrutiny. Methods such as X-ray and electron diffraction, solid-state nuclear magnetic resonance spectroscopy (ssNMR) and cryo-electron microscopy (cryo-EM) have been extensively used and they have contributed to shed a new light onto the structure of amyloid, revealing a multiplicity of polymorphic structures that generally fit the cross-? amyloid motif. The development of rational therapeutic approaches against these debilitating and increasingly frequent misfolding diseases requires a thorough understanding of the molecular mechanisms underlying the amyloid cascade. Here, we review the current knowledge on amyloid fibril formation for several proteins and peptides from a kinetic and thermodynamic point of view, the structure of the molecular species involved in the amyloidogenic process, and the origin of their cytotoxicity.

| S-EPMC7179426 | biostudies-literature

Inhibitory Mechanisms of Lusianthridin on Human Platelet Aggregation.

Project description:Lusianthridin is a phenanthrene derivative isolated from Dendrobium venustum. Some phenanthrene compounds have antiplatelet aggregation activities via undefined pathways. This study aims to determine the inhibitory effects and potential mechanisms of lusianthridin on platelet aggregation. The results indicated that lusianthridin inhibited arachidonic acid, collagen, and adenosine diphosphate (ADP)-stimulated platelet aggregation (IC50 of 0.02 ± 0.001 mM, 0.14 ± 0.018 mM, and 0.22 ± 0.046 mM, respectively). Lusianthridin also increased the delaying time of arachidonic acid-stimulated and the lag time of collagen-stimulated and showed a more selective effect on the secondary wave of ADP-stimulated aggregations. Molecular docking studies revealed that lusianthridin bound to the entrance site of the cyclooxygenase-1 (COX-1) enzyme and probably the active region of the cyclooxygenase-2 (COX-2) enzyme. In addition, lusianthridin showed inhibitory effects on both COX-1 and COX-2 enzymatic activities (IC50 value of 10.81 ± 1.12 µM and 0.17 ± 1.62 µM, respectively). Furthermore, lusianthridin significantly inhibited ADP-induced suppression of cAMP formation in platelets at 0.4 mM concentration (p < 0.05). These findings suggested that possible mechanisms of lusianthridin on the antiplatelet effects might act via arachidonic acid-thromboxane and adenylate cyclase pathways.

| S-EPMC8267677 | biostudies-literature

Crowd of Oz: A Crowd-Powered Social Robotics System for Stress Management.

Project description:Coping with stress is crucial for a healthy lifestyle. In the past, a great deal of research has been conducted to use socially assistive robots as a therapy to alleviate stress and anxiety related problems. However, building a fully autonomous social robot which can deliver psycho-therapeutic solutions is a very challenging endeavor due to limitations in artificial intelligence (AI). To overcome AI's limitations, researchers have previously introduced crowdsourcing-based teleoperation methods, which summon the crowd's input to control a robot's functions. However, in the context of robotics, such methods have only been used to support the object manipulation, navigational, and training tasks. It is not yet known how to leverage real-time crowdsourcing (RTC) to process complex therapeutic conversational tasks for social robotics. To fill this gap, we developed Crowd of Oz (CoZ), an open-source system that allows Softbank's Pepper robot to support such conversational tasks. To demonstrate the potential implications of this crowd-powered approach, we investigated how effectively, crowd workers recruited in real-time can teleoperate the robot's speech, in situations when the robot needs to act as a life coach. We systematically varied the number of workers who simultaneously handle the speech of the robot (N = 1, 2, 4, 8) and investigated the concomitant effects for enabling RTC for social robotics. Additionally, we present Pavilion, a novel and open-source algorithm for managing the workers' queue so that a required number of workers are engaged or waiting. Based on our findings, we discuss salient parameters that such crowd-powered systems must adhere to, so as to enhance their performance in response latency and dialogue quality.

| S-EPMC7014516 | biostudies-literature

A3D Model Organism Database (A3D-MODB): a database for proteome aggregation predictions in model organisms.

Project description:Protein aggregation has been associated with aging and different pathologies and represents a bottleneck in the industrial production of biotherapeutics. Numerous past studies performed in Escherichia coli and other model organisms have allowed to dissect the biophysical principles underlying this process. This knowledge fuelled the development of computational tools, such as Aggrescan 3D (A3D) to forecast and re-design protein aggregation. Here, we present the A3D Model Organism Database (A3D-MODB) http://biocomp.chem.uw.edu.pl/A3D2/MODB, a comprehensive resource for the study of structural protein aggregation in the proteomes of 12 key model species spanning distant biological clades. In addition to A3D predictions, this resource incorporates information useful for contextualizing protein aggregation, including membrane protein topology and structural model confidence, as an indirect reporter of protein disorder. The database is openly accessible without any need for registration. We foresee A3D-MOBD evolving into a central hub for conducting comprehensive, multi-species analyses of protein aggregation, fostering the development of protein-based solutions for medical, biotechnological, agricultural and industrial applications.

| S-EPMC10767922 | biostudies-literature

Identifying protein aggregation mechanisms and quantifying aggregation rates from combined monomer depletion and continuous scattering.

Project description:Parallel temperature initial rates (PTIR) from chromatographic separation of aggregating protein solutions are combined with continuous simultaneous multiple sample light scattering (SMSLS) to make quantitative deductions about protein aggregation kinetics and mechanisms. PTIR determines the rates at which initially monomeric proteins are converted to aggregates over a range of temperatures, under initial-rate conditions. Using SMSLS for the same set of conditions provides time courses of the absolute Rayleigh scattering ratio, IR(t), from which a potentially different measure of aggregation rates can be quantified. The present report compares these measures of aggregation rates across a range of solution conditions that result in different aggregation mechanisms for anti-streptavidin (AS) immunoglobulin gamma-1 (IgG1). The results illustrate how the two methods provide complementary information when deducing aggregation mechanisms, as well as cases where they provide new mechanistic details that were not possible to deduce in previous work. Criteria are presented for when the two techniques are expected to give equivalent results for quantitative rates, the potential limitations when solution non-idealities are large, as well as a comparison of the temperature dependence of AS-IgG1 aggregation rates with published data for other antibodies.

| S-EPMC5004974 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data