Humans in the Loop: Incorporating Expert and Crowd-Sourced Knowledge for Predictions Using Survey Data.
Ontology highlight
ABSTRACT:
SUBMITTER: Filippova A
PROVIDER: S-EPMC8112737 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Although continental urban areas are relatively small, they are major drivers of environmental change at local, regional and global scales. Moreover, they are especially vulnerable to these changes owing to the concentration of population and their exposure to a range of hydro-meteorological hazards, emphasizing the need for spatially detailed information on urbanized landscapes. These data need to be consistent in content and scale and provide a holistic description of urban layouts to address different user needs. Here, we map the continental United States into Local Climate Zone (LCZ) types at a 100 m spatial resolution using expert and crowd-sourced information. There are 10 urban LCZ types, each associated with a set of relevant variables such that the map represents a valuable database of urban properties. These data are benchmarked against continental-wide existing and novel geographic databases on urban form. We anticipate the dataset provided here will be useful for researchers and practitioners to assess how the configuration, size, and shape of cities impact the important human and environmental outcomes.
| S-EPMC7421904 | biostudies-literature
Project description:A critical question relevant to the increasing importance of crowd-sourced-based finance is how to optimize collective information processing and decision-making. Here, we investigate an often under-studied aspect of the performance of online traders: beyond focusing on just accuracy, what gives rise to the trade-off between risk and accuracy at the collective level? Answers to this question will lead to designing and deploying more effective crowd-sourced financial platforms and to minimizing issues stemming from risk such as implied volatility. To investigate this trade-off, we conducted a large online Wisdom of the Crowd study where 2037 participants predicted the prices of real financial assets (S&P 500, WTI Oil and Gold prices). Using the data collected, we modeled the belief update process of participants using models inspired by Bayesian models of cognition. We show that subsets of predictions chosen based on their belief update strategies lie on a Pareto frontier between accuracy and risk, mediated by social learning. We also observe that social learning led to superior accuracy during one of our rounds that occurred during the high market uncertainty of the Brexit vote.
| S-EPMC8307866 | biostudies-literature
Project description:IntroductionTo mitigate the COVID-19 pandemic and prevent overwhelming the healthcare system, social-distancing policies such as school closure, stay-at-home orders, and indoor dining closure have been utilized worldwide. These policies function by reducing the rate of close contact within populations and result in decreased human mobility. Adherence to social distancing can substantially reduce disease spread. Thus, quantifying human mobility and social-distancing compliance, especially at high temporal resolution, can provide great insight into the impact of social distancing policies.MethodsWe used the movement of individuals around New York City (NYC), measured via traffic levels, as a proxy for human mobility and the impact of social-distancing policies (i.e., work from home policies, school closure, indoor dining closure etc.). By data mining Google traffic in real-time, and applying image processing, we derived high resolution time series of traffic in NYC. We used time series decomposition and generalized additive models to quantify changes in rush hour/non-rush hour, and weekday/weekend traffic, pre-pandemic and following the roll-out of multiple social distancing interventions.ResultsMobility decreased sharply on March 14, 2020 following declaration of the pandemic. However, levels began rebounding by approximately April 13, almost 2 months before stay-at-home orders were lifted, indicating premature increase in mobility, which we term social-distancing fatigue. We also observed large impacts on diurnal traffic congestion, such that the pre-pandemic bi-modal weekday congestion representing morning and evening rush hour was dramatically altered. By September, traffic congestion rebounded to approximately 75% of pre-pandemic levels.ConclusionUsing crowd-sourced traffic congestion data, we described changes in mobility in Manhattan, NYC, during the COVID-19 pandemic. These data can be used to inform human mobility changes during the current pandemic, in planning for responses to future pandemics, and in understanding the potential impact of large-scale traffic interventions such as congestion pricing policies.
| S-EPMC8403631 | biostudies-literature
Project description:BACKGROUND:Bacterial resistance to antibiotics is a growing health problem that is projected to cause more deaths than cancer by 2050. Consequently, novel antibiotics are urgently needed. Since more than half of the available antibiotics target the structurally conserved bacterial ribosomes, factors involved in protein synthesis are thus prime targets for the development of novel antibiotics. However, experimental identification of these potential antibiotic target proteins can be labor-intensive and challenging, as these proteins are likely to be poorly characterized and specific to few bacteria. Here, we use a bioinformatics approach to identify novel components of protein synthesis. RESULTS:In order to identify these novel proteins, we established a Large-Scale Transcriptomic Analysis Pipeline in Crowd (LSTrAP-Crowd), where 285 individuals processed 26 terabytes of RNA-sequencing data of the 17 most notorious bacterial pathogens. In total, the crowd processed 26,269 RNA-seq experiments and used the data to construct gene co-expression networks, which were used to identify more than a hundred uncharacterized genes that were transcriptionally associated with protein synthesis. We provide the identity of these genes together with the processed gene expression data. CONCLUSIONS:We identified genes related to protein synthesis in common bacterial pathogens and thus provide a resource of potential antibiotic development targets for experimental validation. The data can be used to explore additional vulnerabilities of bacteria, while our approach demonstrates how the processing of gene expression data can be easily crowd-sourced.
| S-EPMC7470450 | biostudies-literature
Project description:Challenges are achieving broad acceptance for addressing many biomedical questions and enabling tool assessment. But ensuring that the methods evaluated are reproducible and reusable is complicated by the diversity of software architectures, input and output file formats, and computing environments. To mitigate these problems, some challenges have leveraged new virtualization and compute methods, requiring participants to submit cloud-ready software packages. We review recent data challenges with innovative approaches to model reproducibility and data sharing, and outline key lessons for improving quantitative biomedical data analysis through crowd-sourced benchmarking challenges.
| S-EPMC6737594 | biostudies-literature
Project description:A spindle detection method was developed that: (1) extracts the signal of interest (i.e., spindle-related phasic changes in sigma) relative to ongoing "background" sigma activity using complex demodulation, (2) accounts for variations of spindle characteristics across the night, scalp derivations and between individuals, and (3) employs a minimum number of sometimes arbitrary, user-defined parameters. Complex demodulation was used to extract instantaneous power in the spindle band. To account for intra- and inter-individual differences, the signal was z-score transformed using a 60 s sliding window, per channel, over the course of the recording. Spindle events were detected with a z-score threshold corresponding to a low probability (e.g., 99th percentile). Spindle characteristics, such as amplitude, duration and oscillatory frequency, were derived for each individual spindle following detection, which permits spindles to be subsequently and flexibly categorized as slow or fast spindles from a single detection pass. Spindles were automatically detected in 15 young healthy subjects. Two experts manually identified spindles from C3 during Stage 2 sleep, from each recording; one employing conventional guidelines, and the other, identifying spindles with the aid of a sigma (11-16 Hz) filtered channel. These spindles were then compared between raters and to the automated detection to identify the presence of true positives, true negatives, false positives and false negatives. This method of automated spindle detection resolves or avoids many of the limitations that complicate automated spindle detection, and performs well compared to a group of non-experts, and importantly, has good external validity with respect to the extant literature in terms of the characteristics of automatically detected spindles.
| S-EPMC4585171 | biostudies-literature
Project description:The Internet has dramatically expanded citizens' access to and ability to engage with political information. On many websites, any user can contribute and edit "crowd-sourced" information about important political figures. One of the most prominent examples of crowd-sourced information on the Internet is Wikipedia, a free and open encyclopedia created and edited entirely by users, and one of the world's most accessed websites. While previous studies of crowd-sourced information platforms have found them to be accurate, few have considered biases in what kinds of information are included. We report the results of four randomized field experiments that sought to explore what biases exist in the political articles of this collaborative website. By randomly assigning factually true but either positive or negative and cited or uncited information to the Wikipedia pages of U.S. senators, we uncover substantial evidence of an editorial bias toward positivity on Wikipedia: Negative facts are 36% more likely to be removed by Wikipedia editors than positive facts within 12 hours and 29% more likely within 3 days. Although citations substantially increase an edit's survival time, the editorial bias toward positivity is not eliminated by inclusion of a citation. We replicate this study on the Wikipedia pages of deceased as well as recently retired but living senators and find no evidence of an editorial bias in either. Our results demonstrate that crowd-sourced information is subject to an editorial bias that favors the politically active.
| S-EPMC4558055 | biostudies-literature
Project description:When the information of many individuals is pooled, the resulting aggregate often is a good predictor of unknown quantities or facts. This aggregate predictor frequently outperforms the forecasts of experts or even the best individual forecast included in the aggregation process ("wisdom of crowds"). However, an appropriate aggregation mechanism is considered crucial to reaping the benefits of a "wise crowd". Of the many possible ways to aggregate individual forecasts, we compare (uncensored and censored) arithmetic and geometric mean and median, continuous double auction market prices and sealed bid-offer call market prices in a controlled experiment. We use an asymmetric information structure, where participants know different sub-sets of the total information needed to exactly calculate the asset value to be estimated. We find that prices from continuous double auction markets clearly outperform all alternative approaches for aggregating dispersed information and that information lets only the best-informed participants generate excess returns.
| S-EPMC7591134 | biostudies-literature
Project description:Collecting large datasets of amputee gait data is notoriously difficult. Additionally, collecting data on less prevalent amputations or on gait activities other than level walking and running on hard surfaces is rarely attempted. However, with the wealth of user-generated content on the Internet, the scope for collecting amputee gait data from alternative sources other than traditional gait labs is intriguing. Here we investigate the potential of YouTube videos to provide gait data on amputee walking. We use an example dataset of trans-femoral amputees level walking at self-selected speeds to collect temporal gait parameters and calculate gait asymmetry. We compare our YouTube data with typical literature values, and show that our methodology produces results that are highly comparable to data collected in a traditional manner. The similarity between the results of our novel methodology and literature values lends confidence to our technique. Nevertheless, clear challenges with the collection and interpretation of crowd-sourced gait data remain, including long term access to datasets, and a lack of validity and reliability studies in this area.
| S-EPMC5072704 | biostudies-literature
Project description:Seafloor mapping can offer important insights for marine management, spatial planning, and research in marine geology, ecology, and oceanography. Here, we present a method for generating regional bathymetry and geomorphometry maps from crowd-sourced depth soundings (Olex AS) for a small fraction of the cost of multibeam data collection over the same area. Empirical Bayesian Kriging was used to generate a continuous bathymetric surface from incomplete and, in some areas, sparse Olex coverage on the Newfoundland and Labrador shelves of eastern Canada. The result is a 75m bathymetric grid that provides over 100x finer spatial resolution than previously available for the majority of the 672,900 km2 study area. The interpolated bathymetry was tested for accuracy against independent depth data provided by Fisheries and Oceans Canada (Spearman correlation = 0.99, p<0.001). Quantitative terrain attributes were generated to better understand seascape characteristics at multiple spatial scales, including slope, rugosity, aspect, and bathymetric position index. Landform classification was carried out using the geomorphons algorithm and a novel method for the identification of previously unmapped tributary canyons at the continental shelf edge are also presented to illustrate some of many potential benefits of crowd-sourced regional seafloor mapping.
| S-EPMC6557478 | biostudies-literature