Dataset Information

Estimating the reproducibility of social learning research published between 1955 and 2018.

ABSTRACT: Reproducibility is integral to science, but difficult to achieve. Previous research has quantified low rates of data availability and results reproducibility across the biological and behavioural sciences. Here, we surveyed 560 empirical publications, published between 1955 and 2018 in the social learning literature, a research topic that spans animal behaviour, behavioural ecology, cultural evolution and evolutionary psychology. Data were recoverable online or through direct data requests for 30% of this sample. Data recovery declines exponentially with time since publication, halving every 6 years, and up to every 9 years for human experimental data. When data for a publication can be recovered, we estimate a high probability of subsequent data usability (87%), analytical clarity (97%) and agreement of published results with reproduced findings (96%). This corresponds to an overall rate of recovering data and reproducing results of 23%, largely driven by the unavailability or incompleteness of data. We thus outline clear measures to improve the reproducibility of research on the ecology and evolution of social behaviour.

SUBMITTER: Minocher R

PROVIDER: S-EPMC8441137 | biostudies-literature | 2021 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Estimating the reproducibility of social learning research published between 1955 and 2018.

Minocher Riana R Atmaca Silke S Bavero Claudia C McElreath Richard R Beheim Bret B

Royal Society open science 20210915 9

Reproducibility is integral to science, but difficult to achieve. Previous research has quantified low rates of data availability and results reproducibility across the biological and behavioural sciences. Here, we surveyed 560 empirical publications, published between 1955 and 2018 in the social learning literature, a research topic that spans animal behaviour, behavioural ecology, cultural evolution and evolutionary psychology. Data were recoverable online or through direct data requests for 3 ...[more]

PMID: 34540248

Similar Datasets

Project description:IntroductionPrevious studies about the replicability of clinical research based on the published literature have suggested that highly cited articles are often contradicted or found to have inflated effects. Nevertheless, there are no recent updates of such efforts, and this situation may have changed over time.MethodsWe searched the Web of Science database for articles studying medical interventions with more than 2000 citations, published between 2004 and 2018 in high-impact medical journals. We then searched for replications of these studies in PubMed using the PICO (Population, Intervention, Comparator and Outcome) framework. Replication success was evaluated by the presence of a statistically significant effect in the same direction and by overlap of the replication's effect size confidence interval (CIs) with that of the original study. Evidence of effect size inflation and potential predictors of replicability were also analyzed.ResultsA total of 89 eligible studies, of which 24 had valid replications (17 meta-analyses and 7 primary studies) were found. Of these, 21 (88%) had effect sizes with overlapping CIs. Of 15 highly cited studies with a statistically significant difference in the primary outcome, 13 (87%) had a significant effect in the replication as well. When both criteria were considered together, the replicability rate in our sample was of 20 out of 24 (83%). There was no evidence of systematic inflation in these highly cited studies, with a mean effect size ratio of 1.03 [95% CI (0.88, 1.21)] between initial and subsequent effects. Due to the small number of contradicted results, our analysis had low statistical power to detect predictors of replicability.ConclusionAlthough most studies did not have eligible replications, the replicability rate of highly cited clinical studies in our sample was higher than in previous estimates, with little evidence of systematic effect size inflation. This estimate is based on a very select sample of studies and may not be generalizable to clinical research in general.

Project description:IntroductionPublic health investigations, including research, in refugee populations are necessary to inform evidence-based interventions and care. The unique challenges refugees face (displacement, limited political protections, economic hardship) can make them especially vulnerable to harm, burden, or undue influence. Acute survival needs, fear of stigma or persecution, and history of trauma may present challenges to ensuring meaningful informed consent and establishing trust. We examined the recently published literature to understand the application of ethics principles in investigations involving refugees.MethodsWe conducted a preliminary review of refugee health literature (research and non-research data collections) published from 2015 through 2018 available in PubMed. Article inclusion criteria were: participants were refugees, topic was health-related, and methods used primary data collection. Information regarding type of investigation, methods, and reported ethics considerations was abstracted.ResultsWe examined 288 articles. Results indicated 33% of investigations were conducted before resettlement, during the displacement period (68% of these were in refugee camps). Common topics included mental health (48%) and healthcare access (8%). The majority (87%) of investigations obtained consent. Incentives were provided less frequently (23%). Most authors discussed the ways in which community stakeholders were engaged (91%), yet few noted whether refugee representatives had an opportunity to review investigational protocols (8%). Cultural considerations were generally limited to gender and religious norms, and 13% mentioned providing some form of post-investigation support.ConclusionsOur analysis is a preliminary assessment of the application of ethics principles reported within the recently published refugee health literature. From this analysis, we have proposed a list of best practices, which include stakeholder engagement, respect for cultural norms, and post-study support. Investigations conducted among refugees require additional diligence to ensure respect for and welfare of the participants. Development of a refugee-specific ethics framework with ethics and refugee health experts that addresses the need for stakeholder involvement, appropriate incentive use, protocol review, and considerations of cultural practices may help guide future investigations in this population.

Dataset Information

Estimating the reproducibility of social learning research published between 1955 and 2018.

Publications

Estimating the reproducibility of social learning research published between 1955 and 2018.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets