Dataset Information

The natural selection of bad science.

ABSTRACT: Poor research design and data analysis encourage false-positive findings. Such poor methods persist despite perennial calls for improvement, suggesting that they result from something more than just misunderstanding. The persistence of poor methods results partly from incentives that favour them, leading to the natural selection of bad science. This dynamic requires no conscious strategizing-no deliberate cheating nor loafing-by scientists, only that publication is a principal factor for career advancement. Some normative methods of analysis have almost certainly been selected to further publication instead of discovery. In order to improve the culture of science, a shift must be made away from correcting misunderstandings and towards rewarding understanding. We support this argument with empirical evidence and computational modelling. We first present a 60-year meta-analysis of statistical power in the behavioural sciences and show that power has not improved despite repeated demonstrations of the necessity of increasing power. To demonstrate the logical consequences of structural incentives, we then present a dynamic model of scientific communities in which competing laboratories investigate novel or previously published hypotheses using culturally transmitted research methods. As in the real world, successful labs produce more 'progeny,' such that their methods are more often copied and their students are more likely to start labs of their own. Selection for high output leads to poorer methods and increasingly high false discovery rates. We additionally show that replication slows but does not stop the process of methodological deterioration. Improving the quality of research requires change at the institutional level.

SUBMITTER: Smaldino PE

PROVIDER: S-EPMC5043322 | biostudies-literature | 2016 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The natural selection of bad science.

Smaldino Paul E PE McElreath Richard R

Royal Society open science 20160921 9

Poor research design and data analysis encourage false-positive findings. Such poor methods persist despite perennial calls for improvement, suggesting that they result from something more than just misunderstanding. The persistence of poor methods results partly from incentives that favour them, leading to the natural selection of bad science. This dynamic requires no conscious strategizing-no deliberate cheating nor loafing-by scientists, only that publication is a principal factor for career ...[more]

PMID: 27703703

Similar Datasets

Project description:With a realistic threat against biodiversity in rain forests and in the sea, a sustainable use of natural products is becoming more and more important. Basic research directed against different organisms in Nature could reveal unexpected insights into fundamental biological mechanisms but also new pharmaceutical or biotechnological possibilities of more immediate use. Many different strategies have been used prospecting the biodiversity of Earth in the search for novel structure-activity relationships, which has resulted in important discoveries in drug development. However, we believe that the development of multidisciplinary incentives will be necessary for a future successful exploration of Nature. With this aim, one way would be a modernization and renewal of a venerable proven interdisciplinary science, Pharmacognosy, which represents an integrated way of studying biological systems. This has been demonstrated based on an explanatory model where the different parts of the model are explained by our ongoing research. Anti-inflammatory natural products have been discovered based on ethnopharmacological observations, marine sponges in cold water have resulted in substances with ecological impact, combinatory strategy of ecology and chemistry has revealed new insights into the biodiversity of fungi, in depth studies of cyclic peptides (cyclotides) has created new possibilities for engineering of bioactive peptides, development of new strategies using phylogeny and chemography has resulted in new possibilities for navigating chemical and biological space, and using bioinformatic tools for understanding of lateral gene transfer could provide potential drug targets. A multidisciplinary subject like Pharmacognosy, one of several scientific disciplines bridging biology and chemistry with medicine, has a strategic position for studies of complex scientific questions based on observations in Nature. Furthermore, natural product research based on intriguing scientific questions in Nature can be of value to increase the attraction for young students in modern life science.

Project description:The hypothesis that evolvability - the capacity to evolve by natural selection - is itself the object of natural selection is highly intriguing but remains controversial due in large part to a paucity of direct experimental evidence. The antigenic variation mechanisms of microbial pathogens provide an experimentally tractable system to test whether natural selection has favored mechanisms that increase evolvability. Many antigenic variation systems consist of paralogous unexpressed 'cassettes' that recombine into an expression site to rapidly alter the expressed protein. Importantly, the magnitude of antigenic change is a function of the genetic diversity among the unexpressed cassettes. Thus, evidence that selection favors among-cassette diversity is direct evidence that natural selection promotes antigenic evolvability. We used the Lyme disease bacterium, Borrelia burgdorferi, as a model to test the prediction that natural selection favors amino acid diversity among unexpressed vls cassettes and thereby promotes evolvability in a primary surface antigen, VlsE. The hypothesis that diversity among vls cassettes is favored by natural selection was supported in each B. burgdorferi strain analyzed using both classical (dN/dS ratios) and Bayesian population genetic analyses of genetic sequence data. This hypothesis was also supported by the conservation of highly mutable tandem-repeat structures across B. burgdorferi strains despite a near complete absence of sequence conservation. Diversification among vls cassettes due to natural selection and mutable repeat structures promotes long-term antigenic evolvability of VlsE. These findings provide a direct demonstration that molecular mechanisms that enhance evolvability of surface antigens are an evolutionary adaptation. The molecular evolutionary processes identified here can serve as a model for the evolution of antigenic evolvability in many pathogens which utilize similar strategies to establish chronic infections.

Dataset Information

The natural selection of bad science.

Publications

The natural selection of bad science.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets