Browse
Submit Data
Databases
API
Help

Dataset Information

15 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Second-generation p-values: Improved rigor, reproducibility, & transparency in statistical analyses.

ABSTRACT: Verifying that a statistically significant result is scientifically meaningful is not only good scientific practice, it is a natural way to control the Type I error rate. Here we introduce a novel extension of the p-value-a second-generation p-value (pδ)-that formally accounts for scientific relevance and leverages this natural Type I Error control. The approach relies on a pre-specified interval null hypothesis that represents the collection of effect sizes that are scientifically uninteresting or are practically null. The second-generation p-value is the proportion of data-supported hypotheses that are also null hypotheses. As such, second-generation p-values indicate when the data are compatible with null hypotheses (pδ = 1), or with alternative hypotheses (pδ = 0), or when the data are inconclusive (0 < pδ < 1). Moreover, second-generation p-values provide a proper scientific adjustment for multiple comparisons and reduce false discovery rates. This is an advance for environments rich in data, where traditional p-value adjustments are needlessly punitive. Second-generation p-values promote transparency, rigor and reproducibility of scientific results by a priori specifying which candidate hypotheses are practically meaningful and by providing a more reliable statistical summary of when the data are compatible with alternative or null hypotheses.

SUBMITTER: Blume JD

PROVIDER: S-EPMC5863943 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Rigor, reproducibility, and transparency of randomized controlled trials in obstetrics and gynecology.

Project description: Not available

| S-EPMC8599633 | biostudies-literature

Maternal immune activation: reporting guidelines to improve the rigor, reproducibility, and transparency of the model.

Project description:The 2017 American College of Neuropychopharmacology (ACNP) conference hosted a Study Group on 4 December 2017, Establishing best practice guidelines to improve the rigor, reproducibility, and transparency of the maternal immune activation (MIA) animal model of neurodevelopmental abnormalities. The goals of this session were to (a) evaluate the current literature and establish a consensus on best practices to be implemented in MIA studies, (b) identify remaining research gaps warranting additional data collection and lend to the development of evidence-based best practice design, and (c) inform the MIA research community of these findings. During this session, there was a detailed discussion on the importance of validating immunogen doses and standardizing the general design (e.g., species, immunogenic compound used, housing) of our MIA models both within and across laboratories. The consensus of the study group was that data does not currently exist to support specific evidence-based model selection or methodological recommendations due to lack of consistency in reporting, and that this issue extends to other inflammatory models of neurodevelopmental abnormalities. This launched a call to establish a reporting checklist focusing on validation, implementation, and transparency modeled on the ARRIVE Guidelines and CONSORT (scientific reporting guidelines for animal and clinical research, respectively). Here we provide a summary of the discussions in addition to a suggested checklist of reporting guidelines needed to improve the rigor and reproducibility of this valuable translational model, which can be adapted and applied to other animal models as well.

| S-EPMC6300528 | biostudies-literature

Accelerating Biomedical Discoveries through Rigor and Transparency.

Project description:Difficulties in reproducing published research findings have garnered a lot of press in recent years. As a funder of biomedical research, the National Institutes of Health (NIH) has taken measures to address underlying causes of low reproducibility. Extensive deliberations resulted in a policy, released in 2015, to enhance reproducibility through rigor and transparency. We briefly explain what led to the policy, describe its elements, provide examples and resources for the biomedical research community, and discuss the potential impact of the policy on translatability with a focus on research using animal models. Importantly, while increased attention to rigor and transparency may lead to an increase in the number of laboratory animals used in the near term, it will lead to more efficient and productive use of such resources in the long run. The translational value of animal studies will be improved through more rigorous assessment of experimental variables and data, leading to better assessments of the translational potential of animal models, for the benefit of the research community and society.

| S-EPMC6279133 | biostudies-other

Transparency and reproducibility in artificial intelligence.

Project description: Not available

| S-EPMC8144864 | biostudies-literature

Rigor and reproducibility in polymer nanoparticle synthesis and characterization.

Project description:Standardized process improvement methods and tools were used to enhance the rigor and reproducibility of diblock copolymer nanoparticle (NP) synthesis and characterization. Models linking design parameters with NP characteristics boosted process control for NP synthesis, which may improve translation and commercialization of NP research.

| S-EPMC8496373 | biostudies-literature

Recommendations to enhance rigor and reproducibility in biomedical research.

Project description:Biomedical research depends increasingly on computational tools, but mechanisms ensuring open data, open software, and reproducibility are variably enforced by academic institutions, funders, and publishers. Publications may present software for which source code or documentation are or become unavailable; this compromises the role of peer review in evaluating technical strength and scientific contribution. Incomplete ancillary information for an academic software package may bias or limit subsequent work. We provide 8 recommendations to improve reproducibility, transparency, and rigor in computational biology-precisely the values that should be emphasized in life science curricula. Our recommendations for improving software availability, usability, and archival stability aim to foster a sustainable data science ecosystem in life science research.

| S-EPMC7263079 | biostudies-literature

Good clinical practice improves rigor and transparency: Lessons from the ACTIVE trial.

Project description:Clinical trials are governed by principles of good clinical practice (GCP), which can strengthen the achievement of rigor, reproducibility, and transparency in scientific research. Rigor, reproducibility, and transparency are key for producing findings with greater certainty. Clinical trials are closely supervised, often by a clinical trial coordinating center, data safety and monitoring board, and a funding agency, with policies that are a manifestation of GCP and support rigor, reproducibility, and transparency. The multisite Advanced Cognitive Training for Independent and Vital Elderly (ACTIVE) study is an example clinical trial of relevance to a psychology and aging audience that utilized many protocols that can be applied to single-laboratory designs, including a manualized protocol with accompanying scientific rationale, predefined analysis plans, standardization of procedures across field sites, assurance of competence of study staff in study procedures, transparent coding/entry/transmittal of data, regular quality assurance, and open publication of data. Despite substantial resource discrepancies between the two, single-laboratory studies can model the GCP principles utilized in large clinical trials to provide an excellent foundation for rigor, reproducibility, and transparency. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

| S-EPMC10022634 | biostudies-literature

Protocol matters – reproducibility and rigor of DNA methylation data sets

Project description:This SuperSeries is composed of the SubSeries listed below.

2022-01-12 | GSE164833 | GEO

Rigor and Reproducibility of Acoustofluidics of saliva from healthy donors

Project description:This is for Rigor and Reproducibility study to demonstrate the reproducibility of AFS SOP for EV separation, RNA isolation, and RNA analysis by using saliva samples from healthy individuals. Blinded saliva samples have been processed by two independent AFS operators for EV separation and subjected to miRNA-seq analysis. EV-associated miRNA seqeunces were used as a monitoring tool for Rigor and Reproducibility of AFS process between operators.

2023-12-29 | GSE235349 | GEO

A beginner's guide to rigor and reproducibility in fluorescence imaging experiments.

Project description:Fluorescence light microscopy is an indispensable approach for the investigation of cell biological mechanisms. With the development of cutting-edge tools such as genetically encoded fluorescent proteins and superresolution methods, light microscopy is more powerful than ever at providing insight into a broad range of phenomena, from bacterial fission to cancer metastasis. However, as with all experimental approaches, care must be taken to ensure reliable and reproducible data collection, analysis, and reporting. Each step of every imaging experiment, from design to execution to communication to data management, should be critically assessed for bias, rigor, and reproducibility. This Perspective provides a basic "best practices" guide for designing and executing fluorescence imaging experiments, with the goal of introducing researchers to concepts that will help empower them to acquire images with rigor.

| S-EPMC6080651 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data