Automated screening of COVID-19 preprints: can we help authors to improve transparency and reproducibility?
Ontology highlight
ABSTRACT:
SUBMITTER: Weissgerber T
PROVIDER: S-EPMC8177099 | biostudies-literature | 2021 Jan
REPOSITORIES: biostudies-literature
Publications
Automated screening of COVID-19 preprints: can we help authors to improve transparency and reproducibility?
Weissgerber Tracey T Riedel Nico N Kilicoglu Halil H Labbé Cyril C Eckmann Peter P Ter Riet Gerben G Byrne Jennifer J Cabanac Guillaume G Capes-Davis Amanda A Favier Bertrand B Saladi Shyam S Grabitz Peter P Bannach-Brown Alexandra A Schulz Robert R McCann Sarah S Bernard Rene R Bandrowski Anita A
Nature medicine 20210101 1
Similar Datasets
Project description:Reproducibility of computational research is often challenging despite established guidelines and best practices. Translating these guidelines into practical applications remains difficult. Here, we present ENCORE, an approach to enhance transparency and reproducibility by guiding researchers in how to structure and document a computational project. ENCORE builds on previous efforts in computational reproducibility and integrates all project components into a standardized file system structure. It utilizes pre-defined files as documentation templates, leverages GitHub for software versioning, and includes an HTML-based navigator. ENCORE is designed to be agnostic to the type of computational project, data, programming language, and ICT infrastructure, and does not rely on specific software tools. We also share our group's experience using ENCORE, highlighting that the most significant challenge to the routine adoption of approaches like ours is the lack of incentives to motivate researchers to dedicate sufficient time and effort to ensure reproducibility.
| S-EPMC11405857 | biostudies-literature
Project description: Not available
| S-EPMC7598568 | biostudies-literature
Project description:Non-targeted analysis (NTA) workflows using mass spectrometry are gaining popularity in many disciplines, but universally accepted reporting standards are nonexistent. Current guidance addresses limited elements of NTA reporting-most notably, identification confidence-and is insufficient to ensure scientific transparency and reproducibility given the complexity of these methods. This lack of reporting standards hinders researchers' development of thorough study protocols and reviewers' ability to efficiently assess grant and manuscript submissions. To overcome these challenges, we developed the NTA Study Reporting Tool (SRT), an easy-to-use, interdisciplinary framework for comprehensive NTA methods and results reporting. Eleven NTA practitioners reviewed eight published articles covering environmental, food, and health-based exposomic applications with the SRT. Overall, our analysis demonstrated that the SRT provides a valid structure to guide study design and manuscript writing, as well as to evaluate NTA reporting quality. Scores self-assigned by authors fell within the range of peer-reviewer scores, indicating that SRT use for self-evaluation will strengthen reporting practices. The results also highlighted NTA reporting areas that need immediate improvement, such as analytical sequence and quality assurance/quality control information. Although scores intentionally do not correspond to data/results quality, widespread implementation of the SRT could improve study design and standardize reporting practices, ultimately leading to broader use and acceptance of NTA data.
| S-EPMC9408805 | biostudies-literature
Project description:Two questions regarding the scientific literature have become grist for public discussion: 1) what place should P values have in reporting the results of studies? 2) How should the perceived difficulty in replicating the results reported in published studies be addressed? We consider these questions to be 2 sides of the same coin; failing to address them can lead to an incomplete or incorrect message being sent to the reader. If P values (which are derived from the estimate of the effect size and a measure of the precision of the estimate of the effect) are used improperly, for example reporting only significant findings, or reporting P values without account for multiple comparisons, or failing to indicate the number of tests performed, the scientific record can be biased. Moreover, if there is a lack of transparency in the conduct of a study and reporting of study results, it will not be possible to repeat a study in a manner that allows inferences from the original study to be reproduced or to design and conduct a different experiment whose aim is to confirm the original study's findings. The goal of this article is to discuss how P values can be used in a manner that is consistent with the scientific method, and to increase transparency and reproducibility in the conduct and analysis of nutrition research.
| S-EPMC8488872 | biostudies-literature
Project description: Not available
| S-EPMC7544437 | biostudies-literature
Project description: Not available
| S-EPMC8662292 | biostudies-literature
Project description:The 2017 American College of Neuropychopharmacology (ACNP) conference hosted a Study Group on 4 December 2017, Establishing best practice guidelines to improve the rigor, reproducibility, and transparency of the maternal immune activation (MIA) animal model of neurodevelopmental abnormalities. The goals of this session were to (a) evaluate the current literature and establish a consensus on best practices to be implemented in MIA studies, (b) identify remaining research gaps warranting additional data collection and lend to the development of evidence-based best practice design, and (c) inform the MIA research community of these findings. During this session, there was a detailed discussion on the importance of validating immunogen doses and standardizing the general design (e.g., species, immunogenic compound used, housing) of our MIA models both within and across laboratories. The consensus of the study group was that data does not currently exist to support specific evidence-based model selection or methodological recommendations due to lack of consistency in reporting, and that this issue extends to other inflammatory models of neurodevelopmental abnormalities. This launched a call to establish a reporting checklist focusing on validation, implementation, and transparency modeled on the ARRIVE Guidelines and CONSORT (scientific reporting guidelines for animal and clinical research, respectively). Here we provide a summary of the discussions in addition to a suggested checklist of reporting guidelines needed to improve the rigor and reproducibility of this valuable translational model, which can be adapted and applied to other animal models as well.
| S-EPMC6300528 | biostudies-literature
Project description:Computational models of infectious diseases have become valuable tools for research and the public health response against epidemic threats. The reproducibility of computational models has been limited, undermining the scientific process and possibly trust in modeling results and related response strategies, such as vaccination. We translated published reproducibility guidelines from a wide range of scientific disciplines into an implementation framework for improving reproducibility of infectious disease computational models. The framework comprises 22 elements that should be described, grouped into 6 categories: computational environment, analytical software, model description, model implementation, data, and experimental protocol. The framework can be used by scientific communities to develop actionable tools for sharing computational models in a reproducible way.
| S-EPMC10019712 | biostudies-literature
Project description:Background: In response to the COVID-19 pandemic, our microbial diagnostic laboratory located in a university hospital has implemented several distinct SARS-CoV-2 RT-PCR systems in a very short time. More than 148,000 tests have been performed over 12 months, which represents about 405 tests per day, with peaks to more than 1,500 tests per days during the second wave. This was only possible thanks to automation and digitalization, to allow high throughput, acceptable time to results and to maintain test reliability. An automated dashboard was developed to give access to Key Performance Indicators (KPIs) to improve laboratory operational management. Methods: RT-PCR data extraction of four respiratory viruses-SARS-CoV-2, influenza A and B and RSV-from our laboratory information system (LIS), was automated. This included age, gender, test result, RT-PCR instrument, sample type, reception time, requester, and hospitalization status etc. Important KPIs were identified and the visualization was achieved using an in-house dashboard based on the open-source language R (Shiny). Results: The dashboard is organized into three main parts. The "Filter" page presents all the KPIs, divided into five sections: (i) general and gender-related indicators, (ii) number of tests and positivity rate, (iii) cycle threshold and viral load, (iv) test durations, and (v) not valid results. Filtering allows to select a given period, a dedicated instrument, a given specimen, an age range or a requester. The "Comparison" page allows a custom charting of all the available variables, which represents more than 182 combination. The "Data" page, gives the user an access to the raw data in tables format, with possibility of filtering, allowing for a deeper analysis and data download. Informations are updated every 4 h. Conclusions: By giving a rapid access to a huge number of up-to-date information, represented using the most relevant visualization types, without the burden of timely data extraction and analysis, the dashboard represents a reliable and user-friendly tool for operational laboratory management. The dashboard represents a reliable and user-friendly tool improving the decision-making process, resource planning and quality management.
| S-EPMC8685224 | biostudies-literature
Project description: Not available
| S-EPMC8144864 | biostudies-literature