Towards computational reproducibility: researcher perspectives on the use and sharing of software.
Ontology highlight
ABSTRACT:
SUBMITTER: AlNoamany Y
PROVIDER: S-EPMC7924683 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The impact of commercialization and patenting pressure on genomics research is still a topic of considerable debate in academic, policy and popular literature. We interviewed genomic researchers to see if their perspectives offered fresh insights. Regional Genome Canada centers provided us with relevant researcher contact information, and in-depth structured interviews were conducted. Researcher perspectives were sharply divided, with both support and concern for commercialization regimes surfacing in interviews. Data withholding and publication delays were commonly reported, but the aggressive enforcement of patents was not. There are parallels to the Stem Cell community in Canada in these respects. Genomic researchers, as individuals directly implicated in the field of controversy, have developed varied and often novel insights which should be incorporated into the ongoing debates surrounding commercialization and patenting. Many researchers continue to raise concerns, particularly in relation to data withholding, thus emphasizing the need for a continued exploration of the complex issues associated with commercialization and patenting.
| S-EPMC2664955 | biostudies-literature
Project description:Data "publication" seeks to appropriate the prestige of authorship in the peer-reviewed literature to reward researchers who create useful and well-documented datasets. The scholarly communication community has embraced data publication as an incentive to document and share data. But, numerous new and ongoing experiments in implementation have not yet resolved what a data publication should be, when data should be peer-reviewed, or how data peer review should work. While researchers have been surveyed extensively regarding data management and sharing, their perceptions and expectations of data publication are largely unknown. To bring this important yet neglected perspective into the conversation, we surveyed ? 250 researchers across the sciences and social sciences- asking what expectations"data publication" raises and what features would be useful to evaluate the trustworthiness, evaluate the impact, and enhance the prestige of a data publication. We found that researcher expectations of data publication center on availability, generally through an open database or repository. Few respondents expected published data to be peer-reviewed, but peer-reviewed data enjoyed much greater trust and prestige. The importance of adequate metadata was acknowledged, in that almost all respondents expected data peer review to include evaluation of the data's documentation. Formal citation in the reference list was affirmed by most respondents as the proper way to credit dataset creators. Citation count was viewed as the most useful measure of impact, but download count was seen as nearly as valuable. These results offer practical guidance for data publishers seeking to meet researcher expectations and enhance the value of published data.
| S-EPMC4338305 | biostudies-literature
Project description:Heart rate variability (HRV) is a valid and non-invasive indicator of cardiac autonomic nervous system functioning. Short-term HRV recordings (e.g., 10 min long) produce data that usually is manually processed. Researcher subjective decision-making on data processing could produce inter- or intra-researcher differences whose magnitude has not been previously quantified in three independent human cohorts. This study examines the inter- and intra-researcher reproducibility of HRV parameters (i.e., the influence of R-R interval selection by different researchers and by the same researcher in different moments on the quantification of HRV parameters, respectively) derived from short-term recordings in a cohort of children with overweight/obesity, young adults and middle-age adults. Participants were recruited from 3 different studies: 107 children (10.03?±?1.13 years, 58% male), 132 young adults (22.22?±?2.20 years, 33% males) and 73 middle-aged adults (53.62?±?5.18 years, 48% males). HRV was measured using a Polar RS800CX heart rate monitor. The intraclass correlation coefficient (ICC) ranged from 0.703 to 0.989 and from 0.950 to 0.998 for inter-and intra-researcher reproducibility, respectively. Limits of agreement for HRV parameters were higher for the inter-researcher processing compared with the intra-researcher processing. On average, the intra-researcher differences were 31%, 62%, and 80% smaller than the inter-researchers differences based on Coefficient of Variation in children, young and middle-aged adults, respectively. Our study provides the quantification of the inter-researcher and intra-researcher differences in three independent human cohorts, which could elicit some clinical relevant differences for HRV parameters. Based on our findings, we recommend the HRV data signal processing to be performed always by the same trained researcher and we postulate a development of algorithms for an automatic ECG selection.
| S-EPMC7347623 | biostudies-literature
Project description:When reporting research findings, scientists document the steps they followed so that others can verify and build upon the research. When those steps have been described in sufficient detail that others can retrace the steps and obtain similar results, the research is said to be reproducible. Computers play a vital role in many research disciplines and present both opportunities and challenges for reproducibility. Computers can be programmed to execute analysis tasks, and those programs can be repeated and shared with others. The deterministic nature of most computer programs means that the same analysis tasks, applied to the same data, will often produce the same outputs. However, in practice, computational findings often cannot be reproduced because of complexities in how software is packaged, installed, and executed-and because of limitations associated with how scientists document analysis steps. Many tools and techniques are available to help overcome these challenges; here we describe seven such strategies. With a broad scientific audience in mind, we describe the strengths and limitations of each approach, as well as the circumstances under which each might be applied. No single strategy is sufficient for every scenario; thus we emphasize that it is often useful to combine approaches.
| S-EPMC4940747 | biostudies-other
Project description:Wild pigs (Sus scrofa) are one of the most detrimental invasive mammals in the US. Lack of adequate population control has allowed pigs to become established across the landscape, causing significant ecological and economic damage. Given the need for additional tools for reducing wild pig populations, two toxicants, warfarin and sodium nitrite, are at the forefront of the discussion regarding future wild pig management. However, no research has examined stakeholders' perspectives towards the use of toxicants in wild pig management. Given the lack of knowledge, our goal was to determine stakeholders' perspectives towards the legal use of toxicants for managing wild pigs. We surveyed 1822 individuals from three stakeholder groups (hunters, farmers, and forestland owners) across Alabama during February 2018 using an online survey following the Tailored Design Method. All three stakeholder groups were generally supportive of toxicant use, though their views differed slightly by group. Furthermore, all stakeholder groups were supportive of toxicant purchasing and use regulations, while accidental water contamination, human health impact, and incorrect usage of a toxicant were stakeholders' greatest concerns. These results indicate that these groups would likely be in support of using toxicants for wild pig management in Alabama and could be a model for other states or locations. Consequently, these results have direct implications for shaping policy and possible use of toxicants as a future wild pig management tool.
| S-EPMC7870098 | biostudies-literature
Project description:Independent reproducibility is essential to the generation of scientific knowledge. Optimizing experimental protocols to ensure reproducibility is an important aspect of scientific work. Genetic or pharmacological lifespan extensions are generally small compared to the inherent variability in mean lifespan even in isogenic populations housed under identical conditions. This variability makes reproducible detection of small but real effects experimentally challenging. In this study, we aimed to determine the reproducibility of C. elegans lifespan measurements under ideal conditions, in the absence of methodological errors or environmental or genetic background influences. To accomplish this, we generated a parametric model of C. elegans lifespan based on data collected from 5,026 wild-type N2 animals. We use this model to predict how different experimental practices, effect sizes, number of animals, and how different "shapes" of survival curves affect the ability to reproduce real longevity effects. We find that the chances of reproducing real but small effects are exceedingly low and would require substantially more animals than are commonly used. Our results indicate that many lifespan studies are underpowered to detect reported changes and that, as a consequence, stochastic variation alone can account for many failures to reproduce longevity results. As a remedy, we provide power of detection tables that can be used as guidelines to plan experiments with statistical power to reliably detect real changes in lifespan and limit spurious false positive results. These considerations will improve best-practices in designing lifespan experiment to increase reproducibility.
| S-EPMC5492194 | biostudies-literature
Project description:Recent studies have demonstrated the difficulties to replicate scientific findings and/or experiments published in past.1 The effects seen in the replicated experiments were smaller than previously reported. Some of the explanations for these findings include the complexity of the experimental design and the pressure on researches to report positive findings. The International Committee of Medical Journal Editors (ICMJE) suggests that every study considered for publication must submit a plan to share the de-identified patient data no later than 6 months after publication. There is a growing demand to enhance the management of clinical data, facilitate data sharing across institutions and also to keep track of the data from previous experiments. The ultimate goal is to assure the reproducibility of experiments in the future. This paper describes Shiny-tooth, a web based application created to improve clinical data acquisition during the clinical trial; data federation of such data as well as morphological data derived from medical images; Currently, this application is being used to store clinical data from an osteoarthritis (OA) study. This work is submitted to the SPIE Biomedical Applications in Molecular, Structural, and Functional Imaging conference.
| S-EPMC5497850 | biostudies-other
Project description:BackgroundThe use of next-generation sequencing technologies has enabled the rapid identification of non-synonymous somatic mutations in cancer cells. Neoantigens are mutated peptides derived from somatic mutations not present in normal tissues that may result in the presentation of tumour-specific peptides capable of eliciting antitumour T-cell responses. Personalised neoantigen-based cancer vaccines and adoptive T-cell therapies have been shown to prime host immunity against tumour cells and are under clinical trial development. However, the optimisation and standardisation of neoantigen identification, as well as its delivery as immunotherapy are needed to increase tumour-specific T-cell responses and, thus, the clinical efficacy of current cancer immunotherapies.MethodsIn this recommendation article, launched by the European Society for Medical Oncology (ESMO), we outline and discuss the available framework for neoantigen prediction and present a systematic review of the current scientific evidence.ResultsA number of computational pipelines for neoantigen prediction are available. Most of them provide peptide major histocompatibility complex (MHC) binding affinity predictions, but more recent approaches incorporate additional features like variant allele fraction, gene expression, and clonality of mutations. Neoantigens can be predicted in all cancer types with high and low tumour mutation burden, in part by exploiting tumour-specific aberrations derived from mutational frameshifts, splice variants, gene fusions, endogenous retroelements and other tumour-specific processes that could yield more potently immunogenic tumour neoantigens. Ongoing clinical trials will highlight those cancer types and combinations of immune therapies that would derive the most benefit from neoantigen-based immunotherapies.ConclusionsImproved identification, selection and prioritisation of tumour-specific neoantigens are needed to increase the scope of benefit from cancer vaccines and adoptive T-cell therapies. Novel pipelines are being developed to resolve the challenges posed by high-throughput sequencing and to predict immunogenic neoantigens.
| S-EPMC7885309 | biostudies-literature
Project description:Conservation physiology represents a recently emerging arm of conservation science that applies physiological tools and techniques to understand and solve conservation issues. While a multi-disciplinary toolbox can only help to address the global biodiversity crisis, any field can face challenges while becoming established, particularly highly applied disciplines that require multi-stakeholder involvement. Gaining first-hand knowledge of the challenges that conservation physiologists are facing can help characterize the current state of the field and build a better foundation for determining how it can grow. Through an online survey of 468 scientists working at the intersection of physiology and conservation, we aimed to identify characteristics of those engaging in conservation physiology research (e.g. demographics, primary taxa of study), gauge conservation physiology's role in contributing to on-the-ground conservation action, identify the perceived barriers to achieving success and determine how difficult any identified barriers are to overcome. Despite all participants having experience combining physiology and conservation, only one-third considered themselves to be 'conservation physiologists'. Moreover, there was a general perception that conservation physiology does not yet regularly lead to tangible conservation success. Respondents identified the recent conceptualization of the field and the broader issue of adequately translating science into management action as the primary reasons for these deficits. Other significant barriers that respondents have faced when integrating physiology and conservation science included a lack of funding, logistical constraints (e.g. sample sizes, obtaining permits) and a lack of physiological baseline data (i.e. reference ranges of a physiological metric's 'normal' or pre-environmental change levels). We identified 12 actions based on suggestions of survey participants that we anticipate will help deconstruct the barriers and continue to develop a narrative of physiology that is relevant to conservation science, policy and practice.
| S-EPMC8084030 | biostudies-literature
Project description:BackgroundTwo-dimensional speckle-tracking echocardiography (2D-STE) enables objective assessment of left atrial (LA) deformation through the analysis of myocardial strain, which can be measured by different speckle-tracking software. The aim of this study was to compare the consistency of 3 different commercially available software, which include vendor-specific software for measuring left ventricle (VSSLV), vendor-independent software packages for measuring LV strain (VISLV) and vendor-independent software packages for measuring LA strain (VISLA).MethodsSixty-four subjects (mean age: 44 ± 16 years, 50% males) underwent conventional echocardiograms using a GE Vivid 9 (GE Ultrasound, Horten, Norway) cardiac ultrasound system. Standard apical 4 and 2 chamber views of the left atrium were obtained in each subject with a frame-rate range of 40-71 frames/s. LA strain during the contraction phase (Sct), conduit phase (Scd), reservoir phase (Sr = Sct + Scd) were analyzed by 2 independent observers and 3 different software.ResultsSct, Scd, Sr were, respectively, - 11.26 ± 2.45%, - 16.77 ± 7.06%, and 28.03 ± 7.58% with VSSLV, - 14.77 ± 3.59%, - 23.17 ± 10.33%, and 38.23 ± 10.99% with VISLV, and - 14.80 ± 3.88%, - 23.94 ± 10.48%, and 38.73 ± 11.56% when VISLA was used. A comparison of strain measurements between VSSLV and VIS (VISLV and VISLA) showed VIS had significantly smaller mean differences and narrower limits of agreement. Similar results were observed in the coefficient of variation (CV) for measurements between VSSLV and VIS (VISLV and VISLA). Comparison of the intra-class correlation coefficients (ICCs) indicated that measurement reliability was weaker with VSSLV (ICC < 0.6) than with VIS (VISLV and VISLA) (ICC > 0.9). For intra-observer ICCs, VISLA > VSSLV = VISLV. For inter-observer ICCs, VSSLV > VISLA > VISLV.ConclusionsSoftware measurement results of LA strain vary considerably. We recommended not measuring LA strain across vendor platforms.
| S-EPMC6521472 | biostudies-literature