Towards computational reproducibility: researcher perspectives on the use and sharing of software.
Ontology highlight
ABSTRACT:
SUBMITTER: AlNoamany Y
PROVIDER: S-EPMC7924683 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Image processing in cryogenic electron tomography (cryoET) is currently at a similar state as Single Particle Analysis (SPA) in cryogenic electron microscopy (cryoEM) was a few years ago. Its data processing workflows are far from being well defined and the user experience is still not smooth. Moreover, file formats of different software packages and their associated metadata are not standardized, mainly since different packages are developed by different groups, focusing on different steps of the data processing pipeline. The Scipion framework, originally developed for SPA (de la Rosa-Trevín et al., 2016), has a generic python workflow engine that gives it the versatility to be extended to other fields, as demonstrated for model building (Martínez et al., 2020). In this article, we provide an extension of Scipion based on a set of tomography plugins (referred to as ScipionTomo hereafter), with a similar purpose: to allow users to be focused on the data processing and analysis instead of having to deal with multiple software installation issues and the inconvenience of switching from one to another, converting metadata files, managing possible incompatibilities, scripting (writing a simple program in a language that the computer must convert to machine language each time the program is run), etcetera. Additionally, having all the software available in an integrated platform allows comparing the results of different algorithms trying to solve the same problem. In this way, the commonalities and differences between estimated parameters shed light on which results can be more trusted than others. ScipionTomo is developed by a collaborative multidisciplinary team composed of Scipion team engineers, structural biologists, and in some cases, the developers whose software packages have been integrated. It is open to anyone in the field willing to contribute to this project. The result is a framework extension that combines the acquired knowledge of Scipion developers in close collaboration with third-party developers, and the on-demand design of functionalities requested by beta testers applying this solution to actual biological problems.
| S-EPMC7613607 | biostudies-literature
Project description:The impact of commercialization and patenting pressure on genomics research is still a topic of considerable debate in academic, policy and popular literature. We interviewed genomic researchers to see if their perspectives offered fresh insights. Regional Genome Canada centers provided us with relevant researcher contact information, and in-depth structured interviews were conducted. Researcher perspectives were sharply divided, with both support and concern for commercialization regimes surfacing in interviews. Data withholding and publication delays were commonly reported, but the aggressive enforcement of patents was not. There are parallels to the Stem Cell community in Canada in these respects. Genomic researchers, as individuals directly implicated in the field of controversy, have developed varied and often novel insights which should be incorporated into the ongoing debates surrounding commercialization and patenting. Many researchers continue to raise concerns, particularly in relation to data withholding, thus emphasizing the need for a continued exploration of the complex issues associated with commercialization and patenting.
| S-EPMC2664955 | biostudies-literature
Project description:Data "publication" seeks to appropriate the prestige of authorship in the peer-reviewed literature to reward researchers who create useful and well-documented datasets. The scholarly communication community has embraced data publication as an incentive to document and share data. But, numerous new and ongoing experiments in implementation have not yet resolved what a data publication should be, when data should be peer-reviewed, or how data peer review should work. While researchers have been surveyed extensively regarding data management and sharing, their perceptions and expectations of data publication are largely unknown. To bring this important yet neglected perspective into the conversation, we surveyed ∼ 250 researchers across the sciences and social sciences- asking what expectations"data publication" raises and what features would be useful to evaluate the trustworthiness, evaluate the impact, and enhance the prestige of a data publication. We found that researcher expectations of data publication center on availability, generally through an open database or repository. Few respondents expected published data to be peer-reviewed, but peer-reviewed data enjoyed much greater trust and prestige. The importance of adequate metadata was acknowledged, in that almost all respondents expected data peer review to include evaluation of the data's documentation. Formal citation in the reference list was affirmed by most respondents as the proper way to credit dataset creators. Citation count was viewed as the most useful measure of impact, but download count was seen as nearly as valuable. These results offer practical guidance for data publishers seeking to meet researcher expectations and enhance the value of published data.
| S-EPMC4338305 | biostudies-literature
Project description:Over the past decade, bioethicists, legal scholars and social scientists have started to investigate the potential implications of epigenetic research and technologies on medicine and society. There is growing literature discussing the most promising opportunities, as well as arising ethical, legal and social issues (ELSI). This paper explores the views of epigenetic researchers about some of these discussions. From January to March 2020, we conducted an online survey of 189 epigenetic researchers working in 31 countries. We questioned them about the scope of their field, opportunities in different areas of specialization, and ELSI in the conduct of research and knowledge translation. We also assessed their level of concern regarding four emerging non-medical applications of epigenetic testing-i.e., in life insurance, forensics, immigration and direct-to-consumer testing. Although there was strong agreement on DNA methylation, histone modifications, 3D structure of chromatin and nucleosomes being integral elements of the field, there was considerable disagreement on transcription factors, RNA interference, RNA splicing and prions. The most prevalent ELSI experienced or witnessed by respondents were in obtaining timely access to epigenetic data in existing databases, and in the communication of epigenetic findings by the media. They expressed high levels of concern regarding non-medical applications of epigenetics, echoing cautionary appraisals in the social sciences and humanities literature.
| S-EPMC9440515 | biostudies-literature
Project description: Not available
| S-EPMC4383539 | biostudies-literature
Project description:Heart rate variability (HRV) is a valid and non-invasive indicator of cardiac autonomic nervous system functioning. Short-term HRV recordings (e.g., 10 min long) produce data that usually is manually processed. Researcher subjective decision-making on data processing could produce inter- or intra-researcher differences whose magnitude has not been previously quantified in three independent human cohorts. This study examines the inter- and intra-researcher reproducibility of HRV parameters (i.e., the influence of R-R interval selection by different researchers and by the same researcher in different moments on the quantification of HRV parameters, respectively) derived from short-term recordings in a cohort of children with overweight/obesity, young adults and middle-age adults. Participants were recruited from 3 different studies: 107 children (10.03?±?1.13 years, 58% male), 132 young adults (22.22?±?2.20 years, 33% males) and 73 middle-aged adults (53.62?±?5.18 years, 48% males). HRV was measured using a Polar RS800CX heart rate monitor. The intraclass correlation coefficient (ICC) ranged from 0.703 to 0.989 and from 0.950 to 0.998 for inter-and intra-researcher reproducibility, respectively. Limits of agreement for HRV parameters were higher for the inter-researcher processing compared with the intra-researcher processing. On average, the intra-researcher differences were 31%, 62%, and 80% smaller than the inter-researchers differences based on Coefficient of Variation in children, young and middle-aged adults, respectively. Our study provides the quantification of the inter-researcher and intra-researcher differences in three independent human cohorts, which could elicit some clinical relevant differences for HRV parameters. Based on our findings, we recommend the HRV data signal processing to be performed always by the same trained researcher and we postulate a development of algorithms for an automatic ECG selection.
| S-EPMC7347623 | biostudies-literature
Project description:When reporting research findings, scientists document the steps they followed so that others can verify and build upon the research. When those steps have been described in sufficient detail that others can retrace the steps and obtain similar results, the research is said to be reproducible. Computers play a vital role in many research disciplines and present both opportunities and challenges for reproducibility. Computers can be programmed to execute analysis tasks, and those programs can be repeated and shared with others. The deterministic nature of most computer programs means that the same analysis tasks, applied to the same data, will often produce the same outputs. However, in practice, computational findings often cannot be reproduced because of complexities in how software is packaged, installed, and executed-and because of limitations associated with how scientists document analysis steps. Many tools and techniques are available to help overcome these challenges; here we describe seven such strategies. With a broad scientific audience in mind, we describe the strengths and limitations of each approach, as well as the circumstances under which each might be applied. No single strategy is sufficient for every scenario; thus we emphasize that it is often useful to combine approaches.
| S-EPMC4940747 | biostudies-other
Project description:BackgroundTo receive the best care, people share their health data (HD) with their health practitioners (known as sharing HD for primary purposes). However, during the past two decades, sharing for other (i.e., secondary) purposes has become of great importance in numerous fields, including public health, personalized medicine, research, and development. We aimed to conduct the first comprehensive overview of all studies that investigated people's HD sharing attitudes-along with associated barriers/motivators and significant influencing factors-for all data types and across both primary and secondary uses.MethodsWe searched PubMed, MEDLINE, PsycINFO, Web of Science, EMBASE, and CINAHL for relevant studies published in English between database inception and February 28, 2023, using a predefined set of keywords. Studies were included, regardless of their design, if they reported outcomes related to attitudes towards sharing HD. We extracted key data from the included studies, including the type of HD involved and findings related to: HD sharing attitudes (either in general or depending on type of data/user); barriers/motivators/benefits/concerns of the study participants; and sociodemographic and other variables that could impact HD sharing behaviour. The qualitative synthesis was conducted by dividing the studies according to the data type (resulting in five subgroups) as well as the purpose the data sharing was focused on (primary, secondary or both). The Newcastle-Ottawa Scale (NOS) was used to assess the quality of non-randomised studies. This work was registered with PROSPERO, CRD42023413822.FindingsOf 2109 studies identified through our search, 116 were included in the qualitative synthesis, yielding a total of 228,501 participants and various types of HD represented: person-generated HD (n = 17 studies and 10,771 participants), personal HD in general (n = 69 studies and 117,054 participants), Biobank data (n = 7 studies and 27,073 participants), genomic data (n = 13 studies and 54,716 participants), and miscellaneous data (n = 10 studies and 18,887 participants). The majority of studies had a moderate level of quality (83 [71.6%] of 116 studies), but varying levels of quality were observed across the included studies. Overall, studies suggest that sharing intentions for primary purposes were observed to be high regardless of data type, and it was higher than sharing intentions for secondary purposes. Sharing for secondary purposes yielded variable findings, where both the highest and the lowest intention rates were observed in the case of studies that explored sharing biobank data (98% and 10%, respectively). Several influencing factors on sharing intentions were identified, such as the type of data recipient, data, consent. Further, concerns related to data sharing that were found to be mutual for all data types included privacy, security, and data access/control, while the perceived benefits included those related to improvements in healthcare. Findings regarding attitudes towards sharing varied significantly across sociodemographic factors and depended on data type and type of use. In most cases, these findings were derived from single studies and therefore warrant confirmations from additional studies.InterpretationSharing health data is a complex issue that is influenced by various factors (the type of health data, the intended use, the data recipient, among others) and these insights could be used to overcome barriers, address people's concerns, and focus on spreading awareness about the data sharing process and benefits.FundingNone.
| S-EPMC10963197 | biostudies-literature
Project description:Wild pigs (Sus scrofa) are one of the most detrimental invasive mammals in the US. Lack of adequate population control has allowed pigs to become established across the landscape, causing significant ecological and economic damage. Given the need for additional tools for reducing wild pig populations, two toxicants, warfarin and sodium nitrite, are at the forefront of the discussion regarding future wild pig management. However, no research has examined stakeholders' perspectives towards the use of toxicants in wild pig management. Given the lack of knowledge, our goal was to determine stakeholders' perspectives towards the legal use of toxicants for managing wild pigs. We surveyed 1822 individuals from three stakeholder groups (hunters, farmers, and forestland owners) across Alabama during February 2018 using an online survey following the Tailored Design Method. All three stakeholder groups were generally supportive of toxicant use, though their views differed slightly by group. Furthermore, all stakeholder groups were supportive of toxicant purchasing and use regulations, while accidental water contamination, human health impact, and incorrect usage of a toxicant were stakeholders' greatest concerns. These results indicate that these groups would likely be in support of using toxicants for wild pig management in Alabama and could be a model for other states or locations. Consequently, these results have direct implications for shaping policy and possible use of toxicants as a future wild pig management tool.
| S-EPMC7870098 | biostudies-literature
Project description:Independent reproducibility is essential to the generation of scientific knowledge. Optimizing experimental protocols to ensure reproducibility is an important aspect of scientific work. Genetic or pharmacological lifespan extensions are generally small compared to the inherent variability in mean lifespan even in isogenic populations housed under identical conditions. This variability makes reproducible detection of small but real effects experimentally challenging. In this study, we aimed to determine the reproducibility of C. elegans lifespan measurements under ideal conditions, in the absence of methodological errors or environmental or genetic background influences. To accomplish this, we generated a parametric model of C. elegans lifespan based on data collected from 5,026 wild-type N2 animals. We use this model to predict how different experimental practices, effect sizes, number of animals, and how different "shapes" of survival curves affect the ability to reproduce real longevity effects. We find that the chances of reproducing real but small effects are exceedingly low and would require substantially more animals than are commonly used. Our results indicate that many lifespan studies are underpowered to detect reported changes and that, as a consequence, stochastic variation alone can account for many failures to reproduce longevity results. As a remedy, we provide power of detection tables that can be used as guidelines to plan experiments with statistical power to reliably detect real changes in lifespan and limit spurious false positive results. These considerations will improve best-practices in designing lifespan experiment to increase reproducibility.
| S-EPMC5492194 | biostudies-literature