Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Scanning the horizon: towards transparent and reproducible neuroimaging research.

ABSTRACT: Functional neuroimaging techniques have transformed our ability to probe the neurobiological basis of behaviour and are increasingly being applied by the wider neuroscience community. However, concerns have recently been raised that the conclusions that are drawn from some human neuroimaging studies are either spurious or not generalizable. Problems such as low statistical power, flexibility in data analysis, software errors and a lack of direct replication apply to many fields, but perhaps particularly to functional MRI. Here, we discuss these problems, outline current and suggested best practices, and describe how we think the field should evolve to produce the most meaningful and reliable answers to neuroscientific questions.

SUBMITTER: Poldrack RA

PROVIDER: S-EPMC6910649 | biostudies-literature | 2017 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Scanning the horizon: towards transparent and reproducible neuroimaging research.

Poldrack Russell A RA Baker Chris I CI Durnez Joke J Gorgolewski Krzysztof J KJ Matthews Paul M PM Munafò Marcus R MR Nichols Thomas E TE Poline Jean-Baptiste JB Vul Edward E Yarkoni Tal T

Nature reviews. Neuroscience 20170105 2

Functional neuroimaging techniques have transformed our ability to probe the neurobiological basis of behaviour and are increasingly being applied by the wider neuroscience community. However, concerns have recently been raised that the conclusions that are drawn from some human neuroimaging studies are either spurious or not generalizable. Problems such as low statistical power, flexibility in data analysis, software errors and a lack of direct replication apply to many fields, but perhaps part ...[more]

PMID: 28053326

Similar Datasets

Reproducible and transparent research practices in published neurology research.

Project description:BackgroundThe objective of this study was to evaluate the nature and extent of reproducible and transparent research practices in neurology publications.MethodsThe NLM catalog was used to identify MEDLINE-indexed neurology journals. A PubMed search of these journals was conducted to retrieve publications over a 5-year period from 2014 to 2018. A random sample of publications was extracted. Two authors conducted data extraction in a blinded, duplicate fashion using a pilot-tested Google form. This form prompted data extractors to determine whether publications provided access to items such as study materials, raw data, analysis scripts, and protocols. In addition, we determined if the publication was included in a replication study or systematic review, was preregistered, had a conflict of interest declaration, specified funding sources, and was open access.ResultsOur search identified 223,932 publications meeting the inclusion criteria, from which 400 were randomly sampled. Only 389 articles were accessible, yielding 271 publications with empirical data for analysis. Our results indicate that 9.4% provided access to materials, 9.2% provided access to raw data, 0.7% provided access to the analysis scripts, 0.7% linked the protocol, and 3.7% were preregistered. A third of sampled publications lacked funding or conflict of interest statements. No publications from our sample were included in replication studies, but a fifth were cited in a systematic review or meta-analysis.ConclusionsCurrently, published neurology research does not consistently provide information needed for reproducibility. The implications of poor research reporting can both affect patient care and increase research waste. Collaborative intervention by authors, peer reviewers, journals, and funding sources is needed to mitigate this problem.

| S-EPMC7049215 | biostudies-literature

Horizon scanning for translational genomic research beyond bench to bedside.

Project description:PurposeThe dizzying pace of genomic discoveries is leading to an increasing number of clinical applications. In this report, we provide a method for horizon scanning and 1 year data on translational research beyond bench to bedside to assess the validity, utility, implementation, and outcomes of such applications.MethodsWe compiled cross-sectional results of ongoing horizon scanning of translational genomic research, conducted between 16 May 2012 and 15 May 2013, based on a weekly, systematic query of PubMed. A set of 505 beyond bench to bedside articles were collected and classified, including 312 original research articles; 123 systematic and other reviews; 38 clinical guidelines, policies, and recommendations; and 32 articles describing tools, decision support, and educational materials.ResultsMost articles (62%) addressed a specific genomic test or other health application; almost half of these (n = 180) were related to cancer. We estimate that these publications account for 0.5% of reported human genomics and genetics research during the same time.ConclusionThese data provide baseline information to track the evolving knowledge base and gaps in genomic medicine. Continuous horizon scanning of the translational genomics literature is crucial for an evidence-based translation of genomics discoveries into improved health care and disease prevention.

| S-EPMC4079725 | biostudies-literature

Orchestrating and sharing large multimodal data for transparent and reproducible research.

Project description:Reproducibility is essential to open science, as there is limited relevance for findings that can not be reproduced by independent research groups, regardless of its validity. It is therefore crucial for scientists to describe their experiments in sufficient detail so they can be reproduced, scrutinized, challenged, and built upon. However, the intrinsic complexity and continuous growth of biomedical data makes it increasingly difficult to process, analyze, and share with the community in a FAIR (findable, accessible, interoperable, and reusable) manner. To overcome these issues, we created a cloud-based platform called ORCESTRA ( orcestra.ca ), which provides a flexible framework for the reproducible processing of multimodal biomedical data. It enables processing of clinical, genomic and perturbation profiles of cancer samples through automated processing pipelines that are user-customizable. ORCESTRA creates integrated and fully documented data objects with persistent identifiers (DOI) and manages multiple dataset versions, which can be shared for future studies.

| S-EPMC8490371 | biostudies-literature

Digital open science-Teaching digital tools for reproducible and transparent research.

Project description:An important hallmark of science is the transparency and reproducibility of scientific results. Over the last few years, internet-based technologies have emerged that allow for a representation of the scientific process that goes far beyond traditional methods and analysis descriptions. Using these often freely available tools requires a suite of skills that is not necessarily part of a curriculum in the life sciences. However, funders, journals, and policy makers increasingly require researchers to ensure complete reproducibility of their methods and analyses. To close this gap, we designed an introductory course that guides students towards a reproducible science workflow. Here, we outline the course content and possible extensions, report encountered challenges, and discuss how to integrate such a course in existing curricula.

| S-EPMC6095603 | biostudies-other

Towards Molecular Simulations that are Transparent, Reproducible, Usable By Others, and Extensible (TRUE).

Project description:Systems composed of soft matter (e.g., liquids, polymers, foams, gels, colloids, and most biological materials) are ubiquitous in science and engineering, but molecular simulations of such systems pose particular computational challenges, requiring time and/or ensemble-averaged data to be collected over long simulation trajectories for property evaluation. Performing a molecular simulation of a soft matter system involves multiple steps, which have traditionally been performed by researchers in a "bespoke" fashion, resulting in many published soft matter simulations not being reproducible based on the information provided in the publications. To address the issue of reproducibility and to provide tools for computational screening, we have been developing the open-source Molecular Simulation and Design Framework (MoSDeF) software suite. In this paper, we propose a set of principles to create Transparent, Reproducible, Usable by others, and Extensible (TRUE) molecular simulations. MoSDeF facilitates the publication and dissemination of TRUE simulations by automating many of the critical steps in molecular simulation, thus enhancing their reproducibility. We provide several examples of TRUE molecular simulations: All of the steps involved in creating, running and extracting properties from the simulations are distributed on open-source platforms (within MoSDeF and on GitHub), thus meeting the definition of TRUE simulations.

| S-EPMC7576934 | biostudies-literature

A review of reproducible and transparent research practices in urology publications from 2014 to2018.

Project description:BackgroundReproducibility is essential for the integrity of scientific research. Reproducibility is measured by the ability of different investigators to replicate the outcomes of an original publication using the same materials and procedures. Unfortunately, reproducibility is not currently a standard being met by most scientific research.MethodsFor this review, we sampled 300 publications in the field of urology to assess for 14 indicators of reproducibility including material availability, raw data availability, analysis script availability, pre-registration information, links to protocols, and if the publication was available free to the public. Publications were also assessed for statements about conflicts of interest and funding sources.ResultsOf the 300 sample publications, 171 contained empirical data available for analysis of reproducibility. Of the 171 articles with empirical data to analyze, 0.58% provided links to protocols, 4.09% provided access to raw data, 3.09% provided access to materials, and 4.68% were pre-registered. None of the studies provided analysis scripts. Our review is cross-sectional in nature, including only PubMed indexed journals-published in English-and within a finite time period. Thus, our results should be interpreted in light of these considerations.ConclusionCurrent urology research does not consistently provide the components needed to reproduce original studies. Collaborative efforts from investigators and journal editors are needed to improve research quality while minimizing waste and patient risk.

| S-EPMC9277815 | biostudies-literature

Towards reproducible research in recurrent pregnancy loss immunology: Learning from cancer microenvironment deconvolution.

Project description:The most recent international guidelines regarding recurrent pregnancy loss (RPL) exclude most of the immunological tests recommended for RPL since they do not reach an evidence-based level. Comparisons for metanalysis and systematic reviews are limited by the ambiguity in terms of RPL definition, etiological and risk factors, diagnostic work-up, and treatments applied. Therefore, cohort heterogeneity, the inadequacy of numerosity, and the quality of data confirm a not standardized research quality in the RPL field, especially for immunological background, for which potential research application remains confined in a separate single biological layer. Innovative sequencing technologies and databases have proved to play a significant role in the exploration and validation of cancer research in the context of dataset quality and bioinformatics tools. In this article, we will investigate how bioinformatics tools born for large-scale cancer immunological research could revolutionize RPL immunological research but are limited by the nature of current RPL datasets.

| S-EPMC9996132 | biostudies-literature

Everything Matters: The ReproNim Perspective on Reproducible Neuroimaging.

Project description:There has been a recent major upsurge in the concerns about reproducibility in many areas of science. Within the neuroimaging domain, one approach is to promote reproducibility is to target the re-executability of the publication. The information supporting such re-executability can enable the detailed examination of how an initial finding generalizes across changes in the processing approach, and sampled population, in a controlled scientific fashion. ReproNim: A Center for Reproducible Neuroimaging Computation is a recently funded initiative that seeks to facilitate the "last mile" implementations of core re-executability tools in order to reduce the accessibility barrier and increase adoption of standards and best practices at the neuroimaging research laboratory level. In this report, we summarize the overall approach and tools we have developed in this domain.

| S-EPMC6374302 | biostudies-other

Towards a fair and transparent research participant compensation and reimbursement framework in Vietnam.

Project description:BackgroundProviding compensation for participants in clinical research is well established and while international guidelines exist, defining a context-specific and fair compensation for participants in low-resource settings is challenging due to ethical concerns and the lack of practical, national compensation and reimbursement frameworks.MethodsWe reviewed Oxford University Clinical Research Unit (OUCRU) internal reimbursement documentation over a 10-y period and conducted a scoping literature review to expand our knowledge of compensation and reimbursement practices including ethical concerns. We developed a preliminary reimbursement framework that was presented to community advisory boards (CAB) and clinical investigators to assess its applicability, fairness and transparency.ResultsThe main topics discussed at the workshops centered on fairness and whether the reimbursements could be perceived as financial incentives. Other decisive factors in the decision-making process were altruism and the loss of caregivers' earnings. Investigators raised the issue of additional burdens, whereas the CAB members were focused on non-monetary elements such as the healthcare quality the patients would receive. All elements discussed were reviewed and, where possible, incorporated into the final framework.ConclusionOur new reimbursement framework provides a consistent, fair and transparent decision-making process and will be implemented across all future OUCRU clinical research in Vietnam.

| S-EPMC7651161 | biostudies-literature

Scanning the horizon: a systematic literature review of methodologies.

Project description:ObjectivesSociety is confronted with the rapid emergence of innovation in science and technology. To manage this, horizon scanning is being adopted globally to identify, assess and prioritise innovations and trends at an early stage of their development. This enables decision-makers to be better informed and to prepare for change. The aim of this paper is to systematically identify and evaluate horizon scanning methodologies employed in the healthcare and biomedical fields.MethodsA systematic literature review was performed using PubMed and Embase and was supplemented with grey literature searches (2008-2018). The principal methodologies used in horizon scanning were extracted.ResultsApproximately 100 articles were summarised in a literature map. The search revealed many examples of horizon scanning across disciplines. Challenges, such as the need to refine prioritisation criteria, manage uncertainty inherent in the findings and improve the dissemination of identified issues, have been highlighted.ConclusionHorizon scanning, when performed appropriately, is a flexible and potentially reliable tool, with a wide variety of methods. Horizon scanning can inform and influence decision-making, through identifying opportunities and challenges, from an organisational to an international level. Further research to identify the most effective methodologies available would add depth to this landscape and enable the evolution of best practice to most efficiently anticipate novel developments and innovations.

| S-EPMC6549743 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data