Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Dataset decay and the problem of sequential analyses on open datasets.

ABSTRACT: Open data allows researchers to explore pre-existing datasets in new ways. However, if many researchers reuse the same dataset, multiple statistical testing may increase false positives. Here we demonstrate that sequential hypothesis testing on the same dataset by multiple researchers can inflate error rates. We go on to discuss a number of correction procedures that can reduce the number of false positives, and the challenges associated with these correction procedures.

SUBMITTER: Thompson WH

PROVIDER: S-EPMC7237204 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Dataset decay and the problem of sequential analyses on open datasets.

Thompson William Hedley WH Wright Jessey J Bissett Patrick G PG Poldrack Russell A RA

eLife 20200519

Open data allows researchers to explore pre-existing datasets in new ways. However, if many researchers reuse the same dataset, multiple statistical testing may increase false positives. Here we demonstrate that sequential hypothesis testing on the same dataset by multiple researchers can inflate error rates. We go on to discuss a number of correction procedures that can reduce the number of false positives, and the challenges associated with these correction procedures. ...[more]

PMID: 32425159

Similar Datasets

A beginner's guide into curated analyses of open access datasets for biomarker discovery in neurodegeneration.

Project description:The discovery of surrogate biomarkers reflecting neuronal dysfunction in neurodegenerative diseases (NDDs) remains an active area of research. To boost these efforts, we demonstrate the utility of publicly available datasets for probing the pathogenic relevance of candidate markers in NDDs. As a starting point, we introduce the readers to several open access resources, which contain gene expression profiles and proteomics datasets from patient studies in common NDDs, including proteomics analyses of cerebrospinal fluid (CSF). Then, we illustrate the method for curated gene expression analyses across select brain regions from four cohorts of Parkinson disease patients (and from one study in common NDDs), probing glutathione biogenesis, calcium signaling and autophagy. These data are complemented by findings of select markers in CSF-based studies in NDDs. Additionally, we enclose several annotated microarray studies, and summarize reports on CSF proteomics across the NDDs, which the readers can utilize for translational purposes. We anticipate that this "beginner's guide" will benefit the research community in NDDs, and would serve as a useful educational tool.

| S-EPMC10325954 | biostudies-literature

The Amsterdam Open MRI Collection, a set of multimodal MRI datasets for individual difference analyses.

Project description:We present the Amsterdam Open MRI Collection (AOMIC): three datasets with multimodal (3 T) MRI data including structural (T1-weighted), diffusion-weighted, and (resting-state and task-based) functional BOLD MRI data, as well as detailed demographics and psychometric variables from a large set of healthy participants (N = 928, N = 226, and N = 216). Notably, task-based fMRI was collected during various robust paradigms (targeting naturalistic vision, emotion perception, working memory, face perception, cognitive conflict and control, and response inhibition) for which extensively annotated event-files are available. For each dataset and data modality, we provide the data in both raw and preprocessed form (both compliant with the Brain Imaging Data Structure), which were subjected to extensive (automated and manual) quality control. All data is publicly available from the OpenNeuro data sharing platform.

| S-EPMC7979787 | biostudies-literature

Development of brain networks for social functions: Confirmatory analyses in a large open source dataset.

Project description:Human observers show robust activity in distinct brain networks during movie-viewing. For example, scenes that emphasize characters' thoughts evoke activity in the "Theory of Mind" (ToM) network, whereas scenes that emphasize characters' bodily sensations evoke activity in the "Pain Matrix." A prior exploratory fMRI study used a naturalistic movie-viewing stimulus to study the developmental origins of this functional dissociation, and the links between cortical and cognitive changes in children's social development (Richardson et al., 2018). To replicate and extend this work, the current study utilized a large publicly available dataset (n = 241, ages 5-20 years) (Alexander et al., 2017) who viewed "The Present" (Frey, 2014) and completed a resting state scan (n = 200) while undergoing fMRI. This study provides confirmatory evidence that 1) ToM and pain networks are functionally dissociated early in development, 2) selectivity increases with age, and in ToM regions, with a behavioral index of social reasoning. Additionally, while inter-region correlations are similar when measured during the movie and at rest, only inter-region correlations measured during movie-viewing correlated with functional maturity. This study demonstrates the scientific benefits of open source data in developmental cognitive neuroscience, and provides insight into the relationship between functional and intrinsic properties of the developing brain.

| S-EPMC6969289 | biostudies-literature

SeEn: Sequential enriched datasets for sequence-aware recommendations.

Project description:The recommendation of items based on the sequential past users' preferences has evolved in the last few years, mostly due to deep learning approaches, such as BERT4Rec. However, in scientific fields, recommender systems for recommending the next best item are not widely used. The main goal of this work is to improve the results for the recommendation of the next best item in scientific domains using sequence aware datasets and algorithms. In the first part of this work, we present the adaptation of a previous method (LIBRETTI) for creating sequential recommendation datasets for scientific fields. The results were assessed in Astronomy and Chemistry. In the second part of this work, we propose a new approach to improve the datasets, not the algorithms, to obtain better recommendations. The new hybrid approach is called sequential enrichment (SeEn), which consists of adding to a sequence of items the n most similar items after each original item. The results show that the enriched sequences obtained better results than the original ones. The Chemistry dataset improved by approximately seven percentage points and the Astronomy dataset by 16 percentage points for Hit Ratio and Normalized Discounted Cumulative Gain.

| S-EPMC9352715 | biostudies-literature

Dataset for the electric capacitated traveling salesman problem.

Project description:Regarding climate change and energy resource problems, cargo movement in the urban environment is essential to shift to a more sustainable mode. As cities seek to slash transport-related emissions and tackle traffic congestion, the cargo bike is showing itself to be an attractive and versatile last-mile delivery alternative. To this end, this article presents a series of datasets for the Electric Capacitated Travelling Salesman Problem (EC-TSP). This problem has been built for modeling and solving the e-cargo bike parcel distribution problem in urban environments. For the design of these datasets, real geographical data have been used that are in the city centers of Athens, Thessaloniki, Patra, and Larisa in Greece. These datasets have been used for the assessment of e-cargo bikes versus typical delivery vans in terms of operational efficiency and CO2e emissions. The entire benchmark is composed of 9 instances comprised of 14-29 nodes each. The datasets are publicly available for use and modification.

| S-EPMC10430151 | biostudies-literature

A FAIR and AI-ready Higgs boson decay dataset.

Project description:To enable the reusability of massive scientific datasets by humans and machines, researchers aim to adhere to the principles of findability, accessibility, interoperability, and reusability (FAIR) for data and artificial intelligence (AI) models. This article provides a domain-agnostic, step-by-step assessment guide to evaluate whether or not a given dataset meets these principles. We demonstrate how to use this guide to evaluate the FAIRness of an open simulated dataset produced by the CMS Collaboration at the CERN Large Hadron Collider. This dataset consists of Higgs boson decays and quark and gluon background, and is available through the CERN Open Data Portal. We use additional available tools to assess the FAIRness of this dataset, and incorporate feedback from members of the FAIR community to validate our results. This article is accompanied by a Jupyter notebook to visualize and explore this dataset. This study marks the first in a planned series of articles that will guide scientists in the creation of FAIR AI models and datasets in high energy particle physics.

| S-EPMC8844008 | biostudies-literature

Problem instances dataset of a real-world sequencing problem with transition constraints and asymmetric costs.

Project description:This data article describes 30 instances of the real-world problem of sequencing steel coils in a continuous galvanizing line. Each instance is represented by a cost matrix that gives information of the cost of sequencing each pair of coils or items together (e.g. a transition). Some transitions are forbidden due to technical limitations of the line and/or because of the properties of the coils, what makes the problem more challenging. These costs were previously obtained by a cost model that estimates the final cost of each transition for a set of coils to be sequenced in the line. Although the instances come from this real context, the problem can be theoretically seen as finding a minimum cost Hamiltonian path (e.g. a minimum cost feasible production sequence with all the coils appearing just once). It is a well-known NP-Hard combinatorial optimization problem. Since these instances represent real challenges found in the industry, they can be very useful for algorithm development and testing. Due to the cost distributions obtained for the given coils, just finding a feasible sequence can be a challenging task, especially for some types of approximate algorithms (Alvarez-Gil et al., 2022).

| S-EPMC8804161 | biostudies-literature

Dataset for the cumulative unmanned aerial vehicle routing problem.

Project description:The Cumulative Unmanned Aerial Vehicle Routing Problem applies to area covering operations using UAVs. It is defined on a graph, the nodes of which, ensure the complete coverage of the underlying area of interest. The data generation process takes into account the characteristics of such operations, in particular, the viewing window of the UAVs' sensor, their maximum range, the size of the UAV fleet and the unknown locations of the targets within the area of interest. Instances are created simulating different scenarios, using different values for those UAV characteristics, as well as the different locations where the search targets might be positioned in the area of interest.

| S-EPMC10294095 | biostudies-literature

Open University Learning Analytics dataset.

Project description:Learning Analytics focuses on the collection and analysis of learners' data to improve their learning experience by providing informed guidance and to optimise learning materials. To support the research in this area we have developed a dataset, containing data from courses presented at the Open University (OU). What makes the dataset unique is the fact that it contains demographic data together with aggregated clickstream data of students' interactions in the Virtual Learning Environment (VLE). This enables the analysis of student behaviour, represented by their actions. The dataset contains the information about 22 courses, 32,593 students, their assessment results, and logs of their interactions with the VLE represented by daily summaries of student clicks (10,655,280 entries). The dataset is freely available at https://analyse.kmi.open.ac.uk/open_dataset under a CC-BY 4.0 license.

| S-EPMC5704676 | biostudies-literature

A benchmark dataset for the multiple depot vehicle scheduling problem.

Project description:This data article presents a description of a benchmark dataset for the multiple depot vehicle scheduling problem (MDVSP). The MDVSP is to assign vehicles from different depots to timetabled trips to minimize the total cost of empty travel and waiting. The dataset has been developed to evaluate the heuristics of the MDVSP that are presented in "A new formulation and a column generation-based heuristic for the multiple depot vehicle scheduling problem" (Kulkarni et al., 2018). The dataset contains 60 problem instances of varying size. Researchers can use the dataset to evaluate the future algorithms for the MDVSP and compare the performance with the existing algorithms. The dataset includes a program that can be used to generate new problem instances of the MDVSP.

| S-EPMC6312793 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data