Unknown

Dataset Information

0

Detecting and correcting misclassified sequences in the large-scale public databases.


ABSTRACT:

Motivation

As the cost of sequencing decreases, the amount of data being deposited into public repositories is increasing rapidly. Public databases rely on the user to provide metadata for each submission that is prone to user error. Unfortunately, most public databases, such as non-redundant (NR), rely on user input and do not have methods for identifying errors in the provided metadata, leading to the potential for error propagation. Previous research on a small subset of the NR database analyzed misclassification based on sequence similarity. To the best of our knowledge, the amount of misclassification in the entire database has not been quantified. We propose a heuristic method to detect potentially misclassified taxonomic assignments in the NR database. We applied a curation technique and quality control to find the most probable taxonomic assignment. Our method incorporates provenance and frequency of each annotation from manually and computationally created databases and clustering information at 95% similarity.

Results

We found more than two million potentially taxonomically misclassified proteins in the NR database. Using simulated data, we show a high precision of 97% and a recall of 87% for detecting taxonomically misclassified proteins. The proposed approach and findings could also be applied to other databases.

Availability and implementation

Source code, dataset, documentation, Jupyter notebooks and Docker container are available at https://github.com/boalang/nr.

Supplementary information

Supplementary data are available at Bioinformatics online.

SUBMITTER: Bagheri H 

PROVIDER: S-EPMC7821992 | biostudies-literature | 2020 Sep

REPOSITORIES: biostudies-literature

altmetric image

Publications

Detecting and correcting misclassified sequences in the large-scale public databases.

Bagheri Hamid H   Severin Andrew J AJ   Rajan Hridesh H  

Bioinformatics (Oxford, England) 20200901 18


<h4>Motivation</h4>As the cost of sequencing decreases, the amount of data being deposited into public repositories is increasing rapidly. Public databases rely on the user to provide metadata for each submission that is prone to user error. Unfortunately, most public databases, such as non-redundant (NR), rely on user input and do not have methods for identifying errors in the provided metadata, leading to the potential for error propagation. Previous research on a small subset of the NR databa  ...[more]

Similar Datasets

| S-EPMC4160374 | biostudies-literature
| S-EPMC2718670 | biostudies-literature
| S-EPMC8363810 | biostudies-literature
| S-EPMC6110253 | biostudies-literature
2009-11-30 | GSE18619 | GEO
| S-EPMC3713709 | biostudies-literature
| S-EPMC1762357 | biostudies-literature
2010-05-19 | E-GEOD-18619 | biostudies-arrayexpress
| S-EPMC2742552 | biostudies-literature
| S-EPMC8631639 | biostudies-literature