Unknown

Dataset Information

0

QVZ: lossy compression of quality values.


ABSTRACT: Recent advancements in sequencing technology have led to a drastic reduction in the cost of sequencing a genome. This has generated an unprecedented amount of genomic data that must be stored, processed and transmitted. To facilitate this effort, we propose a new lossy compressor for the quality values presented in genomic data files (e.g. FASTQ and SAM files), which comprise roughly half of the storage space (in the uncompressed domain). Lossy compression allows for compression of data beyond its lossless limit.The proposed algorithm QVZ exhibits better rate-distortion performance than the previously proposed algorithms, for several distortion metrics and for the lossless case. Moreover, it allows the user to define any quasi-convex distortion function to be minimized, a feature not supported by the previous algorithms. Finally, we show that QVZ-compressed data exhibit better performance in the genotyping than data compressed with previously proposed algorithms, in the sense that for a similar rate, a genotyping closer to that achieved with the original quality values is obtained.QVZ is written in C and can be downloaded from https://github.com/mikelhernaez/qvz.mhernaez@stanford.edu or gmalysa@stanford.edu or iochoa@stanford.eduSupplementary data are available at Bioinformatics online.

SUBMITTER: Malysa G 

PROVIDER: S-EPMC5856090 | biostudies-other | 2015 Oct

REPOSITORIES: biostudies-other

altmetric image

Publications

QVZ: lossy compression of quality values.

Malysa Greg G   Hernaez Mikel M   Ochoa Idoia I   Rao Milind M   Ganesan Karthik K   Weissman Tsachy T  

Bioinformatics (Oxford, England) 20150528 19


<h4>Motivation</h4>Recent advancements in sequencing technology have led to a drastic reduction in the cost of sequencing a genome. This has generated an unprecedented amount of genomic data that must be stored, processed and transmitted. To facilitate this effort, we propose a new lossy compressor for the quality values presented in genomic data files (e.g. FASTQ and SAM files), which comprise roughly half of the storage space (in the uncompressed domain). Lossy compression allows for compressi  ...[more]

Similar Datasets

| S-EPMC6330002 | biostudies-literature
| S-EPMC5946873 | biostudies-literature
| S-EPMC5568552 | biostudies-literature
| S-EPMC6873394 | biostudies-literature
| S-EPMC6277120 | biostudies-literature
| S-EPMC3377704 | biostudies-literature
| S-EPMC5862240 | biostudies-literature
| S-EPMC7372835 | biostudies-literature
| S-EPMC5946613 | biostudies-literature
| S-EPMC8683719 | biostudies-literature