Dataset Information
Data-dependent bucketing improves reference-free compression of sequencing reads.
Ontology highlight
ABSTRACT: Motivation
The storage and transmission of high-throughput sequencing data consumes significant resources. As our capacity to produce such data continues to increase, this burden will only grow. One approach to reduce storage and transmission requirements is to compress this sequencing data.Results
We present a novel technique to boost the compression of sequencing that is based on the concept of bucketing similar reads so that they appear nearby in the file. We demonstrate that, by adopting a data-dependent bucketing scheme and employing a number of encoding ideas, we can achieve substantially better compression ratios than existing de novo sequence compression tools, including other bucketing and reordering schemes. Our method, Mince, achieves up to a 45% reduction in file sizes (28% on average) compared with existing state-of-the-art de novo compression schemes.Availability and implementation
Mince is written in C++11, is open source and has been made available under the GPLv3 license. It is available at http://www.cs.cmu.edu/?ckingsf/software/mince.Contact
carlk@cs.cmu.eduSupplementary information
Supplementary data are available at Bioinformatics online.
SUBMITTER: Patro R
PROVIDER: S-EPMC4547610 | biostudies-literature | 2015 Sep
REPOSITORIES: biostudies-literature
Publications
Data-dependent bucketing improves reference-free compression of sequencing reads.
Bioinformatics (Oxford, England) 20150424 17
<h4>Motivation</h4>The storage and transmission of high-throughput sequencing data consumes significant resources. As our capacity to produce such data continues to increase, this burden will only grow. One approach to reduce storage and transmission requirements is to compress this sequencing data.<h4>Results</h4>We present a novel technique to boost the compression of sequencing that is based on the concept of bucketing similar reads so that they appear nearby in the file. We demonstrate that, ...[more]