Unknown

Dataset Information

0

Compression of next-generation sequencing reads aided by highly efficient de novo assembly.


ABSTRACT: UNLABELLED:We present Quip, a lossless compression algorithm for next-generation sequencing data in the FASTQ and SAM/BAM formats. In addition to implementing reference-based compression, we have developed, to our knowledge, the first assembly-based compressor, using a novel de novo assembly algorithm. A probabilistic data structure is used to dramatically reduce the memory required by traditional de Bruijn graph assemblers, allowing millions of reads to be assembled very efficiently. Read sequences are then stored as positions within the assembled contigs. This is combined with statistical compression of read identifiers, quality scores, alignment information and sequences, effectively collapsing very large data sets to <15% of their original size with no loss of information. AVAILABILITY:Quip is freely available under the 3-clause BSD license from http://cs.washington.edu/homes/dcjones/quip.

SUBMITTER: Jones DC 

PROVIDER: S-EPMC3526293 | biostudies-literature | 2012 Dec

REPOSITORIES: biostudies-literature

altmetric image

Publications

Compression of next-generation sequencing reads aided by highly efficient de novo assembly.

Jones Daniel C DC   Ruzzo Walter L WL   Peng Xinxia X   Katze Michael G MG  

Nucleic acids research 20120816 22


<h4>Unlabelled</h4>We present Quip, a lossless compression algorithm for next-generation sequencing data in the FASTQ and SAM/BAM formats. In addition to implementing reference-based compression, we have developed, to our knowledge, the first assembly-based compressor, using a novel de novo assembly algorithm. A probabilistic data structure is used to dramatically reduce the memory required by traditional de Bruijn graph assemblers, allowing millions of reads to be assembled very efficiently. Re  ...[more]

Similar Datasets

| S-EPMC3726674 | biostudies-literature
| S-EPMC4120091 | biostudies-literature
| S-EPMC4682372 | biostudies-literature
| S-EPMC2945192 | biostudies-literature
| S-EPMC3137213 | biostudies-literature
| S-EPMC9946810 | biostudies-literature
| S-EPMC10997618 | biostudies-literature
| S-EPMC4154752 | biostudies-literature
| S-EPMC3639258 | biostudies-literature
| S-EPMC3158087 | biostudies-literature