Dataset Information

Balancing efficient analysis and storage of quantitative genomics data with the D4 format and d4tools.

ABSTRACT: Modern DNA sequencing is used as a readout for diverse assays, with the count of aligned sequences (read depth) representing the quantitative signal for each underlying cellular phenomena. Existing data formats for quantitative genomics assays are, however, limited in either the analysis speeds they enable, the disk space they require or both. We have developed the dense depth data dump (D4) format and tool suite, with the goal of balancing improved analysis speeds with file size. The D4 format is adaptive in that it profiles a random sample of aligned sequence depth from the input sequence file to determine an optimal encoding that enables fast data access. We demonstrate that the D4 format offers substantial speed improvements over existing formats for random access, aggregation and summarization, while also achieving better or comparable file sizes. This performance enables scalable downstream analyses that would be otherwise difficult.

SUBMITTER: Hou H

PROVIDER: S-EPMC9355464 | biostudies-literature | 2021 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Balancing efficient analysis and storage of quantitative genomics data with the D4 format and d4tools.

Hou Hao H Pedersen Brent B Quinlan Aaron A

Nature computational science 20210621 6

Modern DNA sequencing is used as a readout for diverse assays, with the count of aligned sequences (read depth) representing the quantitative signal for each underlying cellular phenomena. Existing data formats for quantitative genomics assays are, however, limited in either the analysis speeds they enable, the disk space they require or both. We have developed the dense depth data dump (D4) format and tool suite, with the goal of balancing improved analysis speeds with file size. The D4 format ...[more]

PMID: 35936573

Similar Datasets

Project description:In immunocompromised hosts, latent infection with Toxoplasma gondii can reactivate from tissue cysts, leading to encephalitis. A characteristic of T. gondii bradyzoites in tissue cysts is the presence of amylopectin granules. The regulatory mechanisms and role of amylopectin accumulation in this organism are not fully understood. The T. gondii genome encodes a putative glycogen phosphorylase (TgGP), and mutants were constructed to manipulate the activity of TgGP and to evaluate the function of TgGP in amylopectin storage. Both a stop codon mutant (Pru/TgGPS25stop [expressing a Ser-to-stop codon change at position 25 in TgGP]) and a phosphorylation null mutant (Pru/TgGPS25A [expressing a Ser-to-Ala change at position 25 in TgGp]) mutated at Ser25 displayed amylopectin accumulation, while the phosphorylation-mimetic mutant (Pru/TgGPS25E [expressing a Ser-to-Glu change at position 25 in TgGp]) had minimal amylopectin accumulation under both tachyzoite and bradyzoite growth conditions. The expression of active TgGPS25S or TgGPS25E restored amylopectin catabolism in Pru/TgGPS25A To understand the relation between GP and calcium-dependent protein kinase 2 (CDPK2), which was recently reported to regulate amylopectin consumption, we knocked out CDPK2 in these mutants. PruΔcdpk2/TgGPS25E had minimal amylopectin accumulation, whereas the Δcdpk2 phenotype in the other GP mutants and parental lines displayed amylopectin accumulation. Both the inactive S25A and hyperactive S25E mutant produced brain cysts in infected mice, but the numbers of cysts produced were significantly less than the number produced by the S25S wild-type GP parasite. Complementation that restored amylopectin regulation restored brain cyst production to the control levels seen in infected mice. These data suggest that T. gondii requires tight regulation of amylopectin expression for efficient production of cysts and persistent infections and that GP phosphorylation is a regulatory mechanism involved in amylopectin storage and utilization.IMPORTANCEToxoplasma gondii is an obligate intracellular parasite that causes disease in immune-suppressed individuals, as well as a fetopathy in pregnant women who acquire infection for the first time during pregnancy. This parasite can differentiate between tachyzoites (seen in acute infection) and bradyzoites (seen in latent infection), and this differentiation is associated with disease relapse. A characteristic of bradyzoites is that they contain cytoplasmic amylopectin granules. The regulatory mechanisms and the roles of amylopectin granules during latent infection remain to be elucidated. We have identified a role of T. gondii glycogen phosphorylase (TgGP) in the regulation of starch digestion and a role of posttranslational modification of TgGP, i.e., phosphorylation of Ser25, in the regulation of amylopectin digestion. By manipulating TgGP activity in the parasite with genome editing, we found that the digestion and storage of amylopectin due to TgGP activity are both important for latency in the brain.

Project description:Data storage in DNA has recently emerged as a promising archival solution, offering space-efficient and long-lasting digital storage solutions. Recent studies suggest leveraging the inherent redundancy of synthesis and sequencing technologies by using composite DNA alphabets. A major challenge of this approach involves the noisy inference process, obstructing large composite alphabets. This paper introduces a novel approach for DNA-based data storage, offering, in some implementations, a 6.5-fold increase in logical density over standard DNA-based storage systems, with near-zero reconstruction error. Combinatorial DNA encoding uses a set of clearly distinguishable DNA shortmers to construct large combinatorial alphabets, where each letter consists of a subset of shortmers. We formally define various combinatorial encoding schemes and investigate their theoretical properties. These include information density and reconstruction probabilities, as well as required synthesis and sequencing multiplicities. We then propose an end-to-end design for a combinatorial DNA-based data storage system, including encoding schemes, two-dimensional (2D) error correction codes, and reconstruction algorithms, under different error regimes. We performed simulations and show, for example, that the use of 2D Reed-Solomon error correction has significantly improved reconstruction rates. We validated our approach by constructing two combinatorial sequences using Gibson assembly, imitating a 4-cycle combinatorial synthesis process. We confirmed the successful reconstruction, and established the robustness of our approach for different error types. Subsampling experiments supported the important role of sampling rate and its effect on the overall performance. Our work demonstrates the potential of combinatorial shortmer encoding for DNA-based data storage and describes some theoretical research questions and technical challenges. Combining combinatorial principles with error-correcting strategies, and investing in the development of DNA synthesis technologies that efficiently support combinatorial synthesis, can pave the way to efficient, error-resilient DNA-based storage solutions.

Dataset Information

Balancing efficient analysis and storage of quantitative genomics data with the D4 format and d4tools.

Publications

Balancing efficient analysis and storage of quantitative genomics data with the D4 format and d4tools.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets