Falco: high-speed FastQC emulation for quality control of sequencing data.
Ontology highlight
ABSTRACT:
SUBMITTER: de Sena Brandine G
PROVIDER: S-EPMC7845152 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:MOTIVATION:Detection of random errors and systematic biases is a crucial step of a robust pipeline for processing high-throughput sequencing (HTS) data. Bioinformatics software tools capable of performing this task are available, either for general analysis of HTS data or targeted to a specific sequencing technology. However, most of the existing QC instruments only allow processing of one sample at a time. RESULTS:Qualimap 2 represents a next step in the QC analysis of HTS data. Along with comprehensive single-sample analysis of alignment data, it includes new modes that allow simultaneous processing and comparison of multiple samples. As with the first version, the new features are available via both graphical and command line interface. Additionally, it includes a large number of improvements proposed by the user community. AVAILABILITY AND IMPLEMENTATION:The implementation of the software along with documentation is freely available at http://www.qualimap.org. CONTACT:meyer@mpiib-berlin.mpg.de SUPPLEMENTARY INFORMATION:Supplementary data are available at Bioinformatics online.
| S-EPMC4708105 | biostudies-literature
Project description:Quality control and read preprocessing are critical steps in the analysis of data sets generated from high-throughput genomic screens. In the most extreme cases, improper preprocessing can negatively affect downstream analyses and may lead to incorrect biological conclusions. Here, we present PathoQC, a streamlined toolkit that seamlessly combines the benefits of several popular quality control software approaches for preprocessing next-generation sequencing data. PathoQC provides a variety of quality control options appropriate for most high-throughput sequencing applications. PathoQC is primarily developed as a module in the PathoScope software suite for metagenomic analysis. However, PathoQC is also available as an open-source Python module that can run as a stand-alone application or can be easily integrated into any bioinformatics workflow. PathoQC achieves high performance by supporting parallel computation and is an effective tool that removes technical sequencing artifacts and facilitates robust downstream analysis. The PathoQC software package is available at http://sourceforge.net/projects/PathoScope/.
| S-EPMC4429651 | biostudies-literature
Project description:BACKGROUND:High throughput DNA/RNA sequencing has revolutionized biological and clinical research. Sequencing is widely used, and generates very large amounts of data, mainly due to reduced cost and advanced technologies. Quickly assessing the quality of giga-to-tera base levels of sequencing data has become a routine but important task. Identification and elimination of low-quality sequence data is crucial for reliability of downstream analysis results. There is a need for a high-speed tool that uses optimized parallel programming for batch processing and simply gauges the quality of sequencing data from multiple datasets independent of any other processing steps. RESULTS:FQStat is a stand-alone, platform-independent software tool that assesses the quality of FASTQ files using parallel programming. Based on the machine architecture and input data, FQStat automatically determines the number of cores and the amount of memory to be allocated per file for optimum performance. Our results indicate that in a core-limited case, core assignment overhead exceeds the benefit of additional cores. In a core-unlimited case, there is a saturation point reached in performance by increasingly assigning additional cores per file. We also show that memory allocation per file has a lower priority in performance when compared to the allocation of cores. FQStat's output is summarized in HTML web page, tab-delimited text file, and high-resolution image formats. FQStat calculates and plots read count, read length, quality score, and high-quality base statistics. FQStat identifies and marks low-quality sequencing data to suggest removal from downstream analysis. We applied FQStat on real sequencing data to optimize performance and to demonstrate its capabilities. We also compared FQStat's performance to similar quality control (QC) tools that utilize parallel programming and attained improvements in run time. CONCLUSIONS:FQStat is a user-friendly tool with a graphical interface that employs a parallel programming architecture and automatically optimizes its performance to generate quality control statistics for sequencing data. Unlike existing tools, these statistics are calculated for multiple datasets and separately at the "lane," "sample," and "experiment" level to identify subsets of the samples with low quality, thereby preventing the loss of complete samples when reliable data can still be obtained.
| S-EPMC6694608 | biostudies-literature
Project description:Traditional Chinese medicine (TCM)has played an important role in promoting the health of Chinese people. The TCM Psoralea corylifolia L. has been used in the treatment of various kinds of diseases including enuresis, vitiligo, and calvities. However, therapeutic effects of P. corylifolia L. have often influenced by the quality of plants. So, it is very important to control the quality of P. corylifolia L. In this study, analytical high-speed countercurrent chromatography (HSCCC) was successfully used to fingerprint P. corylifolia L. Samples of P. corylifolia L. were extracted by ultrasonic extraction. n-hexane-ethyl acetate-methanol-water at a ratio of 5:5.5:6.5:5 (v/v) was selected as a two-phase solvent system and the condition of HSCCC were optimized in order to good separation. And the method of HSCCC was verified (reproducibility, precision, and stability). HSCCC chromatograms exhibited six common peaks, which were selected as indicator compounds for the quality control of P. corylifolia L. Within 20 types of medicinal materials, chemical components are similar, but the levels of components are quite different in HSCCC fingerprint. The present results demonstrate that the HSCCC method provides a reliable basis for the quality control of P. corylifolia L. and can also be applied to confirm the authenticity of plant materials.
| S-EPMC7024294 | biostudies-literature
Project description:Use of high-throughput sequencing (HTS) has become indispensable in life science research. Raw HTS data contains several sequencing artifacts, and as a first step it is imperative to remove the artifacts for reliable downstream bioinformatics analysis. Although there are multiple stand-alone tools available that can perform the various quality control steps separately, availability of an integrated tool that can allow one-step, automated quality control analysis of HTS datasets will significantly enhance handling large number of samples parallelly. Here, we developed HTSQualC, a stand-alone, flexible, and easy-to-use software for one-step quality control analysis of raw HTS data. HTSQualC can evaluate HTS data quality and perform filtering and trimming analysis in a single run. We evaluated the performance of HTSQualC for conducting batch analysis of HTS datasets with 322 samples with an average ~ 1 M (paired end) sequence reads per sample. HTSQualC accomplished the QC analysis in ~ 3 h in distributed mode and ~ 31 h in shared mode, thus underscoring its utility and robust performance. In addition to command-line execution, we integrated HTSQualC into the free, open-source, CyVerse cyberinfrastructure resource as a GUI interface, for wider access to experimental biologists who have limited computational resources and/or programming abilities.
| S-EPMC8455540 | biostudies-literature
Project description:Quantitative high throughput screening (qHTS) experiments can generate 1000s of concentration-response profiles to screen compounds for potentially adverse effects. However, potency estimates for a single compound can vary considerably in study designs incorporating multiple concentration-response profiles for each compound. We introduce an automated quality control procedure based on analysis of variance (ANOVA) to identify and filter out compounds with multiple cluster response patterns and improve potency estimation in qHTS assays. Our approach, called Cluster Analysis by Subgroups using ANOVA (CASANOVA), clusters compound-specific response patterns into statistically supported subgroups. Applying CASANOVA to 43 publicly available qHTS data sets, we found that only about 20% of compounds with response values outside of the noise band have single cluster responses. The error rates for incorrectly separating true clusters and incorrectly clumping disparate clusters were both less than 5% in extensive simulation studies. Simulation studies also showed that the bias and variance of concentration at half-maximal response (AC50 ) estimates were usually within 10-fold when using a weighted average approach for potency estimation. In short, CASANOVA effectively sorts out compounds with "inconsistent" response patterns and produces trustworthy AC50 values.
| S-EPMC6520559 | biostudies-literature
Project description:Next-generation sequencing (NGS) technologies have dramatically expanded the breadth of genomics. Genome-scale data, once restricted to a small number of biomedical model organisms, can now be generated for virtually any species at remarkable speed and low cost. Yet non-model organisms often lack a suitable reference to map sequence reads against, making alignment-based quality control (QC) of NGS data more challenging than cases where a well-assembled genome is already available. Here we show that by generating a rapid, non-optimized draft assembly of raw reads, it is possible to obtain reliable and informative QC metrics, thus removing the need for a high quality reference. We use benchmark datasets generated from control samples across a range of genome sizes to illustrate that QC inferences made using draft assemblies are broadly equivalent to those made using a well-established reference, and describe QC tools routinely used in our production facility to assess the quality of NGS data from non-model organisms.
| S-EPMC4018527 | biostudies-literature
Project description:Advances in next-generation sequencing (NGS) technologies have greatly improved our ability to detect genomic variants for biomedical research. In particular, NGS technologies have been recently applied with great success to the discovery of mutations associated with the growth of various tumours and in rare Mendelian diseases. The advance in NGS technologies has also created significant challenges in bioinformatics. One of the major challenges is quality control of the sequencing data. In this review, we discuss the proper quality control procedures and parameters for Illumina technology-based human DNA re-sequencing at three different stages of sequencing: raw data, alignment and variant calling. Monitoring quality control metrics at each of the three stages of NGS data provides unique and independent evaluations of data quality from differing perspectives. Properly conducting quality control protocols at all three stages and correctly interpreting the quality control results are crucial to ensure a successful and meaningful study.
| S-EPMC4492405 | biostudies-literature
Project description:Quality control (QC) and preprocessing are essential steps for sequencing data analysis to ensure the accuracy of results. However, existing tools cannot provide a satisfying solution with integrated comprehensive functions, proper architectures, and highly scalable acceleration. In this article, we demonstrate SOAPnuke as a tool with abundant functions for a "QC-Preprocess-QC" workflow and MapReduce acceleration framework. Four modules with different preprocessing functions are designed for processing datasets from genomic, small RNA, Digital Gene Expression, and metagenomic experiments, respectively. As a workflow-like tool, SOAPnuke centralizes processing functions into 1 executable and predefines their order to avoid the necessity of reformatting different files when switching tools. Furthermore, the MapReduce framework enables large scalability to distribute all the processing works to an entire compute cluster.We conducted a benchmarking where SOAPnuke and other tools are used to preprocess a ?30× NA12878 dataset published by GIAB. The standalone operation of SOAPnuke struck a balance between resource occupancy and performance. When accelerated on 16 working nodes with MapReduce, SOAPnuke achieved ?5.7 times the fastest speed of other tools.
| S-EPMC5788068 | biostudies-literature
Project description:PurposeConcurrent EEG and fMRI is increasingly used to characterize the spatial-temporal dynamics of brain activity. However, most studies to date have been limited to conventional echo-planar imaging (EPI). There is considerable interest in integrating recently developed high-speed fMRI methods with high-density EEG to increase temporal resolution and sensitivity for task-based and resting state fMRI, and for detecting interictal spikes in epilepsy. In the present study using concurrent high-density EEG and recently developed high-speed fMRI methods, we investigate safety of radiofrequency (RF) related heating, the effect of EEG on cortical signal-to-noise ratio (SNR) in fMRI, and assess EEG data quality.Materials and methodsThe study compared EPI, multi-echo EPI, multi-band EPI and multi-slab echo-volumar imaging pulse sequences, using clinical 3 Tesla MR scanners from two different vendors that were equipped with 64- and 256-channel MR-compatible EEG systems, respectively, and receive only array head coils. Data were collected in 11 healthy controls (3 males, age range 18-70 years) and 13 patients with epilepsy (8 males, age range 21-67 years). Three of the healthy controls were scanned with the 256-channel EEG system, the other subjects were scanned with the 64-channel EEG system. Scalp surface temperature, SNR in occipital cortex and head movement were measured with and without the EEG cap. The degree of artifacts and the ability to identify background activity was assessed by visual analysis by a trained expert in the 64 channel EEG data (7 healthy controls, 13 patients).ResultsRF induced heating at the surface of the EEG electrodes during a 30-minute scan period with stable temperature prior to scanning did not exceed 1.0° C with either EEG system and any of the pulse sequences used in this study. There was no significant decrease in cortical SNR due to the presence of the EEG cap (p > 0.05). No significant differences in the visually analyzed EEG data quality were found between EEG recorded during high-speed fMRI and during conventional EPI (p = 0.78). Residual ballistocardiographic artifacts resulted in 58% of EEG data being rated as poor quality.ConclusionThis study demonstrates that high-density EEG can be safely implemented in conjunction with high-speed fMRI and that high-speed fMRI does not adversely affect EEG data quality. However, the deterioration of the EEG quality due to residual ballistocardiographic artifacts remains a significant constraint for routine clinical applications of concurrent EEG-fMRI.
| S-EPMC5446172 | biostudies-literature