Dataset Information

Comparison of RNA-seq and microarray-based models for clinical endpoint prediction.

ABSTRACT: Gene expression profiling is being widely applied in cancer research to identify biomarkers for clinical endpoint prediction. Since RNA-seq provides a powerful tool for transcriptome-based applications beyond the limitations of microarrays, we sought to systematically evaluate the performance of RNA-seq-based and microarray-based classifiers in this MAQC-III/SEQC study for clinical endpoint prediction using neuroblastoma as a model.We generate gene expression profiles from 498 primary neuroblastomas using both RNA-seq and 44 k microarrays. Characterization of the neuroblastoma transcriptome by RNA-seq reveals that more than 48,000 genes and 200,000 transcripts are being expressed in this malignancy. We also find that RNA-seq provides much more detailed information on specific transcript expression patterns in clinico-genetic neuroblastoma subgroups than microarrays. To systematically compare the power of RNA-seq and microarray-based models in predicting clinical endpoints, we divide the cohort randomly into training and validation sets and develop 360 predictive models on six clinical endpoints of varying predictability. Evaluation of factors potentially affecting model performances reveals that prediction accuracies are most strongly influenced by the nature of the clinical endpoint, whereas technological platforms (RNA-seq vs. microarrays), RNA-seq data analysis pipelines, and feature levels (gene vs. transcript vs. exon-junction level) do not significantly affect performances of the models.We demonstrate that RNA-seq outperforms microarrays in determining the transcriptomic characteristics of cancer, while RNA-seq and microarray-based models perform similarly in clinical endpoint prediction. Our findings may be valuable to guide future studies on the development of gene expression-based predictive models and their implementation in clinical practice.

SUBMITTER: Zhang W

PROVIDER: S-EPMC4506430 | biostudies-literature | 2015 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparison of RNA-seq and microarray-based models for clinical endpoint prediction.

Zhang Wenqian W Yu Ying Y Hertwig Falk F Thierry-Mieg Jean J Zhang Wenwei W Thierry-Mieg Danielle D Wang Jian J Furlanello Cesare C Devanarayan Viswanath V Cheng Jie J Deng Youping Y Hero Barbara B Hong Huixiao H Jia Meiwen M Li Li L Lin Simon M SM Nikolsky Yuri Y Oberthuer André A Qing Tao T Su Zhenqiang Z Volland Ruth R Wang Charles C Wang May D MD Ai Junmei J Albanese Davide D Asgharzadeh Shahab S Avigad Smadar S Bao Wenjun W Bessarabova Marina M Brilliant Murray H MH Brors Benedikt B Chierici Marco M Chu Tzu-Ming TM Zhang Jibin J Grundy Richard G RG He Min Max MM Hebbring Scott S Kaufman Howard L HL Lababidi Samir S Lancashire Lee J LJ Li Yan Y Lu Xin X XX Luo Heng H Ma Xiwen X Ning Baitang B Noguera Rosa R Peifer Martin M Phan John H JH Roels Frederik F Rosswog Carolina C Shao Susan S Shen Jie J Theissen Jessica J Tonini Gian Paolo GP Vandesompele Jo J Wu Po-Yen PY Xiao Wenzhong W Xu Joshua J Xu Weihong W Xuan Jiekun J Yang Yong Y Ye Zhan Z Dong Zirui Z Zhang Ke K KK Yin Ye Y Zhao Chen C Zheng Yuanting Y Wolfinger Russell D RD Shi Tieliu T Malkas Linda H LH Berthold Frank F Wang Jun J Tong Weida W Shi Leming L Peng Zhiyu Z Fischer Matthias M

Genome biology 20150625

<h4>Background</h4>Gene expression profiling is being widely applied in cancer research to identify biomarkers for clinical endpoint prediction. Since RNA-seq provides a powerful tool for transcriptome-based applications beyond the limitations of microarrays, we sought to systematically evaluate the performance of RNA-seq-based and microarray-based classifiers in this MAQC-III/SEQC study for clinical endpoint prediction using neuroblastoma as a model.<h4>Results</h4>We generate gene expression p ...[more]

PMID: 26109056

Similar Datasets

Project description:We generated gene expression profiles from 498 primary neuroblastomas using RNA-Seq and microarrays. We sought to systematically evaluate the capability of RNA deep-sequencing (RNA-Seq)-based classification for clinical endpoint prediction in comparison to microarray-based ones. The neuroblastoma cohort was randomly divided into training and validation sets, and 360 predictive models on six clinical endpoints were generated and evaluated. While prediction performances did not differ considerably between the two technical platforms, the RNA-Seq data processing pipelines, or feature levels (i.e., gene, transcript, and exon junction levels), RNA-Seq models based on the AceView database performed best on most endpoints. Collectively, our study reveals an unprecedented complexity of the neuroblastoma transcriptome, and provides guidelines for the development of gene expression-based predictive classifiers using high-throughput technologies. Sample clinical characteristics definitions: dataset: Expression data set used for classification training (1) or validation (2) Sex: M = male; F= female age at diagnosis: the age in days at diagnosis mycn status: Amplification status of the MYCN proto-oncogene (amplified = 1, no amplification = 0; no information = N/A) high risk: Clinically considered as high-risk neuroblastoma (yes=1, no= 0) INSS stage: disease stage according to International Neuroblastoma Staging System (INSS) (1, 2, 3, 4 and 4S) class label: Maximally divergent disease courses - unfavorable (= 1): patient died despite intensive chemotherapy, favorable (=0): patient survived without chemotharapy for at least 1000 days post diagnosis; not applicable (N/A) progression: Occurrence of a tumor progression event (yes=1; no=0) death from disease: Occurrence of death from the disease (yes=1; no=0) Gene expression of 498 neuroblastoma samples was quantified by RNA sequencing as well as by microarray analyses in order to understand the neuroblastoma transcriptome and predict clinical endpoints.

Project description:BackgroundClinical endpoint prediction remains challenging for health providers. Although predictors such as age, gender, and disease staging are of considerable predictive value, the accuracy often ranges between 60 and 80%. An accurate prognosis assessment is required for making effective clinical decisions.MethodsWe proposed an extended prognostic model based on clinical covariates with adjustment for additional variables that were radio-graphically induced, termed imaging biomarkers. Eight imaging biomarkers were introduced and investigated in a cohort of 68 non-small cell lung cancer subjects with tumor internal characteristic. The subjects comprised of 40 males and 28 females with mean age at 68.7 years. The imaging biomarkers used to quantify the solid component and non-solid component of a tumor. The extended model comprises of additional frameworks that correlate these markers to the survival ends through uni- and multi-variable analysis to determine the most informative predictors, before combining them with existing clinical predictors. Performance was compared between traditional and extended approaches using Receiver Operating Characteristic (ROC) curves, Area under the ROC curves (AUC), Kaplan-Meier (KM) curves, Cox Proportional Hazard, and log-rank tests (p-value).ResultsThe proposed hybrid model exhibited an impressive boosting pattern over the traditional approach of prognostic modelling in the survival prediction (AUC ranging from 77 to 97%). Four developed imaging markers were found to be significant in distinguishing between subjects having more and less dense components: (P = 0.002-0.006). The correlation to survival analysis revealed that patients with denser composition of tumor (solid dominant) lived 1.6-2.2 years longer (mean survival) and 0.5-2.0 years longer (median survival), than those with less dense composition (non-solid dominant).ConclusionThe present study provides crucial evidence that there is an added value for incorporating additional image-based predictors while predicting clinical endpoints. Though the hypotheses were confirmed in a customized case study, we believe the proposed model is easily adapted to various clinical cases, such as predictions of complications, treatment response, and disease evolution.

Project description:RNA sequencing (RNA-Seq) is often used for transcriptome profiling as well as the identification of novel transcripts and alternative splicing events. Typically, RNA-Seq libraries are prepared from total RNA using poly(A) enrichment of the mRNA (mRNA-Seq) to remove ribosomal RNA (rRNA), however, this method fails to capture non-poly(A) transcripts or partially degraded mRNAs. Hence, a mRNA-Seq protocol will not be compatible for use with RNAs coming from Formalin-Fixed and Paraffin-Embedded (FFPE) samples.To address the desire to perform RNA-Seq on FFPE materials, we evaluated two different library preparation protocols that could be compatible for use with small RNA fragments. We obtained paired Fresh Frozen (FF) and FFPE RNAs from multiple tumors and subjected these to different gene expression profiling methods. We tested 11 human breast tumor samples using: (a) FF RNAs by microarray, mRNA-Seq, Ribo-Zero-Seq and DSN-Seq (Duplex-Specific Nuclease) and (b) FFPE RNAs by Ribo-Zero-Seq and DSN-Seq. We also performed these different RNA-Seq protocols using 10 TCGA tumors as a validation set.The data from paired RNA samples showed high concordance in transcript quantification across all protocols and between FF and FFPE RNAs. In both FF and FFPE, Ribo-Zero-Seq removed rRNA with comparable efficiency as mRNA-Seq, and it provided an equivalent or less biased coverage on gene 3' ends. Compared to mRNA-Seq where 69% of bases were mapped to the transcriptome, DSN-Seq and Ribo-Zero-Seq contained significantly fewer reads mapping to the transcriptome (20-30%); in these RNA-Seq protocols, many if not most reads mapped to intronic regions. Approximately 14 million reads in mRNA-Seq and 45-65 million reads in Ribo-Zero-Seq or DSN-Seq were required to achieve the same gene detection levels as a standard Agilent DNA microarray.Our results demonstrate that compared to mRNA-Seq and microarrays, Ribo-Zero-Seq provides equivalent rRNA removal efficiency, coverage uniformity, genome-based mapped reads, and consistently high quality quantification of transcripts. Moreover, Ribo-Zero-Seq and DSN-Seq have consistent transcript quantification using FFPE RNAs, suggesting that RNA-Seq can be used with FFPE-derived RNAs for gene expression profiling.

Dataset Information

Comparison of RNA-seq and microarray-based models for clinical endpoint prediction.

Publications

Comparison of RNA-seq and microarray-based models for clinical endpoint prediction.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure