Dataset Information

Statistical classifiers for diagnosing disease from immune repertoires: a case study using multiple sclerosis.

ABSTRACT:

Background

Deep sequencing of lymphocyte receptor repertoires has made it possible to comprehensively profile the clonal composition of lymphocyte populations. This opens the door for novel approaches to diagnose and prognosticate diseases with a driving immune component by identifying repertoire sequence patterns associated with clinical phenotypes. Indeed, recent studies support the feasibility of this, demonstrating an association between repertoire-level summary statistics (e.g., diversity) and patient outcomes for several diseases. In our own prior work, we have shown that six codons in VH4-containing genes in B cells from the cerebrospinal fluid of patients with relapsing remitting multiple sclerosis (RRMS) have higher replacement mutation frequencies than observed in healthy controls or patients with other neurological diseases. However, prior methods to date have been limited to focusing on repertoire-level summary statistics, ignoring the vast amounts of information in the millions of individual immune receptors comprising a repertoire. We have developed a novel method that addresses this limitation by using innovative approaches for accommodating the extraordinary sequence diversity of immune receptors and widely used machine learning approaches. We applied our method to RRMS, an autoimmune disease that is notoriously difficult to diagnose.

Results

We use the biochemical features encoded by the complementarity determining region 3 of each B cell receptor heavy chain in every patient repertoire as input to a detector function, which is fit to give the correct diagnosis for each patient using maximum likelihood optimization methods. The resulting statistical classifier assigns patients to one of two diagnosis categories, RRMS or other neurological disease, with 87% accuracy by leave-one-out cross-validation on training data (N = 23) and 72% accuracy on unused data from a separate study (N = 102).

Conclusions

Our method is the first to apply statistical learning to immune repertoires to aid disease diagnosis, learning repertoire-level labels from the set of individual immune repertoire sequences. This method produced a repertoire-based statistical classifier for diagnosing RRMS that provides a high degree of diagnostic capability, rivaling the accuracy of diagnosis by a clinical expert. Additionally, this method points to a diagnostic biochemical motif in the antibodies of RRMS patients, which may offer insight into the disease process.

SUBMITTER: Ostmeyer J

PROVIDER: S-EPMC5588725 | biostudies-literature | 2017 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Statistical classifiers for diagnosing disease from immune repertoires: a case study using multiple sclerosis.

Ostmeyer Jared J Christley Scott S Rounds William H WH Toby Inimary I Greenberg Benjamin M BM Monson Nancy L NL Cowell Lindsay G LG

BMC bioinformatics 20170907 1

<h4>Background</h4>Deep sequencing of lymphocyte receptor repertoires has made it possible to comprehensively profile the clonal composition of lymphocyte populations. This opens the door for novel approaches to diagnose and prognosticate diseases with a driving immune component by identifying repertoire sequence patterns associated with clinical phenotypes. Indeed, recent studies support the feasibility of this, demonstrating an association between repertoire-level summary statistics (e.g., div ...[more]

PMID: 28882107

Similar Datasets

Project description:BackgroundIn this paper we present a method for the statistical assessment of cancer predictors which make use of gene expression profiles. The methodology is applied to a new data set of microarray gene expression data collected in Casa Sollievo della Sofferenza Hospital, Foggia--Italy. The data set is made up of normal (22) and tumor (25) specimens extracted from 25 patients affected by colon cancer. We propose to give answers to some questions which are relevant for the automatic diagnosis of cancer such as: Is the size of the available data set sufficient to build accurate classifiers? What is the statistical significance of the associated error rates? In what ways can accuracy be considered dependant on the adopted classification scheme? How many genes are correlated with the pathology and how many are sufficient for an accurate colon cancer classification? The method we propose answers these questions whilst avoiding the potential pitfalls hidden in the analysis and interpretation of microarray data.ResultsWe estimate the generalization error, evaluated through the Leave-K-Out Cross Validation error, for three different classification schemes by varying the number of training examples and the number of the genes used. The statistical significance of the error rate is measured by using a permutation test. We provide a statistical analysis in terms of the frequencies of the genes involved in the classification. Using the whole set of genes, we found that the Weighted Voting Algorithm (WVA) classifier learns the distinction between normal and tumor specimens with 25 training examples, providing e = 21% (p = 0.045) as an error rate. This remains constant even when the number of examples increases. Moreover, Regularized Least Squares (RLS) and Support Vector Machines (SVM) classifiers can learn with only 15 training examples, with an error rate of e = 19% (p = 0.035) and e = 18% (p = 0.037) respectively. Moreover, the error rate decreases as the training set size increases, reaching its best performances with 35 training examples. In this case, RLS and SVM have error rates of e = 14% (p = 0.027) and e = 11% (p = 0.019). Concerning the number of genes, we found about 6000 genes (p < 0.05) correlated with the pathology, resulting from the signal-to-noise statistic. Moreover the performances of RLS and SVM classifiers do not change when 74% of genes is used. They progressively reduce up to e = 16% (p < 0.05) when only 2 genes are employed. The biological relevance of a set of genes determined by our statistical analysis and the major roles they play in colorectal tumorigenesis is discussed.ConclusionsThe method proposed provides statistically significant answers to precise questions relevant for the diagnosis and prognosis of cancer. We found that, with as few as 15 examples, it is possible to train statistically significant classifiers for colon cancer diagnosis. As for the definition of the number of genes sufficient for a reliable classification of colon cancer, our results suggest that it depends on the accuracy required.

Project description:Machine learning-based imaging diagnostics has recently reached or even surpassed the level of clinical experts in several clinical domains. However, classification decisions of a trained machine learning system are typically non-transparent, a major hindrance for clinical integration, error tracking or knowledge discovery. In this study, we present a transparent deep learning framework relying on 3D convolutional neural networks (CNNs) and layer-wise relevance propagation (LRP) for diagnosing multiple sclerosis (MS), the most widespread autoimmune neuroinflammatory disease. MS is commonly diagnosed utilizing a combination of clinical presentation and conventional magnetic resonance imaging (MRI), specifically the occurrence and presentation of white matter lesions in T2-weighted images. We hypothesized that using LRP in a naive predictive model would enable us to uncover relevant image features that a trained CNN uses for decision-making. Since imaging markers in MS are well-established this would enable us to validate the respective CNN model. First, we pre-trained a CNN on MRI data from the Alzheimer's Disease Neuroimaging Initiative (n = 921), afterwards specializing the CNN to discriminate between MS patients (n = 76) and healthy controls (n = 71). Using LRP, we then produced a heatmap for each subject in the holdout set depicting the voxel-wise relevance for a particular classification decision. The resulting CNN model resulted in a balanced accuracy of 87.04% and an area under the curve of 96.08% in a receiver operating characteristic curve. The subsequent LRP visualization revealed that the CNN model focuses indeed on individual lesions, but also incorporates additional information such as lesion location, non-lesional white matter or gray matter areas such as the thalamus, which are established conventional and advanced MRI markers in MS. We conclude that LRP and the proposed framework have the capability to make diagnostic decisions of CNN models transparent, which could serve to justify classification decisions for clinical review, verify diagnosis-relevant features and potentially gather new disease knowledge.

Project description:ObjectiveHere, we aimed to identify protein biomarkers that could rapidly and accurately diagnose multiple sclerosis (MS) using a highly sensitive proteomic immunoassay.MethodsTandem mass tag (TMT) quantitative proteomic analysis was performed to determine the differentially expressed proteins (DEPs) in cerebrospinal fluid (CSF) samples collected from 10 patients with MS and 10 non-inflammatory neurological controls (NINCs). The DEPs were analyzed using bioinformatics tools, and the candidate proteins were validated using the ELISA method in another cohort comprising 160 samples (paired CSF and plasma of 40 patients with MS, CSF of 40 NINCs, and plasma of 40 healthy individuals). Receiver operating characteristic (ROC) curves were used to determine the diagnostic potential of this method.ResultsCompared to NINCs, we identified 83 CSF-specific DEPs out of a total of 343 proteins in MS patients. Gene ontology (GO) enrichment analysis revealed that these DEPs are mainly involved in platelet degranulation, negative regulation of proteolysis, and post-translational protein modification. Pathway enrichment analysis revealed that the complement and coagulation cascades, Ras signaling pathway, and PI3K-Akt signaling pathway are the main components. Insulin-like growth factor-binding protein 7 (IGFBP7), insulin-like growth factor 2 (IGF2), and somatostatin (SST) were identified as the potential proteins with high scores, degree, and centrality in the protein-protein interaction (PPI) network. We validated the expression of these three proteins using ELISA. Compared to NINCs, the level of CSF IGFBP7 was significantly upregulated, and the level of CSF SST was significantly downregulated in the MS group.ConclusionOur results suggest that SST and IGFBP7 might be associated with the pathogenesis of MS and would be helpful in diagnosing MS. Since IGFBP7 was used to classify relapsing remitting MS (RRMS) and secondary progressive MS (SPMS) patients, therefore, it may act as a potential key marker and therapeutic target in MS.

Dataset Information

Statistical classifiers for diagnosing disease from immune repertoires: a case study using multiple sclerosis.

Background

Results

Conclusions

Publications

Statistical classifiers for diagnosing disease from immune repertoires: a case study using multiple sclerosis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets