Bagging optimal ROC curve method for predictive genetic tests, with an application for rheumatoid arthritis.
Ontology highlight
ABSTRACT:
SUBMITTER: Lu Q
PROVIDER: S-EPMC3823239 | biostudies-literature | 2010 Mar
REPOSITORIES: biostudies-literature
Publications
Bagging optimal ROC curve method for predictive genetic tests, with an application for rheumatoid arthritis.
Lu Qing Q Cui Yuehua Y Ye Chengyin C Wei Changshuai C Elston Robert C RC
Journal of biopharmaceutical statistics 20100301 2
Translation studies have been initiated to assess the combined effect of genetic loci from recently accomplished genome-wide association studies and the existing risk factors for early disease prediction. We propose a bagging optimal receiver operating characteristic (ROC) curve method to facilitate this research. Through simulation and real data application, we compared the new method with the commonly used allele counting method and logistic regression, and found that the new method yields a b ...[more]
Similar Datasets
Project description:Current ongoing genome-wide association (GWA) studies represent a powerful approach to uncover common unknown genetic variants causing common complex diseases. The discovery of these genetic variants offers an important opportunity for early disease prediction, prevention, and individualized treatment. We describe here a method of combining multiple genetic variants for early disease prediction, based on the optimality theory of the likelihood ratio (LR). Such theory simply shows that the receiver operating characteristic (ROC) curve based on the LR has maximum performance at each cutoff point and that the area under the ROC curve so obtained is highest among that of all approaches. Through simulations and a real data application, we compared it with the commonly used logistic regression and classification tree approaches. The three approaches show similar performance if we know the underlying disease model. However, for most common diseases we have little prior knowledge of the disease model and in this situation the new method has an advantage over logistic regression and classification tree approaches. We applied the new method to the type 1 diabetes GWA data from the Wellcome Trust Case Control Consortium. Based on five single nucleotide polymorphisms, the test reaches medium level classification accuracy. With more genetic findings to be discovered in the future, we believe a predictive genetic test for type 1 diabetes can be successfully constructed and eventually implemented for clinical use.
| S-EPMC3039874 | biostudies-literature
Project description:BACKGROUND: The receiver operating characteristic (ROC) curve is a fundamental tool to assess the discriminant performance for not only a single marker but also a score function combining multiple markers. The area under the ROC curve (AUC) for a score function measures the intrinsic ability for the score function to discriminate between the controls and cases. Recently, the partial AUC (pAUC) has been paid more attention than the AUC, because a suitable range of the false positive rate can be focused according to various clinical situations. However, existing pAUC-based methods only handle a few markers and do not take nonlinear combination of markers into consideration. RESULTS: We have developed a new statistical method that focuses on the pAUC based on a boosting technique. The markers are combined componentially for maximizing the pAUC in the boosting algorithm using natural cubic splines or decision stumps (single-level decision trees), according to the values of markers (continuous or discrete). We show that the resulting score plots are useful for understanding how each marker is associated with the outcome variable. We compare the performance of the proposed boosting method with those of other existing methods, and demonstrate the utility using real data sets. As a result, we have much better discrimination performances in the sense of the pAUC in both simulation studies and real data analysis. CONCLUSIONS: The proposed method addresses how to combine the markers after a pAUC-based filtering procedure in high dimensional setting. Hence, it provides a consistent way of analyzing data based on the pAUC from maker selection to marker combination for discrimination problems. The method can capture not only linear but also nonlinear association between the outcome variable and the markers, about which the nonlinearity is known to be necessary in general for the maximization of the pAUC. The method also puts importance on the accuracy of classification performance as well as interpretability of the association, by offering simple and smooth resultant score plots for each marker.
| S-EPMC2898798 | biostudies-other
Project description:Many statistical studies report p-values for inferential purposes. In several scenarios, the stochastic aspect of p-values is neglected, which may contribute to drawing wrong conclusions in real data experiments. The stochastic nature of p-values makes their use to examine the performance of given testing procedures or associations between investigated factors to be difficult. We turn our focus on the modern statistical literature to address the expected p-value (EPV) as a measure of the performance of decision-making rules. During the course of our study, we prove that the EPV can be considered in the context of receiver operating characteristic (ROC) curve analysis, a well-established biostatistical methodology. The ROC-based framework provides a new and efficient methodology for investigating and constructing statistical decision-making procedures, including: (1) evaluation and visualization of properties of the testing mechanisms, considering, e.g. partial EPVs; (2) developing optimal tests via the minimization of EPVs; (3) creation of novel methods for optimally combining multiple test statistics. We demonstrate that the proposed EPV-based approach allows us to maximize the integrated power of testing algorithms with respect to various significance levels. In an application, we use the proposed method to construct the optimal test and analyze a myocardial infarction disease dataset. We outline the usefulness of the "EPV/ROC" technique for evaluating different decision-making procedures, their constructions and properties with an eye towards practical applications.
| S-EPMC6212326 | biostudies-literature
Project description:The receiver operating characteristic (ROC) curve is commonly used to evaluate the accuracy of a diagnostic test for classifying observations into two groups. We propose two novel tuning parameters for estimating the ROC curve via Bernstein polynomial smoothing of the empirical ROC curve. The new estimator is very easy to implement with the naturally selected tuning parameter, as illustrated by analyzing both real and simulated data sets. Empirical performance is investigated through extensive simulation studies with a variety of scenarios where the two groups are both from a single family of distributions (symmetric or right skewed) or one from a symmetric and the other from a right skewed distribution. The new estimator is uniformly more efficient than the empirical ROC estimator, and very competitive to eleven other existing smooth ROC estimators in terms of mean integrated square errors.
| S-EPMC8148335 | biostudies-literature
Project description:It is a common approach to dichotomize a continuous biomarker in clinical setting for the convenience of application. Analytically, results from using a dichotomized biomarker are often more reliable and resistant to outliers, bi-modal and other unknown distributions. There are two commonly used methods for selecting the best cut-off value for dichotomization of a continuous biomarker, using either maximally selected chi-square statistic or a ROC curve, specifically the Youden Index. In this paper, we explained that in many situations, it is inappropriate to use the former. By using the Maximum Absolute Youden Index (MAYI), we demonstrated that the integration of a MAYI and the Kolmogorov-Smirnov test is not only a robust non-parametric method, but also provides more meaningful p value for selecting the cut-off value than using a Mann-Whitney test. In addition, our method can be applied directly in clinical settings.
| S-EPMC9793859 | biostudies-literature
Project description:OBJECTIVE:Little is known about the experiences, values, and needs of people without arthritis who undergo predictive biomarker testing for the development of rheumatoid arthritis (RA). Our study aimed to explore the perspectives of these individuals and describe their information needs. METHODS:A qualitative, multicenter interview study with a thematic analysis was conducted in Austria, Germany and the UK. Individuals were interviewed who underwent predictive biomarker testing for RA and had a positive test result but no diagnosis of any inflammatory joint disease. Participants included patients with arthralgia and asymptomatic individuals. Information and education needs were developed from the qualitative codes and themes using the Arthritis Educational Needs Assessment Tool as a frame of reference. RESULTS:Thematic saturation was reached in 34 individuals (76% female, 24 [71%] with arthralgia, and 10 [29%] asymptomatic individuals). Thirty-seven codes were summarized into 4 themes: 1) decision-making around whether to undergo initial predictive testing, 2) willingness to consider further predictive tests, and/or 3) preventive interventions, including medication, and 4) varying reactions after receiving a positive test result. Individuals with arthralgia were more likely to be willing to take preventive action, undergo further testing, and experience psychological distress than asymptomatic individuals. All participants expressed the need for tailored, patient-understandable information. CONCLUSION:Individuals at risk of RA are currently the subjects of research aimed at developing better predictive strategies and preventive approaches. Their perceptions and needs should be addressed to inform the future development of interventions combined with education.
| S-EPMC7064954 | biostudies-literature
Project description:The receiver operating characteristic (ROC) curve is often used to evaluate the performance of a biomarker measured on continuous scale to predict the disease status or a clinical condition. Motivated by the need for novel study designs with better estimation efficiency and reduced study cost, we consider a biased sampling scheme that consists of a SRC and a supplemental TDC. Using this approach, investigators can oversample or undersample subjects falling into certain regions of the biomarker measure, yielding improved precision for the estimation of the ROC curve with a fixed sample size. Test-result-dependent sampling will introduce bias in estimating the predictive accuracy of the biomarker if standard ROC estimation methods are used. In this article, we discuss three approaches for analyzing data of a test-result-dependent structure with a special focus on the empirical likelihood method. We establish asymptotic properties of the empirical likelihood estimators for covariate-specific ROC curves and covariate-independent ROC curves and give their corresponding variance estimators. Simulation studies show that the empirical likelihood method yields good properties and is more efficient than alternative methods. Recommendations on number of regions, cutoff points, and subject allocation is made based on the simulation results. The proposed methods are illustrated with a data example based on an ongoing lung cancer clinical trial.
| S-EPMC3577107 | biostudies-literature
Project description:The receiver operating characteristic (ROC) curve is a commonly used graphical summary of the discriminative capacity of a thresholded continuous scoring system for a binary outcome. Estimation and inference procedures for the ROC curve are well-studied in the cross-sectional setting. However, there is a paucity of research when both biomarker measurements and disease status are observed longitudinally. In a motivating example, we are interested in characterizing the value of longitudinally measured CD4 counts for predicting the presence or absence of a transient spike in HIV viral load, also time-dependent. The existing method neither appropriately characterizes the diagnostic value of observed CD4 counts nor efficiently uses status history in predicting the current spike status. We propose to jointly model the binary status as a Markov chain and the biomarkers levels, conditional on the binary status, as an autoregressive process, yielding a dynamic scoring procedure for predicting the occurrence of a spike. Based on the resulting prediction rule, we propose several natural extensions of the ROC curve to the longitudinal setting and describe procedures for statistical inference. Lastly, extensive simulations have been conducted to examine the small sample operational characteristics of the proposed methods.
| S-EPMC6587928 | biostudies-literature
Project description:Rheumatoid arthritis (RA) is a common autoimmune disease characterized by persistent inflammation of joints resulting in progressive destruction of cartilage and bone. Recently, biological agents that suppress the activities of proinflammatory cytokines have shown efficacy as antirheumatic drugs, but require frequent administration, and often result in systemic immune suppression. Thus, gene transfer approaches are being developed as an alternative approach for targeted, more efficient, and sustained delivery of inhibitors of inflammatory cytokines as well as other therapeutic agents. Several gene therapy approaches have been established in preclinical animal models. In these models, autoantigen-specific T cells have been demonstrated to be ideal gene delivery vehicles for the local delivery of "immunoregulatory molecules" because these cells have tissue-specific homing and retention properties. Indeed, bioluminescence studies in an animal model of inflammatory arthritis revealed that these cells accumulated in and remained in inflamed joints. Transfer of genetically modified dendritic cells (DCs) may also have interesting effects. We conclude that modifying antigen-specific T cells or autologous DCs by retroviral transduction for local expression of regulatory proteins is a promising therapeutic strategy for the treatment of RA.
| S-EPMC2780633 | biostudies-other
Project description:ObjectivesThere is increasing interest in prediction and prevention of RA. It is important to understand the views of those at risk to inform the development of effective approaches. First-degree relatives (FDRs) of RA patients are at increased risk of RA. This study assessed predictors of their interest in predictive testing for RA.MethodsQuestionnaires were completed by RA patients (provided with their questionnaire by a healthcare professional) and their FDRs (provided with their questionnaire by their RA proband). FDR surveys assessed interest in taking a predictive test, demographic variables, perceived RA risk, attitudes about predictive testing, autonomy preferences, illness perceptions, avoidance coping and health anxiety. Patient surveys included demographic variables, disease impact, RA duration and treatment. Ordinal logistic regression examined the association between FDRs' characteristics and their interest in predictive testing. Generalized estimating equations assessed associations between patient characteristics and FDRs' interest in predictive testing.ResultsThree hundred and ninety-six FDRs responded. Paired data from the RA proband were available for 292. The proportion of FDRs interested in predictive testing was 91.3%. Information-seeking preferences, beliefs that predictive testing can increase empowerment over health and positive attitudes about risk knowledge were associated with increased interest. Beliefs that predictive testing could cause psychological harm predicted lower interest. Patient characteristics of the proband were not associated with FDRs' interest.ConclusionsFDRs' interest in predictive testing for RA was high, and factors associated with interest were identified. These findings will inform the development of predictive strategies and informational resources for those at risk.
| S-EPMC9348622 | biostudies-literature