Dataset Information

Multiplex serum biomarker assessments: technical and biostatistical issues.

ABSTRACT:

Background

Identification of predictive and prognostic biomarkers for patients with disease and undergoing different therapeutic options is a very active area of investigation. Many of these studies seek biomarkers among circulating proteins accessed in blood. Many levels of standardization in materials and procedures have been identified which can impact the resulting data.

Methods

Here, we have observed unexpected variability in levels of commonly tested analytes in serum which were processed and stored under standardized conditions. We have identified apparent changes in cytokine, chemokine and growth factor levels detected by multiplex Luminex assay in melanoma patient and healthy donor serum samples, over storage time at -80°C. Controls included Luminex kit standards, multiplexed cytokine standards and WHO cytokine controls. Data were analyzed by Wilcoxon rank-sum testing and Spearman's test for correlations.

Results

The interpretation of these changes is confounded by lot-to-lot kit standard curve reagent changes made by a single manufacturer of Luminex kits.

Conclusions

This study identifies previously unknown sources of variation in a commonly used biomarker assay, and suggests additional levels of controls needed for identification of true changes in circulating protein levels.

SUBMITTER: Butterfield LH

PROVIDER: S-EPMC3200183 | biostudies-literature | 2011 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Multiplex serum biomarker assessments: technical and biostatistical issues.

Butterfield Lisa H LH Potter Douglas M DM Kirkwood John M JM

Journal of translational medicine 20111011

<h4>Background</h4>Identification of predictive and prognostic biomarkers for patients with disease and undergoing different therapeutic options is a very active area of investigation. Many of these studies seek biomarkers among circulating proteins accessed in blood. Many levels of standardization in materials and procedures have been identified which can impact the resulting data.<h4>Methods</h4>Here, we have observed unexpected variability in levels of commonly tested analytes in serum which ...[more]

PMID: 21989127

Similar Datasets

Project description:OBJECTIVES:The overall purposes of this first US national pilot study were to (1) test the feasibility of online administration of the Bioethical Issues in Biostatistical Consulting (BIBC) Questionnaire to a random sample of American Statistical Association (ASA) members; (2) determine the prevalence and relative severity of a broad array of bioethical violations requests that are presented to biostatisticians by investigators seeking biostatistical consultations; and (3) establish the sample size needed for a full-size phase II study. DESIGN:A descriptive survey as approved and endorsed by the ASA. PARTICIPANTS:Administered to a randomly drawn sample of 112 professional biostatisticians who were ASA members. PRIMARY AND SECONDARY OUTCOME MEASURES:The 18 bioethical violations were first ranked by perceived severity scores, then categorised into three perceived severity subcategories in order to identify seven 'top tier concern violations' and seven 'second tier concern violations'. RESULTS:Methodologically, this phase I pilot study demonstrated that the BIBC Questionnaire, as administered online to a random sample of ASA members, served to identify bioethical violations that occurred during biostatistical consultations, and provided data needed to establish the sample size needed for a full-scale phase II study. The No. 1 top tier concern was 'remove or alter some data records in order to better support the research hypothesis'. The No. 2 top tier concern was 'interpret the statistical findings based on expectation, not based on actual results'. In total, 14 of the 18 BIBC Questionnaire items, as judged by a combination of 'severity of violation' and 'frequency of occurrence over past 5 years', were rated by biostatisticians as 'top tier' or 'second tier' bioethical concerns. CONCLUSION:This pilot study gives clear evidence that researchers make requests of their biostatistical consultants that are not only rated as severe violations, but further that these requests occur quite frequently.

Project description:BackgroundWe investigated the predictive value of 11 serum biomarkers for renal and mortality end points in people with CKD.MethodsAdults with CKD (n=139) were enrolled from outpatient clinics between February 2014 and November 2016. Biomarker quantification was performed using two multiplex arrays on a clinical-grade analyzer. Relationships between biomarkers and renal and mortality end points were investigated by random forests and Cox proportional hazards regression.ResultsThe cohort was 56% male. The mean age was 63 years and median (IQR) CKD-EPI eGFR was 33 (24-51) ml/min per BSA. A total of 56 (40%) people developed a composite end point defined as ≥40% decline in eGFR, doubling of serum creatinine, RRT, or death over median (IQR) follow-up of 5.4 (4.7-5.7) years. Prediction of the composite end point was better with random forests trained on serum biomarkers compared with clinical variables (area under the curve of 0.81 versus 0.78). The predictive performance of biomarkers was further enhanced when considered alongside clinical variables (area under the curve of 0.83 versus 0.81 for biomarkers alone). Patients (n=27, 19%) with high soluble TNF receptor-1 (≥3 ng/ml) and neutrophil gelatinase-associated lipocalin (≥156 ng/ml), coupled with low complement 3a des-arginine (<2368 ng/ml), almost universally (96%) developed the composite renal and mortality end point. C-reactive protein (adjusted hazard ratio, 1.4; 95% CI, 1.1 to 1.8), neutrophil gelatinase-associated lipocalin (adjusted hazard ratio, 2.8; 95% CI, 1.3 to 6.1) and complement 3a desarginine (adjusted hazard ratio, 0.6; 95% CI, 0.4 to 0.96) independently predicted time to the composite end point.ConclusionsOutpatients with the triad of high soluble TNF receptor-1 and neutrophil gelatinase-associated lipocalin coupled with low complement 3a des-arginine had high adverse event rates over 5-year follow-up. Incorporation of serum biomarkers alongside clinical variables improved prediction of CKD progression and mortality. Our findings require confirmation in larger, more diverse patient cohorts.

Project description:The search for new treatments for seizures, epilepsies, and their comorbidities faces considerable challenges. This is due in part to gaps in our understanding of the etiology and pathophysiology of most forms of epilepsy. An additional challenge is the difficulty in predicting the efficacy, tolerability, and impact of potential new treatments on epilepsies and comorbidities in humans, using the available resources. Herein we provide a summary of the discussions and proposals of the Working Group 2 as presented in the Joint American Epilepsy Society and International League Against Epilepsy Translational Workshop in London (September 2012). We propose methodologic and reporting practices that will enhance the uniformity, reliability, and reporting of early stage preclinical studies with animal seizure and epilepsy models that aim to develop and evaluate new therapies for seizures or epilepsies, using multidisciplinary approaches. The topics considered include the following: (1) implementation of better study design and reporting practices; (2) incorporation in the study design and analysis of covariants that may influence outcomes (including species, age, sex); (3) utilization of approaches to document target relevance, exposure, and engagement by the tested treatment; (4) utilization of clinically relevant treatment protocols; (5) optimization of the use of video-electroencephalography (EEG) recordings to best meet the study goals; and (6) inclusion of outcome measures that address the tolerability of the treatment or study end points apart from seizures. We further discuss the different expectations for studies aiming to meet regulatory requirements to obtain approval for clinical testing in humans. Implementation of the rigorous practices discussed in this report will require considerable investment in time, funds, and other research resources, which may create challenges for academic researchers seeking to contribute to epilepsy therapy discovery and development. We propose several infrastructure initiatives to overcome these barriers.

Project description:As a common medium-throughput technique, qPCR (quantitative real-time polymerase chain reaction) is widely used to measure levels of nucleic acids. In addition to accurate and complete data, experimenters have unavoidably observed some incomplete and uncertainly determined qPCR data because of intrinsically low overall amounts of biological materials, such as nucleic acids present in biofluids. When there are samples with uncertainly determined qPCR data, some investigators apply the statistical complete-case method by excluding the subset of samples with uncertainly determined data from analysis (CO), while others simply choose not to analyze (CNA) these datasets altogether. To include as many observations as possible in analysis for interesting differential changes between groups, some investigators set incomplete observations equal to the maximum quality qPCR cycle (MC), such as 32 and 40. Although straightforward, these methods may decrease the sample size, skew the data distribution, and compromise statistical power and research reproducibility across replicate qPCR studies. To overcome the shortcomings of the existing, commonly-used qPCR data analysis methods and to join the efforts in advancing statistical analysis in rigorous preclinical research, we propose a robust nonparametric statistical cycle-to-threshold method (CTOT) to analyze incomplete qPCR data for two-group comparisons. CTOT incorporates important characteristics of qPCR data and time-to-event statistical methodology, resulting in a novel analytical method for qPCR data that is built around good quality data from all subjects, certainly determined or not. Considering the benchmark full data (BFD), we compared the abilities of CTOT, CO, MC, and CNA statistical methods to detect interesting differential changes between groups with informative but uncertainly determined qPCR data. Our simulations and applications show that CTOT improves the power of detecting and confirming differential changes in many situations over the three commonly used methods without excess type I errors. The robust nonparametric statistical method of CTOT helps leverage qPCR technology and increase the power to detect differential changes that may assist decision making with respect to biomarker detection and early diagnosis, with the goal of improving the management of patient healthcare.

Dataset Information

Multiplex serum biomarker assessments: technical and biostatistical issues.

Background

Methods

Results

Conclusions

Publications

Multiplex serum biomarker assessments: technical and biostatistical issues.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets