Dataset Information

Normalization and statistical analysis of multiplexed bead-based immunoassay data using mixed-effects modeling.

ABSTRACT: Multiplexed bead-based flow cytometric immunoassays are a powerful experimental tool for investigating cellular communication networks, yet their widespread adoption is limited in part by challenges in robust quantitative analysis of the measurements. Here we report our application of mixed-effects modeling for the normalization and statistical analysis of bead-based immunoassay data. Our data set consisted of bead-based immunoassay measurements of 16 phospho-proteins in lysates of HepG2 cells treated with ligands that regulate acute-phase protein secretion. Mixed-effects modeling provided estimates for the effects of both the technical and biological sources of variance, and normalization was achieved by subtracting the technical effects from the measured values. This approach allowed us to detect ligand effects on signaling with greater precision and sensitivity and to more accurately characterize the HepG2 cell signaling network using constrained fuzzy logic. Mixed-effects modeling analysis of our data was vital for ascertaining that IL-1? and TGF-? treatment increased the activities of more pathways than IL-6 and TNF-? and that TGF-? and TNF-? increased p38 MAPK and c-Jun N-terminal kinase (JNK) phospho-protein levels in a synergistic manner. Moreover, we used mixed-effects modeling-based technical effect estimates to reveal the substantial variance contributed by batch effects along with the absence of loading order and assay plate position effects. We conclude that mixed-effects modeling enabled additional insights to be gained from our data than would otherwise be possible and we discuss how this methodology can play an important role in enhancing the value of experiments employing multiplexed bead-based immunoassays.

SUBMITTER: Clarke DC

PROVIDER: S-EPMC3536905 | biostudies-other | 2013 Jan

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Normalization and statistical analysis of multiplexed bead-based immunoassay data using mixed-effects modeling.

Clarke David C DC Morris Melody K MK Lauffenburger Douglas A DA

Molecular & cellular proteomics : MCP 20121015 1

Multiplexed bead-based flow cytometric immunoassays are a powerful experimental tool for investigating cellular communication networks, yet their widespread adoption is limited in part by challenges in robust quantitative analysis of the measurements. Here we report our application of mixed-effects modeling for the normalization and statistical analysis of bead-based immunoassay data. Our data set consisted of bead-based immunoassay measurements of 16 phospho-proteins in lysates of HepG2 cells t ...[more]

PMID: 23071098

Similar Datasets

Project description:Colorectal cancer (CRC) is the second leading cause of cancer deaths in the US and Western world. Despite increased screening and advances in treatment, the mortality rate (ca. 50,000/year) and high national health-care burden for CRC are likely to remain high unless an effective non-invasive screening test for CRC is instituted for a large segment of the population. Blood-based protein biomarkers hold great promise for early disease diagnosis and personalized medicine; yet robust and reproducible multiplexing platforms and methodologies have lagged behind their genomic counterparts. Here, we report the development of a novel, multiplexed, hybrid immunoassay for CRC that is formatted on barcoded VeraCode™ micro-beads, which have until now only been used for genomic assays. The method combines a sandwich immunoassay format for detection of serum protein biomarkers with an antigen assay for autoantibody detection. The serum protein biomarkers CEA and GDF15 as well as autoantibodies to the p53 tumor associated antigen (TAA) were used to exemplify the method. This multiplex biomarker panel was configured to run on Illumina's holographically barcoded VeraCode™ micro-bead platform, which is capable of measuring hundreds of analytes simultaneously in a single well from small volumes of blood (<50 ?L) using a 96-well industry standard microtiter plate. This novel use of the VeraCode™ micro-bead platform translates into a potentially low volume, high throughput, multiplexed assay for CRC, for the purposes of biomarker validation, as well as patient screening, diagnostics and prognostics. In an evaluation of a 186 patient sera training set (CRC and normal), we obtained a diagnostic sensitivity of 54% and a specificity of 98%. We anticipate that by expanding and refining the biomarkers in this initial panel, and performing more extensive clinical validations, such an assay could ultimately provide a basis for CRC population screening to complement the more invasive, expensive and low throughput (but highly sensitive and specific) colonoscopy.

Project description:Background: Advances in statistical methods and computing power have led to a renewed interest in addressing the statistical analysis challenges posed by Small-N Designs (SND). Linear mixed-effects modeling (LMEM) is a multiple regression technique that is flexible and suitable for SND and can provide standardized effect sizes and measures of statistical significance. Aims: Our primary goals are to: 1) explain LMEM at the conceptual level, situating it in the context of treatment studies, and 2) provide practical guidance for implementing LMEM in repeated measures SND. Methods & procedures: We illustrate an LMEM analysis, presenting data from a longitudinal training study of five individuals with acquired dysgraphia, analyzing both binomial (accuracy) and continuous (reaction time) repeated measurements. Outcomes & results: The LMEM analysis reveals that both spelling accuracy and reaction time improved and, for accuracy, improved significantly more quickly under a training schedule with distributed, compared to clustered, practice. We present guidance on obtaining and interpreting various effect sizes and measures of statistical significance from LMEM, and include a simulation study comparing two p-value methods for generalized LMEM. Conclusion: We provide a strong case for the application of LMEM to the analysis of training studies as a preferable alternative to visual analysis or other statistical techniques. When applied to a treatment dataset, the evidence supports that the approach holds up under the extreme conditions of small numbers of individuals, with repeated measures training data for both continuous (reaction time) and binomially distributed (accuracy) dependent measures. The approach provides standardized measures of effect sizes that are obtained through readily available and well-supported statistical packages, and provides statistically rigorous estimates of the expected average effect size of training effects, taking into account variability across both items and individuals.

Project description:Akaike's information theoretic criterion for model discrimination (AIC) is often stated to "overfit", i.e., it selects models with a higher dimension than the dimension of the model that generated the data. However, with experimental pharmacokinetic data it may not be possible to identify the correct model, because of the complexity of the processes governing drug disposition. Instead of trying to find the correct model, a more useful objective might be to minimize the prediction error of drug concentrations in subjects with unknown disposition characteristics. In that case, the AIC might be the selection criterion of choice. We performed Monte Carlo simulations using a model of pharmacokinetic data (a power function of time) with the property that fits with common multi-exponential models can never be perfect - thus resembling the situation with real data. Prespecified models were fitted to simulated data sets, and AIC and AIC c (the criterion with a correction for small sample sizes) values were calculated and averaged. The average predictive performances of the models, quantified using simulated validation sets, were compared to the means of the AICs. The data for fits and validation consisted of 11 concentration measurements each obtained in 5 individuals, with three degrees of interindividual variability in the pharmacokinetic volume of distribution. Mean AIC c corresponded very well, and better than mean AIC, with mean predictive performance. With increasing interindividual variability, there was a trend towards larger optimal models, but with respect to both lowest AIC c and best predictive performance. Furthermore, it was observed that the mean square prediction error itself became less suitable as a validation criterion, and that a predictive performance measure should incorporate interindividual variability. This simulation study showed that, at least in a relatively simple mixed effects modelling context with a set of prespecified models, minimal mean AIC c corresponded to best predictive performance even in the presence of relatively large interindividual variability.

Dataset Information

Normalization and statistical analysis of multiplexed bead-based immunoassay data using mixed-effects modeling.

Publications

Normalization and statistical analysis of multiplexed bead-based immunoassay data using mixed-effects modeling.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets