Dataset Information

Quality assurance of intracellular cytokine staining assays: analysis of multiple rounds of proficiency testing.

ABSTRACT: When evaluating candidate prophylactic HIV and cancer vaccines, intracellular cytokine staining (ICS) assays that measure the frequency and magnitude of antigen-specific T-cell subsets are one tool to monitor immunogen performance and make product advancement decisions. To assess the inter-laboratory assay variation among multiple laboratories testing vaccine candidates, the NIH/NIAID/DAIDS in collaboration with BD Biosciences implemented an ICS Quality Assurance Program (QAP). Seven rounds of testing have been conducted in which 16 laboratories worldwide participated. In each round, IFN-?, IL-2 and/or TNF-? responses in CD4+ and CD8+ T-cells to CEF or CMV pp65 peptide mixes were tested using cryopreserved peripheral blood mononuclear cells (PBMC) from CMV seropositive donors. We found that for responses measured above 0.2%, inter-laboratory %CVs were, on average, 35%. No differences in inter-laboratory variation were observed if a 4-color antibody cocktail or a 7-color combination was used. Moreover, the data allowed identification of important sources of variability for flow cytometry-based assays, including: number of collected events, gating strategy and instrument setup and performance. As a consequence, in this multi-site study we were able to define pass and fail criteria for ICS assays, which will be adopted in the subsequent rounds of testing and could be easily extrapolated to QAP for other flow cytometry-based assays.

SUBMITTER: Jaimes MC

PROVIDER: S-EPMC3003767 | biostudies-literature | 2011 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Quality assurance of intracellular cytokine staining assays: analysis of multiple rounds of proficiency testing.

Jaimes Maria C MC Maecker Holden T HT Yan Ming M Maino Vernon C VC Hanley Mary Beth MB Greer Angela A Darden Janice M JM D'Souza M Patricia MP

Journal of immunological methods 20100819 2

When evaluating candidate prophylactic HIV and cancer vaccines, intracellular cytokine staining (ICS) assays that measure the frequency and magnitude of antigen-specific T-cell subsets are one tool to monitor immunogen performance and make product advancement decisions. To assess the inter-laboratory assay variation among multiple laboratories testing vaccine candidates, the NIH/NIAID/DAIDS in collaboration with BD Biosciences implemented an ICS Quality Assurance Program (QAP). Seven rounds of t ...[more]

PMID: 20727897

Similar Datasets

Project description:BACKGROUND:The Clinical Pharmacology Quality Assurance (CPQA) program provides semiannual proficiency testing (PT) of antiretroviral analytes for 11 US and international clinical pharmacology laboratories (CPLs) to ensure interlaboratory comparability. In this article, we provide estimates of the main sources of variability and assess the accuracy of the algorithm for the assessment of performance. METHODS:Descriptive statistics are reported from 13 PT rounds from 2010 to 2016. Eight of the most common antiretroviral analytes were examined. Variance components analysis was used to rank the relative contributions of CPLs, antiretroviral analyte, and concentration category (low, medium, and high) to bias and variability using mixed models. Binary classification metrics of the PT assessment algorithm are calculated in comparison with a model using 95% prediction limits around estimated regression equations. RESULTS:CPLs provided 4109 reported concentrations of 65 unique samples for each of the 8 antiretroviral analytes across 13 PT rounds. Individual CPL accounted for the greatest amount of total variability (4.4%). Individual CPL and analyte combination (interaction) accounted for the greatest amount of bias (8.1%). Analyte alone accounted for 0.5% or less for total variability and bias. Overall, using a ±20% acceptance window around the final target, 97% of individual reported concentrations were scored acceptable, and 96% of antiretroviral/round scores were deemed satisfactory. Comparison with the regression model gave 100% sensitivity but only 34.47% specificity. Narrowing the acceptance window to ±15% improved specificity to 84.47% while maintaining a 99.17% sensitivity. CONCLUSIONS:The current CPQA PT scoring algorithm that use a ±20% acceptance window seems to suffer from a low specificity and may be too lenient. A stricter ±15% acceptance window would increase specificity and overall accuracy while lowering the overall pass rate by only 3%.

Project description:Cell-mediated responses to immunological stimuli are often localised in inflammatory sites and involve a number of cell types. These responses can be functionally characterised at the single-cell level on the basis of the types of cytokines expressed either in whole blood or PBMCs. The ability to measure antigen-specific cell responses at the single cell level is an important tool with a wide range of potential applications ranging from studies of disease pathogenesis to the evaluation of vaccines. A number of experiments were performed in this study in order to establish the optimal conditions for in vitro stimulation of cytokine production by T cells and monocytes in whole blood samples collected from healthy adult Malawian participants and the optimal staining conditions for various cytokine producing cells. Different stimulation methods and conditions, different culture tubes and incubators and different antibody labelling conditions were assessed in order to establish optimal conditions for detecting cytokine-producing cells in whole blood samples. The use of PMA plus Ionomycin produced highest cytokine-producing T cells whereas LPS was a better stimulant for cytokine producing monocytes. Stimulation of whole blood for 5 h was optimal for cytokine detection in T cells whereas 4 h was optimal for monocytes. BFA was found to be a better Golgi blocker than Monensin and the use of 15 ml Falcon-type polypropylene tubes while stationary resulted in the detection of the highest proportion of cytokine-producing cells. T cells were found to be producers of mainly TNF-α, IFN-γ and IL-2 whereas Monocytes were mainly producing TNF-α and IL-6. Anti-CD3-PerCP (used at a ratio of 1:25), anti-CD14-APC (used at a ratio of 1:50) and anti-cytokine-PE (used at a ratio of 1:12.5) resulted in the best results. The highest cytokine production monocytes were detected when 1 X FACS Lysing solution was used at a volume of 40X that of the whole blood sample compared to the other volumes. These optimal conditions are essential in determination of proportion of cytokine-producing cells using ICS in whole blood.

Dataset Information

Quality assurance of intracellular cytokine staining assays: analysis of multiple rounds of proficiency testing.

Publications

Quality assurance of intracellular cytokine staining assays: analysis of multiple rounds of proficiency testing.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets