Dataset Information

The External Quality Assurance Oversight Laboratory (EQAPOL) proficiency program for IFN-gamma enzyme-linked immunospot (IFN-? ELISpot) assay.

ABSTRACT: The interferon-gamma enzyme-linked immunospot (IFN-? ELISpot) assay has been developed and used as an end-point assay in clinical trials for infectious diseases and cancer to detect the magnitude of antigen-specific immune responses. The ability to compare data generated by different laboratories across organizations is pivotal to understand the relative potency of different therapeutic and vaccine strategies. We developed an external proficiency program for the IFN-? ELISpot assay that evaluates laboratory performance based on five parameters: timeliness for data reporting; ability to handle cellular samples; detection of background (non-specific) responses; accuracy to consensus of the results; and precision of the measurements. Points are awarded for each criterion, and the sum of the points is used to determine a numeric and adjectival performance rating. Importantly, the evaluation of the accuracy to the consensus mean for the detection of antigen-specific responses using laboratory-specific procedures informs each laboratory and its sponsor on the degree of concordance of its results with those obtained by other laboratories. This study will ultimately provide the scientific community with information on how to organize and implement an external proficiency program to evaluate longitudinally the performance of the participating laboratories and, therefore, fulfill the requirements of the GCLP guidelines for laboratories performing end-point IFN-? ELISpot assay for clinical trials.

SUBMITTER: Sanchez AM

PROVIDER: S-EPMC4138255 | biostudies-literature | 2014 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The External Quality Assurance Oversight Laboratory (EQAPOL) proficiency program for IFN-gamma enzyme-linked immunospot (IFN-γ ELISpot) assay.

Sanchez Ana M AM Rountree Wes W Berrong Mark M Garcia Ambrosia A Schuetz Alexandra A Cox Josephine J Frahm Nicole N Manak Mark M Sarzotti-Kelsoe Marcella M D'Souza M Patricia MP Denny Thomas T Ferrari Guido G

Journal of immunological methods 20140328

The interferon-gamma enzyme-linked immunospot (IFN-γ ELISpot) assay has been developed and used as an end-point assay in clinical trials for infectious diseases and cancer to detect the magnitude of antigen-specific immune responses. The ability to compare data generated by different laboratories across organizations is pivotal to understand the relative potency of different therapeutic and vaccine strategies. We developed an external proficiency program for the IFN-γ ELISpot assay that evaluate ...[more]

PMID: 24685833

Similar Datasets

Project description:BACKGROUND:The Clinical Pharmacology Quality Assurance (CPQA) program provides semiannual proficiency testing (PT) of antiretroviral analytes for 11 US and international clinical pharmacology laboratories (CPLs) to ensure interlaboratory comparability. In this article, we provide estimates of the main sources of variability and assess the accuracy of the algorithm for the assessment of performance. METHODS:Descriptive statistics are reported from 13 PT rounds from 2010 to 2016. Eight of the most common antiretroviral analytes were examined. Variance components analysis was used to rank the relative contributions of CPLs, antiretroviral analyte, and concentration category (low, medium, and high) to bias and variability using mixed models. Binary classification metrics of the PT assessment algorithm are calculated in comparison with a model using 95% prediction limits around estimated regression equations. RESULTS:CPLs provided 4109 reported concentrations of 65 unique samples for each of the 8 antiretroviral analytes across 13 PT rounds. Individual CPL accounted for the greatest amount of total variability (4.4%). Individual CPL and analyte combination (interaction) accounted for the greatest amount of bias (8.1%). Analyte alone accounted for 0.5% or less for total variability and bias. Overall, using a ±20% acceptance window around the final target, 97% of individual reported concentrations were scored acceptable, and 96% of antiretroviral/round scores were deemed satisfactory. Comparison with the regression model gave 100% sensitivity but only 34.47% specificity. Narrowing the acceptance window to ±15% improved specificity to 84.47% while maintaining a 99.17% sensitivity. CONCLUSIONS:The current CPQA PT scoring algorithm that use a ±20% acceptance window seems to suffer from a low specificity and may be too lenient. A stricter ±15% acceptance window would increase specificity and overall accuracy while lowering the overall pass rate by only 3%.

Project description:Laboratory assays for identifying recent HIV-1 infections are widely used for estimating incidence in cross-sectional population-level surveys in global HIV-1surveillance. Adequate assay and laboratory performance are required to ensure accurate incidence estimates. The NIAID-supported External Quality Assurance Program Oversight Laboratory (EQAPOL) established a proficiency testing program for the most widely-used incidence assay, the HIV-1 Limiting Antigen Avidity EIA (LAg), with US Centers for Disease Control and Prevention (CDC)-approved kits manufactured by Sedia Biosciences Corporation and Maxim Biomedical. The objective of this program is to monitor the performance of participating laboratories. Four rounds of blinded external proficiency (EP) panels were distributed to up to twenty testing sites (7 North American, 5 African, 4 Asian, 2 South American and 2 European). These panels consisted of ten plasma samples: three blinded well-characterized HIV-1-seropositive samples that were included as replicates and an HIV-negative control. The seropositive samples spanned the dynamic range of the assay and are categorized as either recent or long-term infection. Participating sites performed the assay according to manufacturers' instructions and completed an online survey to gather information on kit manufacturer, lot of kit used, laboratory procedures and the experience of technicians. On average, fifteen sites participated in each round of testing, with an average of four sites testing with only the Maxim assay, seven testing with only the Sedia assay and five sites utilizing both assays. Overall, the Sedia and Maxim assays yielded similar infection status categorization across the laboratories; however, for most of the nine HIV+ samples tested, there were significant differences in the optical density readouts, ODn (N = 8) and OD (N = 7), between LAg kit manufacturers (p < 0.05 based on mixed effects models. The EQAPOL LAg program is important for monitoring laboratory performance as well as detecting variations between manufacturers of HIV-1incidence assays.

Dataset Information

The External Quality Assurance Oversight Laboratory (EQAPOL) proficiency program for IFN-gamma enzyme-linked immunospot (IFN-? ELISpot) assay.

Publications

The External Quality Assurance Oversight Laboratory (EQAPOL) proficiency program for IFN-gamma enzyme-linked immunospot (IFN-γ ELISpot) assay.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure