Dataset Information

Head-to-Head Evaluation of Five Automated SARS-CoV-2 Serology Immunoassays in Various Prevalence Settings.

ABSTRACT:

Purpose

To assess the diagnostic performances of five automated anti-SARS-CoV-2 immunoassays, Epitope (N), Diasorin (S1/S2), Euroimmun (S1), Roche N (N), and Roche S (S-RBD), and to provide a testing strategy based on pre-test probability.

Methods

We assessed the receiver operating characteristic (ROC) areas under the curve (AUC) values, along with the sensitivity, specificity, positive predictive values (PPVs), and negative predictive values (NPVs), of each assay using a validation sample set of 172 COVID-19 sera and 185 negative controls against a validated S1-immunofluorescence as a reference method. The three assays displaying the highest AUCs were selected for further serodetection of 2033 sera of a large population-based cohort.

Results

In the validation analysis (pre-test probability: 48.1%), Roche N, Roche S and Euroimmun showed the highest discriminant accuracy (AUCs: 0.99, 0.98, and 0.98) with PPVs and NPVs above 96% and 94%, respectively. In the population-based cohort (pre-test probability: 6.2%) these three assays displayed AUCs above 0.97 and PPVs and NPVs above 90.5% and 99.4%, respectively. A sequential strategy using an anti-S assay as screening test and an anti-N as confirmatory assays resulted in a 96.7% PPV and 99.5% NPV, respectively.

Conclusions

Euroimmun and both Roche assays performed equally well in high pre-test probability settings. At a lower prevalence, sequentially combining anti-S and anti-N assays resulted in the optimal trade-off between diagnostic performances and operational considerations.

SUBMITTER: Andrey DO

PROVIDER: S-EPMC8069412 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundSevere acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has caused a global pandemic in 2020. Testing is crucial for mitigating public health and economic effects. Serology is considered key to population-level surveillance and potentially individual-level risk assessment. However, immunoassay performance has not been compared on large, identical sample sets. We aimed to investigate the performance of four high-throughput commercial SARS-CoV-2 antibody immunoassays and a novel 384-well ELISA.MethodsWe did a head-to-head assessment of SARS-CoV-2 IgG assay (Abbott, Chicago, IL, USA), LIAISON SARS-CoV-2 S1/S2 IgG assay (DiaSorin, Saluggia, Italy), Elecsys Anti-SARS-CoV-2 assay (Roche, Basel, Switzerland), SARS-CoV-2 Total assay (Siemens, Munich, Germany), and a novel 384-well ELISA (the Oxford immunoassay). We derived sensitivity and specificity from 976 pre-pandemic blood samples (collected between Sept 4, 2014, and Oct 4, 2016) and 536 blood samples from patients with laboratory-confirmed SARS-CoV-2 infection, collected at least 20 days post symptom onset (collected between Feb 1, 2020, and May 31, 2020). Receiver operating characteristic (ROC) curves were used to assess assay thresholds.FindingsAt the manufacturers' thresholds, for the Abbott assay sensitivity was 92·7% (95% CI 90·2-94·8) and specificity was 99·9% (99·4-100%); for the DiaSorin assay sensitivity was 96·2% (94·2-97·7) and specificity was 98·9% (98·0-99·4); for the Oxford immunoassay sensitivity was 99·1% (97·8-99·7) and specificity was 99·0% (98·1-99·5); for the Roche assay sensitivity was 97·2% (95·4-98·4) and specificity was 99·8% (99·3-100); and for the Siemens assay sensitivity was 98·1% (96·6-99·1) and specificity was 99·9% (99·4-100%). All assays achieved a sensitivity of at least 98% with thresholds optimised to achieve a specificity of at least 98% on samples taken 30 days or more post symptom onset.InterpretationFour commercial, widely available assays and a scalable 384-well ELISA can be used for SARS-CoV-2 serological testing to achieve sensitivity and specificity of at least 98%. The Siemens assay and Oxford immunoassay achieved these metrics without further optimisation. This benchmark study in immunoassay assessment should enable refinements of testing strategies and the best use of serological testing resource to benefit individuals and population health.FundingPublic Health England and UK National Institute for Health Research.

Project description:IntroductionCommercially available serological assays for SARS-CoV-2 detect antibodies to either the nucleocapsid or spike protein. Here we compare the performance of the Beckman-Coulter SARS-CoV-2 spike IgG assay to that of the Abbott SARS-CoV-2 nucleocapsid IgG and Roche Anti-SARS-CoV-2 nucleocapsid total antibody assays. In addition, we document the trend in nucleocapsid and spike antibodies in sequential samples collected from convalescent plasma donors.MethodsPlasma or serum samples from 20 individual SARS-CoV-2 RT-PCR-positive inpatients (n = 172), 20 individual convalescent donors with a previous RT-PCR-confirmed SARS-CoV-2 infection (n = 20), were deemed positive SARS-CoV-2 samples. RT-PCR-negative inpatients (n = 24), and 109 pre-SARS-CoV-2 samples were determined to be SARS-CoV-2 negative. Samples were assayed by the Abbott, Roche, and Beckman assays.ResultsAll three assays demonstrated 100% specificity. Abbott, Beckman, and Roche platforms had sensitivities of 98%, 93%, and 90% respectively, with the difference in sensitivity attributed primarily to samples from immunocompromised patients. After the exclusion of samples immunocompromised patients, all assays exhibited ≥ 95% sensitivity. In sequential samples collected from the same individuals, the Roche nucleocapsid antibody assay demonstrated continually increasing signal intensity, with maximal values observed at the last time point examined. In contrast, the Beckman spike IgG antibody signal peaked between 14 and 28 days post positive SARS-CoV-2 PCR and steadily declined in subsequent samples. Subsequent collections 51-200 days (median of 139 days) post positive SARS-CoV-2 RT-PCR from five inpatients and five convalescent donors revealed that spike and nucleocapsid antibodies remained detectable for several months after confirmed infection.ConclusionsThe three assays are sensitive and specific for SARS-CoV-2 antibodies. Nucleocapsid and spike antibodies were detectable for up to 200 days post-positive SARS-CoV-2 PCR but demonstrated markedly different trends in signal intensity.