Dataset Information

Diagnostic and analytical performance evaluation of ten commercial assays for detecting SARS-CoV-2 humoral immune response.

ABSTRACT:

Objective

Analytical validation of newly released SARS-CoV-2 antibody assays in the clinical laboratory is crucial to ensure sufficient performance in respect to its intended use. We aimed to assess analytical and diagnostic performance of 8 (semi-)quantitative assays detecting anti-nucleocapsid IgG (Euroimmun, Id-Vet) or total Ig (Roche), anti-spike protein IgG (Euroimmun, Theradiag, DiaSorin, Thermo Fisher) or both (Theradiag) and 2 rapid lateral flow assays (LFA) (AAZ-LMB and Theradiag).

Methods

Specificity was evaluated using a cross-reactivity panel of 85 pre-pandemic serum samples. Sensitivity was determined at both the manufacturer's and a 95% specificity cut-off level, using 81 serum samples of patients with a positive rRT-PCR. Sensitivity was determined in function of time post symptoms onset.

Results

Specificity for all assays ranged from 92.9% to 100% (Roche and Thermo Fisher) with the exception of the Theradiag IgM LFA (82.4%). Sensitivity in asymptomatic patients ranged between 41.7% and 58.3%. Sensitivity on samples taken <10 days since symptom onset was low (23.3%-66.7%) and increased on samples taken between 10 and 20 days and > 20 days since symptom onset (80%-96% and 92.9%-100%, respectively). From 20 days after symptom onset, the Roche, Id-vet and Thermo Fisher assays all met the sensitivity (>95%) and specificity (>97%) targets determined by the WHO. Antibody signal response was significantly higher in the critically ill patient group.

Conclusion

Antibody detection can complement rRT-PCR for the diagnosis of COVID-19, especially in the later stage, or in asymptomatic patients for epidemiological purposes. Addition of IgM in LFAs did not improve sensitivity.

SUBMITTER: Mylemans M

PROVIDER: S-EPMC7989098 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundSevere acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which has caused a global pandemic beginning in 2020, can be detected by reverse-transcription polymerase chain reaction (RT-PCR). However, owing to the urgent need for a large number of detection kits, the time spent researching and developing these kits has been shortened during the pandemic, and the kits that are being used commercially have not undergone full and independent evaluation. To ensure the accuracy of SARS-CoV-2 test results, performance verification of commercial Real-Time quantitative PCR (RT-qPCR) kits is required.MethodsThe performance of five commercial RT-qPCR diagnostic kits for SARS-CoV-2 used in China was evaluated using a coronavirus disease 2019 (COVID-19) RNA liquid performance verification reference product-manufactured by Guangzhou Bondson (BDS) Biotechnology Co., Ltd.,Guangzhou, China-that uses droplet digital RT-PCR technology combined with fluorescence quantitative PCR. The five kits of Novel Coronavirus 2019-nCoV nucleic acid detection kit (RT-qPCR method) evaluated were Da An (Da An Gene Co., Ltd. of Sun Yat-sen University), Liferiver (Shanghai ZJ Bio-Tech Co., Ltd.), Kinghawk (Beijing Kinghawk Pharmaceutical Co., Ltd.), eDiagnosis (Wuhan Easy Diagnosis Biomedicine Co., Ltd.), and Maccura (Maccura Biotechnology Co., Ltd.). Performance verification criteria included the coincidence rate, limit of detection (LoD), cross-reactivity, precision, and anti-interference. Finally, through the BDS performance verification reference product kit, clinical samples are used to verify its clinical diagnostic efficacy.ResultsThe coincidence rate was 100% for all kits except for Kinghawk, which was 95%. The LoD for Da An, eDiagnosis and Maccura was 250copies/mL, and it was 1000 copies/ml for Liferiver. Kinghawk was not able to detect its advertised LoD of 500 copies/ml. The cross-reactivity test results were all negative. Moreover, all kits had a coefficient of variation less than 5%; however, Liferiver showed the best precision. Da An, Liferiver, and eDiagnosis showed higher sensitivity to the nucleocapsid (N) gene than they did to the open reading frame (ORF) 1ab genes. Anti-interference results for all five kits were positive. The results of clinical diagnostic efficacy were that the specificity of the four kits was 1.000 (0.877-1.000), the sensitivity of Da An was 1.000 (0.850-1.000), Liferiver was 0.964 (0.798-0.998), Maccura was 0.893 (0.706-0.972), and eDiagnosis was 0.857 (0.664-0.953).ConclusionsAll commercial RT-qPCR diagnostic kits for SARS-CoV-2 passed the BDS performance verification, except for Kinghawk (batch No:20200608113) which failed to detect the LoD of 500 copies/mL. Da An and Liferiver have excellent clinical diagnostic specificity and sensitivity. This study can provide guidance for the selection or optimization of RT-qPCR diagnostic test kits for SARS-CoV-2.

Project description:BackgroundSerological testing for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) complements nucleic acid tests for patient diagnosis and enables monitoring of population susceptibility to inform the coronavirus disease 2019 (COVID-19) pandemic response. It is important to understand the reliability of assays with different antigen or antibody targets to detect humoral immunity after SARS-CoV-2 infection and to understand how antibody (Ab) binding assays compare to those detecting neutralizing antibody (nAb), particularly as we move into the era of vaccines.MethodsWe evaluated the performance of 6 commercially available enzyme-linked immunosorbent assays (ELISAs), including a surrogate virus neutralization test (sVNT), for detection of SARS-CoV-2 immunoglobulins (IgA, IgM, IgG), total or nAb. A result subset was compared with a cell culture-based microneutralization (MN) assay. We tested sera from patients with prior reverse transcription polymerase chain reaction-confirmed SARS-CoV-2 infection, prepandemic sera, and potential cross-reactive sera from patients with other non-COVID-19 acute infections.ResultsFor sera collected >14 days post-symptom onset, the assay achieving the highest sensitivity was the Wantai total Ab at 100% (95% CI, 94.6%-100%), followed by 93.1% for Euroimmun NCP-IgG, 93.1% for GenScript sVNT, 90.3% for Euroimmun S1-IgG, 88.9% for Euroimmun S1-IgA, and 83.3% for Wantai IgM. Specificity for the best-performing assay was 99.5% for the Wantai total Ab, and for the lowest-performing assay it was 97.1% for sVNT (as per the Instructions for Use [IFU]). The Wantai Total Ab had the best agreement with MN at 98% followed by Euroimmun S1-IgA, Euro NCP-IgG, and sVNT (as per IFU) with 97%, 97% and 95%, respectively; Wantai IgM had the poorest agreement at 93%.ConclusionsPerformance characteristics of the SARS-CoV-2 serology assays detecting different antibody types are consistent with those found in previously published reports. Evaluation of the surrogate virus neutralization test in comparison to the Ab binding assays and a cell culture-based neutralization assay showed good result correlation between all assays. However, correlation between the cell-based neutralization test and some assays detecting Ab's not specifically involved in neutralization was higher than with the sVNT. This study demonstrates the reliability of different assays to detect the humoral immune response following SARS-CoV-2 infection, which can be used to optimize serological test algorithms for assessing antibody responses post-SARS-CoV-2 infection or vaccination.