Dataset Information

Performance characteristics of five antigen-detecting rapid diagnostic test (Ag-RDT) for SARS-CoV-2 asymptomatic infection: a head-to-head benchmark comparison.

ABSTRACT:

Background

Mass testing for early identification and isolation of infectious COVID-19 individuals is efficacious for reducing disease spread. Antigen-detecting rapid diagnostic tests (Ag-RDT) may be suitable for testing strategies; however, benchmark comparisons are scarce.

Methods

We used 286 nasopharyngeal specimens from unexposed asymptomatic individuals collected between December 2020 and January 2021 to assess five Ag-RDTs marketed by Abbott, Siemens, Roche Diagnostics, Lepu Medical, and Surescreen.

Results

For the overall sample, the performance parameters of Ag-RDTs were as follows: Abbott assay, sensitivity 38.6% (95%CI 29.1-48.8) and specificity 99.5% (97-100%); Siemens, sensitivity 51.5% (41.3-61.6) and specificity 98.4% (95.3-99.6); Roche, sensitivity 43.6% (33.7-53.8) and specificity 96.2% (92.4-98.5); Lepu, sensitivity 45.5% (35.6-55.8) and specificity 89.2% (83.8-93.3%); Surescreen, sensitivity 28.8% (20.2-38.6) and specificity 97.8% (94.5-99.4%). For specimens with cycle threshold (Ct) <30 in RT-qPCR, all Ag-RDT achieved a sensitivity ≥70%. The modelled negative- and positive-predictive value for 1% prevalence were >99% and <50%, respectively.

Conclusions

When screening unexposed asymptomatic individuals, two Ag-RDTs achieved sensitivity ≥80% for specimens with Ct<30 and specificity ≥96%. The estimated negative predictive value suggests the suitability of Ag-RDTs for mass screenings of SARS-CoV-2 infection in the general population.

SUBMITTER: Baro B

PROVIDER: S-EPMC8053403 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMelioidosis, an infectious disease caused by Burkholderia pseudomallei, is endemic in many tropical developing countries and has a high mortality. Here we evaluated combinations of a lateral flow immunoassay (LFI) detecting B. pseudomallei capsular polysaccharide (CPS) and enzyme-linked immunosorbent assays (ELISA) detecting antibodies against hemolysin co-regulated protein (Hcp1) or O-polysaccharide (OPS) for diagnosing melioidosis.Methodology/principal findingsWe conducted a cohort-based case-control study. Both cases and controls were derived from a prospective observational study of patients presenting with community-acquired infections and sepsis in northeast Thailand (Ubon-sepsis). Cases included 192 patients with a clinical specimen culture positive for B. pseudomallei. Controls included 502 patients who were blood culture positive for Staphylococcus aureus, Escherichia coli or Klebsiella pneumoniae or were polymerase chain reaction assay positive for malaria or dengue. Serum samples collected within 24 hours of admission were stored and tested using a CPS-LFI, Hcp1-ELISA and OPS-ELISA. When assessing diagnostic tests in combination, results were considered positive if either test was positive. We selected ELISA cut-offs corresponding to a specificity of 95%. Using a positive cut-off OD of 2.912 for Hcp1-ELISA, the combination of the CPS-LFI and Hcp1-ELISA had a sensitivity of 67.7% (130/192 case patients) and a specificity of 95.0% (477/502 control patients). The sensitivity of the combination (67.7%) was higher than that of the CPS-LFI alone (31.3%, p<0.001) and that of Hcp1-ELISA alone (53.6%, p<0.001). A similar phenomenon was also observed for the combination of CPS-LFI and OPS-ELISA. In case patients, positivity of the CPS-LFI was associated with a short duration of symptoms, high modified Sequential (sepsis-related) Organ Failure Assessment (SOFA) score, bacteraemia and mortality outcome, while positivity of Hcp1-ELISA was associated with a longer duration of symptoms, low modified SOFA score, non-bacteraemia and survival outcome.Conclusions/significanceA combination of antigen-antibody diagnostic tests increased the sensitivity of melioidosis diagnosis over individual tests while preserving high specificity. Point-of-care tests for melioidosis based on the use of combination assays should be further developed and evaluated.

Project description:BackgroundSevere acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has caused a global pandemic in 2020. Testing is crucial for mitigating public health and economic effects. Serology is considered key to population-level surveillance and potentially individual-level risk assessment. However, immunoassay performance has not been compared on large, identical sample sets. We aimed to investigate the performance of four high-throughput commercial SARS-CoV-2 antibody immunoassays and a novel 384-well ELISA.MethodsWe did a head-to-head assessment of SARS-CoV-2 IgG assay (Abbott, Chicago, IL, USA), LIAISON SARS-CoV-2 S1/S2 IgG assay (DiaSorin, Saluggia, Italy), Elecsys Anti-SARS-CoV-2 assay (Roche, Basel, Switzerland), SARS-CoV-2 Total assay (Siemens, Munich, Germany), and a novel 384-well ELISA (the Oxford immunoassay). We derived sensitivity and specificity from 976 pre-pandemic blood samples (collected between Sept 4, 2014, and Oct 4, 2016) and 536 blood samples from patients with laboratory-confirmed SARS-CoV-2 infection, collected at least 20 days post symptom onset (collected between Feb 1, 2020, and May 31, 2020). Receiver operating characteristic (ROC) curves were used to assess assay thresholds.FindingsAt the manufacturers' thresholds, for the Abbott assay sensitivity was 92·7% (95% CI 90·2-94·8) and specificity was 99·9% (99·4-100%); for the DiaSorin assay sensitivity was 96·2% (94·2-97·7) and specificity was 98·9% (98·0-99·4); for the Oxford immunoassay sensitivity was 99·1% (97·8-99·7) and specificity was 99·0% (98·1-99·5); for the Roche assay sensitivity was 97·2% (95·4-98·4) and specificity was 99·8% (99·3-100); and for the Siemens assay sensitivity was 98·1% (96·6-99·1) and specificity was 99·9% (99·4-100%). All assays achieved a sensitivity of at least 98% with thresholds optimised to achieve a specificity of at least 98% on samples taken 30 days or more post symptom onset.InterpretationFour commercial, widely available assays and a scalable 384-well ELISA can be used for SARS-CoV-2 serological testing to achieve sensitivity and specificity of at least 98%. The Siemens assay and Oxford immunoassay achieved these metrics without further optimisation. This benchmark study in immunoassay assessment should enable refinements of testing strategies and the best use of serological testing resource to benefit individuals and population health.FundingPublic Health England and UK National Institute for Health Research.

Project description:BackgroundMalaria rapid diagnostic tests (RDTs) play a critical role in malaria case management, and assurance of quality is a key factor to promote good adherence to test results. Since 2007, the World Health Organization (WHO) and the Foundation for Innovative New Diagnostics (FIND) have coordinated a Malaria RDT Evaluation Programme, comprising a pre-purchase performance evaluation (product testing, PT) and a pre-distribution quality control of lots (lot testing, LT), the former being the basis of WHO recommendations for RDT procurement. Comprehensive information on malaria RDTs sold worldwide based on manufacturers' data and linked to independent performance data is currently not available, and detailed knowledge of procurement practices remains limited.MethodsThe use of the PT/LT Programme results as well as procurement and lot verification practices were assessed through a large-scale survey, gathering product-specific RDT sales and procurement data (2011-14 period) from a total of 32 manufacturers, 12 procurers and 68 National Malaria Control Programmes (NMCPs).ResultsManufacturers' reports showed that RDT sales had more than doubled over the four years, and confirmed a trend towards increased compliance with the WHO procurement criteria (from 83% in 2011 to 93% in 2014). Country-level reports indicated that 74% of NMCPs procured only 'WHO-compliant' RDT products, although procurers' transactions datasets revealed a surprisingly frequent overlap of different products and even product types (e.g., Plasmodium falciparum-only and Plasmodium-pan) in the same year and country (60 and 46% of countries, respectively). Importantly, the proportion of 'non-complying' (i.e., PT low scored or not evaluated) products was found to be higher in the private health care sector than in the public sector (32% vs 5%), and increasing over time (from 22% of private sector sales in 2011 to 39% in 2014). An estimated 70% of the RDT market was covered by the LT programme. The opinion about the PT/LT Programmes was positive overall, and quality of RDTs as per the PT Programme was rated as the number one procurement criteria.ConclusionsThis survey provided in-depth information on RDT sales and procurement dynamics, including the largely unstudied private sector, and demonstrated how the WHO-FIND Programme has positively influenced procurement practices in the public sector.

Project description:BACKGROUND:Malaria rapid diagnostic tests (RDTs) are a simple, point-of-care technology that can improve the diagnosis and subsequent treatment of malaria. They are an increasingly common diagnostic tool, but concerns remain about their use by community health workers (CHWs). These concerns regard the long-term trends relating to infection prevention measures, the interpretation of test results and adherence to treatment protocols. This study assessed whether CHWs maintained their competency at conducting RDTs over a 12-month timeframe, and if this competency varied with specific CHW characteristics. METHODS:From June to September, 2015, CHWs (n?=?271) were trained to conduct RDTs using a 3-day validated curriculum and a baseline assessment was completed. Between June and August, 2016, CHWs (n?=?105) were randomly selected and recruited for follow-up assessments using a 20-step checklist that classified steps as relating to safety, accuracy, and treatment; 103 CHWs participated in follow-up assessments. Poisson regressions were used to test for associations between error count data at follow-up and Poisson regression models fit using generalized estimating equations were used to compare data across time-points. RESULTS:At both baseline and follow-up observations, at least 80% of CHWs correctly completed 17 of the 20 steps. CHWs being 50 years of age or older was associated with increased total errors and safety errors at baseline and follow-up. At follow-up, prior experience conducting RDTs was associated with fewer errors. Performance, as it related to the correct completion of all checklist steps and safety steps, did not decline over the 12 months and performance of accuracy steps improved (mean error ratio: 0.51; 95% CI 0.40-0.63). Visual interpretation of RDT results yielded a CHW sensitivity of 92.0% and a specificity of 97.3% when compared to interpretation by the research team. None of the characteristics investigated was found to be significantly associated with RDT interpretation. CONCLUSIONS:With training, most CHWs performing RDTs maintain diagnostic testing competency over at least 12 months. CHWs generally perform RDTs safely and accurately interpret results. Younger age and prior experiences with RDTs were associated with better testing performance. Future research should investigate the mode by which CHW characteristics impact RDT procedures.

Project description:Background Antigen-detecting rapid diagnostic tests (Ag-RDT) for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) offer new opportunities for the quick and laboratory-independent identification of infected individuals for control of the SARS-CoV-2 pandemic. Despite the potential benefits, nasopharyngeal sample collection is frequently perceived as uncomfortable by patients and requires trained healthcare personnel with protective equipment. Therefore, anterior nasal self-sampling is increasingly recognized as a valuable alternative. Methods We performed a prospective, single-center, point of care validation of an Ag-RDT using a polypropylene absorbent collector for standardized self-collected anterior nasal swabs. Real-time polymerase chain reaction (RT-PCR) from combined oropharyngeal/nasopharyngeal swabs served as a comparator. Primary endpoint was sensitivity of the standardized Ag-RDT in symptomatic patients with medium or high viral concentration (≥1 million RNA copies on RT-PCR for SARS-CoV-2). Results Between 12 February and 22 March 2021, 388 participants were enrolled. After exclusion of 9 patients for which no PCR result could be obtained, the novel Ag-RDT was evaluated based on 379 participants, of whom 273 were symptomatic and 106 asymptomatic. In 61 samples from symptomatic patients with medium or high viral load (≥1 million RNA copies), the sensitivity of the standardized Ag-RDT was 96.7% (59/61; 95% confidence interval (CI): 88.7-99.6%) for the primary endpoint. In total, 62 positive Ag-RDT results were detected out of 70 RT-PCR positive individuals, yielding an overall sensitivity of 88.6% (95% CI: 78.7-94.9%). Specificity was 99.7% (95% CI: 98.2-100%) in 309 RT-PCR negative individuals. Conclusions Here, we present a validation of a novel Ag-RDT with a standardized sampling process for anterior nasal self-collection, which meets World Health Organisation (WHO) criteria of ≥80% sensitivity and ≥97% specificity. Although less sensitive than RT-PCR, this assay could be beneficial due to its rapid results, ease of use, and suitability for standardized self-testing.