Dataset Information

Performance and Operational Evaluation of the Access Bio CareStart Rapid Antigen Test in a High-Throughput Drive-Through Community Testing Site in Massachusetts

ABSTRACT: Abstract

Background

To facilitate deployment of point-of-care testing for severe acute respiratory syndrome coronavirus 2, we evaluated the Access Bio CareStart COVID-19 Antigen test in a high-throughput, drive-through, free community testing site using anterior nasal (AN) swab reverse-transcription polymerase chain reaction (RT-PCR) for clinical testing.

Methods

Consenting symptomatic and asymptomatic children (≤18 years) and adults received dual AN swabs. CareStart testing was performed with temperature/humidity monitoring. All tests had 2 independent reads to assess interoperator agreement. Patients with positive CareStart results were called and instructed to isolate pending RT-PCR results. The paired RT-PCR result was the reference for sensitivity and specificity calculations.

Results

Of 1603 participants, 1245 adults and 253 children had paired RT-PCR/CareStart results and complete symptom data. Eighty-three percent of adults and 87% of children were asymptomatic. CareStart sensitivity/specificity were 84.8% (95% confidence interval [CI], 71.1–93.7)/97.2% (95% CI, 92.0–99.4) and 85.7% (95% CI, 42.1–99.6)/89.5% (95% CI, 66.9–98.7) in adults and children, respectively, within 5 days of symptoms. Sensitivity/specificity were 50.0% (95% CI, 41.0–59.0)/99.1% (95% CI, 98.3–99.6) in asymptomatic adults and 51.4% (95% CI, 34.4–68.1)/97.8% (95% CI, 94.5–99.4) in asymptomatic children. Sensitivity in all 234 RT-PCR-positive people was 96.3% with cycle threshold (Ct) ≤25, 79.6% with Ct ≤30, and 61.4% with Ct ≤35. All 21 false-positive CareStart tests had faint but normal bands. Interoperator agreement was 99.5%. Operational challenges included identification of faint test bands and inconsistent swab elution volumes.

Conclusions

CareStart had high sensitivity in people with Ct ≤25 and moderate sensitivity in symptomatic people overall. Specificity was unexpectedly lower in symptomatic versus asymptomatic people. Excellent interoperator agreement was observed, but operational challenges indicate that operator training is warranted. We evaluated the CareStart COVID-19 Antigen test in a high-throughput community testing site. We observed 50.0%–85.7% sensitivity and 89.5%–99.1% specificity in asymptomatic and symptomatic children/adults, with 96.3% or 79.6% sensitivity, respectively. Interoperator agreement was 99.5%.

SUBMITTER: Pollock N

PROVIDER: S-EPMC8244626 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Rapid diagnostic tests (RDTs) for SARS-CoV-2 antigens (Ag) that can be performed at point of care (POC) can supplement molecular testing and help mitigate the COVID-19 pandemic. Deployment of an Ag RDT requires an understanding of its operational and performance characteristics under real-world conditions and in relevant subpopulations. We evaluated the Abbott BinaxNOW COVID-19 Ag card in a high-throughput, drive-through, free community testing site in Massachusetts using anterior nasal (AN) swab reverse transcriptase PCR (RT-PCR) for clinical testing. Individuals presenting for molecular testing in two of seven lanes were offered the opportunity to also receive BinaxNOW testing. Dual AN swabs were collected from symptomatic and asymptomatic children (≤18 years of age) and adults. BinaxNOW testing was performed in a testing pod with temperature/humidity monitoring. One individual performed testing and official result reporting for each test, but most tests had a second independent reading to assess interoperator agreement. Positive BinaxNOW results were scored as faint, medium, or strong. Positive BinaxNOW results were reported to patients by phone, and they were instructed to isolate pending RT-PCR results. The paired RT-PCR result was the reference for sensitivity and specificity calculations. Of 2,482 participants, 1,380 adults and 928 children had paired RT-PCR/BinaxNOW results and complete symptom data. In this study, 974/1,380 (71%) adults and 829/928 (89%) children were asymptomatic. BinaxNOW had 96.5% (95% confidence interval [CI], 90.0 to 99.3) sensitivity and 100% (95% CI, 98.6 to 100.0) specificity in adults within 7 days of symptoms and 84.6% (95% CI, 65.1 to 95.6) sensitivity and 100% (95% CI, 94.5 to 100.0) specificity in children within 7 days of symptoms. Sensitivity and specificity in asymptomatic adults were 70.2% (95% CI, 56.6 to 81.6) and 99.6% (95% CI, 98.9 to 99.9), respectively, and in asymptomatic children, they were 65.4% (95% CI, 55.6 to 74.4) and 99.0% (95% CI, 98.0 to 99.6), respectively. By cycle threshold (CT ) value cutoff, sensitivity in all subgroups combined (n = 292 RT-PCR-positive individuals) was 99.3% with CT values of ≤25, 95.8% with CT values of ≤30, and 81.2% with CT values of ≤35. Twelve false-positive BinaxNOW results (out of 2,308 tests) were observed; in all 12, the test bands were faint but otherwise normal and were noted by both readers. One invalid BinaxNOW result was identified. Interoperator agreement (positive versus negative BinaxNOW result) was 100% (n = 2,230/2,230 double reads). Each operator was able to process 20 RDTs per hour. In a separate set of 30 specimens (from individuals with symptoms ≤7 days) run at temperatures below the manufacturer's recommended range (46 to 58.5°F), sensitivity was 66.7% and specificity 95.2%. BinaxNOW had very high specificity in both adults and children and very high sensitivity in newly symptomatic adults. Overall, 95.8% sensitivity was observed with CT values of ≤30. These data support public health recommendations for use of the BinaxNOW test in adults with symptoms for ≤7 days without RT-PCR confirmation. Excellent interoperator agreement indicates that an individual can perform and read the BinaxNOW test alone. A skilled laboratorian can perform and read 20 tests per hour. Careful attention to temperature is critical.

Project description:BackgroundTo reduce the risk of drug-induced haemolysis, all patients should be tested for glucose-6-phosphate dehydrogenase (G6PD) deficiency (G6PDd) prior to prescribing primaquine (PQ)-based radical cure for the treatment of vivax malaria. This systematic review and individual patient meta-analysis assessed the utility of a qualitative lateral flow assay from Access Bio/CareStart (Somerset, NJ) (CareStart Screening test for G6PD deficiency) for the diagnosis of G6PDd compared to the gold standard spectrophotometry (International Prospective Register of Systematic Reviews [PROSPERO]: CRD42019110994).Methods and findingsArticles published on PubMed between 1 January 2011 and 27 September 2019 were screened. Articles reporting performance of the standard CSG from venous or capillary blood samples collected prospectively and considering spectrophotometry as gold standard (using kits from Trinity Biotech PLC, Wicklow, Ireland) were included. Authors of articles fulfilling the inclusion criteria were contacted to contribute anonymized individual data. Minimal data requested were sex of the participant, CSG result, spectrophotometry result in U/gHb, and haemoglobin (Hb) reading. The adjusted male median (AMM) was calculated per site and defined as 100% G6PD activity. G6PDd was defined as an enzyme activity of less than 30%. Pooled estimates for sensitivity and specificity, unconditional negative predictive value (NPV), positive likelihood ratio (LR+), and negative likelihood ratio (LR-) were calculated comparing CSG results to spectrophotometry using a random-effects bivariate model. Of 11 eligible published articles, individual data were available from 8 studies, 6 from Southeast Asia, 1 from Africa, and 1 from the Americas. A total of 5,815 individual participant data (IPD) were available, of which 5,777 results (99.3%) were considered for analysis, including data from 3,095 (53.6%) females. Overall, the CSG had a pooled sensitivity of 0.96 (95% CI 0.90-0.99) and a specificity of 0.95 (95% CI 0.92-0.96). When the prevalence of G6PDd was varied from 5% to 30%, the unconditional NPV was 0.99 (95% CI 0.94-1.00), with an LR+ and an LR- of 18.23 (95% CI 13.04-25.48) and 0.05 (95% CI 0.02-0.12), respectively. Performance was significantly better in males compared to females (p = 0.027) but did not differ significantly between samples collected from capillary or venous blood (p = 0.547). Limitations of the study include the lack of wide geographical representation of the included data and that the CSG results were generated under research conditions, and therefore may not reflect performance in routine settings.ConclusionsThe CSG performed well at the 30% threshold. Its high NPV suggests that the test is suitable to guide PQ treatment, and the high LR+ and low LR- render the test suitable to confirm and exclude G6PDd. Further operational studies are needed to confirm the utility of the test in remote endemic settings.