Dataset Information

Cost-effectiveness of artificial intelligence aided vessel occlusion detection in acute stroke: an early health technology assessment.

ABSTRACT:

Background

Limited evidence is available on the clinical impact of artificial intelligence (AI) in radiology. Early health technology assessment (HTA) is a methodology to assess the potential value of an innovation at an early stage. We use early HTA to evaluate the potential value of AI software in radiology. As a use-case, we evaluate the cost-effectiveness of AI software aiding the detection of intracranial large vessel occlusions (LVO) in stroke in comparison to standard care. We used a Markov based model from a societal perspective of the United Kingdom predominantly using stroke registry data complemented with pooled outcome data from large, randomized trials. Different scenarios were explored by varying missed diagnoses of LVOs, AI costs and AI performance. Other input parameters were varied to demonstrate model robustness. Results were reported in expected incremental costs (IC) and effects (IE) expressed in quality adjusted life years (QALYs).

Results

Applying the base case assumptions (6% missed diagnoses of LVOs by clinicians, $40 per AI analysis, 50% reduction of missed LVOs by AI), resulted in cost-savings and incremental QALYs over the projected lifetime (IC: - $156, - 0.23%; IE: + 0.01 QALYs, + 0.07%) per suspected ischemic stroke patient. For each yearly cohort of patients in the UK this translates to a total cost saving of $11 million.

Conclusions

AI tools for LVO detection in emergency care have the potential to improve healthcare outcomes and save costs. We demonstrate how early HTA may be applied for the evaluation of clinically applied AI software for radiology.

SUBMITTER: van Leeuwen KG

PROVIDER: S-EPMC8464539 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Artificial intelligence (AI) can assist dentists in image assessment, for example, caries detection. The wider health and cost impact of employing AI for dental diagnostics has not yet been evaluated. We compared the cost-effectiveness of proximal caries detection on bitewing radiographs with versus without AI. U-Net, a fully convolutional neural network, had been trained, validated, and tested on 3,293, 252, and 141 bitewing radiographs, respectively, on which 4 experienced dentists had marked carious lesions (reference test). Lesions were stratified for initial lesions (E1/E2/D1, presumed noncavitated, receiving caries infiltration if detected) and advanced lesions (D2/D3, presumed cavitated, receiving restorative care if detected). A Markov model was used to simulate the consequences of true- and false-positive and true- and false-negative detections, as well as the subsequent decisions over the lifetime of patients. A German mixed-payers perspective was adopted. Our health outcome was tooth retention years. Costs were measured in 2020 euro. Monte-Carlo microsimulations and univariate and probabilistic sensitivity analyses were conducted. The incremental cost-effectiveness ratio (ICER) and the cost-effectiveness acceptability at different willingness-to-pay thresholds were quantified. AI showed an accuracy of 0.80; dentists' mean accuracy was significantly lower at 0.71 (minimum-maximum: 0.61-0.78, P < 0.05). AI was significantly more sensitive than dentists (0.75 vs. 0.36 [0.19-0.65]; P = 0.006), while its specificity was not significantly lower (0.83 vs. 0.91 [0.69-0.98]; P > 0.05). In the base-case scenario, AI was more effective (tooth retention for a mean 64 [2.5%-97.5%: 61-65] y) and less costly (298 [244-367] euro) than assessment without AI (62 [59-64] y; 322 [257-394] euro). The ICER was -13.9 euro/y (i.e., AI saved money at higher effectiveness). In the majority (>77%) of all cases, AI was less costly and more effective. Applying AI for caries detection is likely to be cost-effective, mainly as fewer lesions remain undetected. Notably, this cost-effectiveness requires dentists to manage detected early lesions nonrestoratively.

Project description:BackgroundRecent randomized trials have suggested that endovascular thrombectomy (EVT) alone may provide similar functional outcomes as the current standard of care, EVT combined with intravenous alteplase treatment, for acute ischemic stroke secondary to large vessel occlusion. We conducted an economic evaluation of these 2 therapeutic options.MethodsWe constructed a decision analytic model with a hypothetical cohort of 1000 patients to assess the cost-effectiveness of EVT with intravenous alteplase treatment versus EVT alone for acute ischemic stroke secondary to large vessel occlusion from both the societal and public health care payer perspectives. We used studies and data published in 2009-2021 for model inputs, and acquired cost data for Canada and China, representing high- and middle-income countries, respectively. We calculated incremental cost-effectiveness ratios (ICERs) using a lifetime horizon and accounted for uncertainty using 1-way and probabilistic sensitivity analyses. All costs are reported in 2021 Canadian dollars.ResultsIn Canada, the difference in quality-adjusted life-years (QALYs) gained between EVT with alteplase and EVT alone was 0.10 from both the societal and health care payer perspectives. The difference in cost was $2847 from a societal perspective and $2767 from the payer perspective. In China, the difference in QALYs gained was 0.07 from both perspectives, and the difference in cost was $1550 from the societal perspective and $1607 from the payer perspective. One-way sensitivity analyses showed that the distributions of modified Rankin Scale scores at 90 days after stroke were the most influential factor on ICERs. For Canada, compared to EVT alone, the probability that EVT with alteplase would be cost-effective at a willingness-to-pay threshold of $50 000 per QALY gained was 58.7% from a societal perspective and 58.4% from a payer perspective. The corresponding values for at a willingness-to-pay threshold of $47 185 (3 times the Chinese gross domestic product per capita in 2021) were 65.2% and 67.4%.InterpretationFor patients with acute ischemic stroke due to large vessel occlusion eligible for immediate treatment with both EVT alone and EVT with intravenous alteplase treatment, it is uncertain whether EVT with alteplase is cost-effective compared to EVT alone in Canada and China.