Dataset Information

Real-World Comparison of Human and Software Image Assessment in Acute Ischemic Stroke Patients' Qualification for Reperfusion Treatment.

ABSTRACT: Our aim was to compare human and computer accuracy in reading medical images of acute stroke patients. We analyzed data of patients who underwent assessment of Alberta Stroke Program Early CT Score (ASPECTS) and CT Perfusion (CTP) via Rapid Processing of Perfusion and Diffusion (RAPID) software RAPID ASPECTS, and RAPID CTP), compared to radiologist reports and manual measurements. We compared volumes calculated by RAPID CTP software with those selected by scanner-equipped software (GE). For reference, follow-up images were manually assessed in accordance with the Alberta Stroke Program Early CT Score (ASPECTS) territories retrospectively. Although exact ASPECTS score agreement between the automatic and manual methods, and between each method and follow-up, was poor, crossing of the threshold for reperfusion therapy was characterized by an 80% match. CT perfusion analyses yielded only slight agreement (kappa = 0.193) in the qualification of patients for therapy. Either automatic or manual scoring methods of non-contrast images imply similar clinical decisions in real-world circumstances. However, volume measurements performed by fully automatic and manually assisted systems are not comparable. Thresholds devised and validated for computer algorithms are not compatible with measurements performed manually using other software and should not be applied to setups other than those with which they were developed.

SUBMITTER: Lasocha B

PROVIDER: S-EPMC7690255 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Real-World Comparison of Human and Software Image Assessment in Acute Ischemic Stroke Patients' Qualification for Reperfusion Treatment.

Lasocha Bartlomiej B Pulyk Roman R Brzegowy Pawel P Latacz Pawel P Slowik Agnieszka A Popiela Tadeusz J TJ

Journal of clinical medicine 20201022 11

Our aim was to compare human and computer accuracy in reading medical images of acute stroke patients. We analyzed data of patients who underwent assessment of Alberta Stroke Program Early CT Score (ASPECTS) and CT Perfusion (CTP) via Rapid Processing of Perfusion and Diffusion (RAPID) software RAPID ASPECTS, and RAPID CTP), compared to radiologist reports and manual measurements. We compared volumes calculated by RAPID CTP software with those selected by scanner-equipped software (GE). For refe ...[more]

PMID: 33105544

Similar Datasets

Project description:Purpose: Automated postprocessing packages have been developed for managing acute ischemic stroke (AIS). These packages identify ischemic core and penumbra using either computed tomographic perfusion imaging (CTP) data or magnetic resonance imaging (MRI) data. Measurements of abnormal tissues and treatment decisions derived from different vendors can vary. The purpose of this study is to investigate the agreement of volumetric and decision-making outcomes derived from two software packages. Methods: A total of 594 AIS patients (174 underwent CTP and 420 underwent MRI) were included. Imaging data were accordingly postprocessed by two software packages: RAPID and RealNow. Volumetric outputs were compared between packages by performing intraclass correlation coefficient (ICC), Wilcoxon paired test and Bland–Altman analysis. Concordance of selecting patients eligible for mechanical thrombectomy (MT) was assessed based on neuroimaging criteria proposed in DEFUSE3. Results: In the group with CTP data, mean ischemic core volume (ICV)/penumbral volume (PV) was 14.9/81.1 mL via RAPID and 12.6/83.2 mL via RealNow. Meanwhile, in the MRI group, mean ICV/PV were 52.4/68.4 mL and 48.9/61.6 mL via RAPID and RealNow, respectively. Reliability, which was measured by ICC of ICV and PV in CTP and MRI groups, ranged from 0.87 to 0.99. The bias remained small between measurements (CTP ICV: 0.89 mL, CTP PV: −2 mL, MRI ICV: 3.5 mL and MRI PV: 6.8 mL). In comparison with CTP ICV with follow-up DWI, the ICC was 0.92 and 0.94 for RAPID and Realnow, respectively. The bias remained small between CTP ICV and follow-up DWI measurements (Rapid: −4.65 mL, RealNow: −3.65 mL). Wilcoxon paired test showed no significant difference between measurements. The results of patient triage were concordant in 159/174 cases (91%, ICC: 0.90) for CTP and 400/420 cases (95%, ICC: 0.93) for MRI. Conclusion: The CTP ICV derived from RealNow was more accurate than RAPID. The similarity in volumetric measurement between packages did not necessarily relate to equivalent patient triage. In this study, RealNow showed excellent agreement with RAPID in measuring ICV and PV as well as patient triage.

Project description:BackgroundEndovascular thrombectomy (EVT) has been proven effective in anterior circulation stroke due to large vessel occlusion (LVO). However, translation from randomized clinical trials (RCTs) with highly selected patients to real-world requires confirmation, particularly to identify associations outside of strict selection criteria.AimsThis study aims to compare functional outcomes after EVT in real-world with those reported in RCTs, and to identify associations with functional outcome after EVT outside RCT-criteria.MethodsThis study analyzed longitudinal German real-world data from the Stroke Research Consortium in Northern Bavaria (STAMINA) cohort from January, 2015 to June, 2019. We conducted a trial emulation, comparing patients with anterior circulation stroke and LVO meeting selection criteria for RCTs investigating EVT (1) predominantly within 6 hours with those from HERMES meta-analysis, and (2) within 6-24 hours with those from AURORA meta-analysis. We (3) analyzed treatment effects of EVT and association with functional outcome in patients treated outside RCT criteria.ResultsOf 598 patients, 281 (47.0%) met RCT-criteria for treatment within 6 hours (hereinafter STAMINA-HERMES), 74 (12.4%) met RCT-criteria for treatment within 6-24 hours (STAMINA-AURORA), and 277 (46.3%) patients received EVT outside RCT-criteria. We observed no difference in rates of functional independence or mortality, comparing STAMINA-HERMES with HERMES meta-analysis (mRS 0-1: n=120/281 [43%] vs. 291/633 [46%], p=0.36; mortality: n=34/281 [12%] vs. 97/633 [15%], p=0.20), and STAMINA-AURORA with AURORA meta-analysis (mRS 0-1: n=26/74 [35%] vs. 122/266 [46%], p=0.10, mortality: n=10/74 [14%] vs. 45/266 [17%], p=0.48). Patients treated outside RCT-criteria had worse outcome (mRS 0-1: n=38/277 [14%], mortality: n=90/277 [32%], both p<0.001); possibly driven by pre-existing functional dependence (n=172/277 [62%]). Compared to matched controls, EVT outside of RCT-criteria was associated with lower mortality (absolute treatment effect: -14%, 95% Confidence Interval [CI] -23 to -5, p<0.01), but not with recovery to functional independence or premorbid functional status (treatment effect: 4%, CI -4 to 11, p=0.34), which was associated with lower NIHSS (Odds ratio [OR] 0.86, CI 0.80-0.92, p<0.001) and age (OR 0.95, CI 0.93-0.98, p=0.002).ConclusionsTranslation of EVT outcomes reported in RCTs into real-world is possible, however, almost half of patients did not meet trial criteria. Identification of patients who functionally benefit from frequently performed EVT outside RCT-criteria requires further investigation.Trial registrationClinicaltrials.gov, NCT04357899.

Dataset Information

Real-World Comparison of Human and Software Image Assessment in Acute Ischemic Stroke Patients' Qualification for Reperfusion Treatment.

Publications

Real-World Comparison of Human and Software Image Assessment in Acute Ischemic Stroke Patients' Qualification for Reperfusion Treatment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets