Dataset Information

Inter-reader variability of SPECT MPI readings in low- and middle-income countries: Results from the IAEA-MPI Audit Project (I-MAP).

ABSTRACT: BACKGROUND:Consistency of results between different readers is an important issue in medical imaging, as it affects portability of results between institutions and may affect patient care. The International Atomic Energy Agency (IAEA) in pursuing its mission of fostering peaceful applications of nuclear technologies has supported several training activities in the field of nuclear cardiology (NC) and SPECT myocardial perfusion imaging (MPI) in particular. The aim of this study was to verify the outcome of those activities through an international clinical audit on MPI where participants were requested to report on studies distributed from a core lab. METHODS:The study was run in two phases: in phase 1, SPECT MPI studies were distributed as raw data and full processing was requested as per local practice. In phase 2, images from studies pre-processed at the core lab were distributed. Data to be reported included summed stress score (SSS); summed rest score (SRS); summed difference score (SDS); left ventricular (LV) ejection fraction (EF) and end- diastolic volume (EDV). Qualitative appraisals included the assessment of perfusion and presence of ischemia, scar or mixed patterns, presence of transient ischemic dilation (TID), and risk for cardiac events (CE). Twenty-four previous trainees from low- and middle-income countries participated (core participants group) and their results were assessed for inter-observer variability in each of the two phases, and for changes between phases. The same evaluations were performed for a group of eleven international experts (experts group). Results were also compared between the groups. RESULTS:Expert readers showed an excellent level of agreement for all parameters in both phase 1 and 2. For core participants, the concordance of all parameters in phase 1 was rated as good to excellent. Two parameters which were re-evaluated in phase 2, namely SSS and SRS, showed an increased level of concordance, up to excellent in both cases. Reporting of categorical variables by expert readers remained almost unchanged between the two phases, while core participants showed an increase in phase 2. Finally, pooled LVEF values did not show a significant difference between core participants and experts. However, significant differences were found between LVEF values obtained using different software packages for cardiac analysis. CONCLUSIONS:In this study, inter-observer agreement was moderate-to-good for core group readers and good-to-excellent for expert readers. The quality of reporting is affected by the quality of processing. These results confirm the important role of the IAEA training activities in improving imaging in low- and middle-income countries.

SUBMITTER: Dondi M

PROVIDER: S-EPMC7174263 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Inter-reader variability of SPECT MPI readings in low- and middle-income countries: Results from the IAEA-MPI Audit Project (I-MAP).

Dondi Maurizio M Rodella Carlo C Giubbini Raffaele R Camoni Luca L Karthikeyan Ganesan G Vitola Joao V JV Einstein Andrew J AJ Arends Bertjan J BJ Morozova Olga O Pascual Thomas N TN Paez Diana D

Journal of nuclear cardiology : official publication of the American Society of Nuclear Cardiology 20180830 2

<h4>Background</h4>Consistency of results between different readers is an important issue in medical imaging, as it affects portability of results between institutions and may affect patient care. The International Atomic Energy Agency (IAEA) in pursuing its mission of fostering peaceful applications of nuclear technologies has supported several training activities in the field of nuclear cardiology (NC) and SPECT myocardial perfusion imaging (MPI) in particular. The aim of this study was to ver ...[more]

PMID: 30168029

Similar Datasets

Project description:ObjectivesTo examine inter- and intra-observer agreement for four simple hepatobiliary phase (HBP)-based scores on gadoxetic acid (GA)-enhanced MRI and their correlation with liver function in patients with mixed chronic liver disease (CLD).MethodsThis single-center, retrospective study included 287 patients (62% male, 38% female, mean age 53.5 ± 13.7 years) with mixed CLD (20.9% hepatitis C, 19.2% alcoholic liver disease, 8% hepatitis B) who underwent GA-enhanced MRI of the liver for clinical care between 2010 and 2015. Relative liver enhancement (RLE), contrast uptake index (CUI), hepatic uptake index (HUI), and liver-to-spleen contrast index (LSI) were calculated by two radiologists independently using unenhanced and GA-enhanced HPB (obtained 20 min after GA administration) images; 50 patients selected at random were reviewed twice by one reader to assess intra-observer reliability. Agreement was assessed by intraclass correlation coefficient (ICC). The albumin-bilirubin (ALBI) score, the model of end-stage liver disease (MELD), and the Child-Turcotte-Pugh (CTP) score were calculated as standards of reference for hepatic function.ResultsIntra-observer ICCs ranged from 0.814 (0.668-0.896) for CUI to 0.969 (0.945-0.983) for RLE. Inter-observer ICCs ranged from 0.777 (0.605-0.874) for HUI to 0.979 (0.963-0.988) for RLE. All HBP-based scores correlated significantly (all p < 0.001) with the ALBI, MELD, and CTP scores and were able to discriminate patients with a MELD score ≥ 15 versus ≤ 14, with area under the curve values ranging from 0.760 for RLE to 0.782 for HUI.ConclusionGA-enhanced, MRI-derived, HBP-based parameters showed excellent inter- and intra-observer agreement. All HBP-based parameters correlated with clinical and laboratory scores of hepatic dysfunction, with no significant differences between each other.Key points• Radiological parameters that quantify the hepatic uptake of gadoxetic acid are highly reproducible. • These parameters can be used interchangeably because they correlate with each other and with scores of hepatic dysfunction. • Assessment of these parameters may be helpful in monitoring disease progression.

Project description:ObjectivesThis study compared the clinical effectiveness of pharmacologic stress myocardial perfusion imaging (MPI) plus positron emission tomography (PET) with single-photon emission computed tomography (SPECT) in patients with known coronary artery disease (CAD) presenting with symptoms suggestive of ischemia.BackgroundAlthough PET MPI has been shown to have higher diagnostic accuracy in detecting hemodynamically significant CAD than SPECT MPI, whether this impacts downstream management has not been formally evaluated in randomized trials.MethodsThis study consisted of a single-center trial in which patients with known CAD and suspected ischemia were randomized to undergo PET or attenuation-corrected SPECT MPI between June 2009 and September 2013. Post-test management was at the discretion of the referring physician, and patients were followed for 12 months. The primary endpoint was diagnostic failure, defined as unnecessary angiography (absence of ≥50% stenosis in ≥1 vessel) or additional noninvasive testing within 60 days of the MPI. Secondary endpoints were post-test escalation of antianginal therapy, referral for angiography, coronary revascularization, and health status at 3, 6, and 12 months.ResultsA total of 322 patients with an evaluable MPI were randomized (n = 161 in each group). At baseline, 88.8% of patients were receiving aspirin therapy, 76.7% were taking beta-blockers, and 77.3% were taking statin therapy. Diagnostic failure within 60 days occurred in only 7 patients (2.2%) (3 [1.9%] in the PET group and 4 [2.5%] in the SPECT group; p = 0.70). There were no significant differences between the 2 groups in subsequent rates of coronary angiography, coronary revascularization, or health status at 3, 6, and 12 months of follow-up (all p values ≥0.20); however, when subjects were stratified by findings on MPI in a post hoc analysis, those with high-risk MPI on PET testing had higher rates of angiography and revascularization on follow-up than those who had SPECT MPI, whereas those undergoing low-risk PET studies had lower rates of both procedures than those undergoing SPECT (interaction between randomized modality ∗high-risk MPI for 12-month catheterization [p = 0.001] and 12-month revascularization [p = 0.09]).ConclusionsIn this contemporary cohort of symptomatic CAD patients who were optimally medically managed, there were no discernible differences in rates of diagnostic failure at 60 days, subsequent coronary angiography, revascularization, or patient health status at 1 year between patients evaluated by pharmacologic PET compared with those evaluated by SPECT MPI. Downstream invasive testing rates with PET MPI were more consistent with high-risk features than those with SPECT MPI. (Effectiveness Study of Single Photon Emission Computed Tomography [SPECT] Versus Positron Emission Tomography [PET] Myocardial Perfusion Imaging; NCT00976053).

Project description:ObjectivesThis study compared the ability of automated myocardial perfusion imaging analysis to predict major adverse cardiac events (MACE) to that of visual analysis.BackgroundQuantitative analysis has not been compared with clinical visual analysis in prognostic studies.MethodsA total of 19,495 patients from the multicenter REFINE SPECT (REgistry of Fast Myocardial Perfusion Imaging with NExt generation SPECT) study (64 ± 12 years of age, 56% males) undergoing stress Tc-99m-labeled single-photon emission computed tomography (SPECT) myocardial perfusion imaging were followed for 4.5 ± 1.7 years for MACE. Perfusion abnormalities were assessed visually and categorized as normal, probably normal, equivocal, or abnormal. Stress total perfusion deficit (TPD), quantified automatically, was categorized as TPD = 0%, TPD >0% to <1%, ≤1% to <3%, ≤3% to <5%, ≤5% to ≤10%, or TPD >10%. MACE consisted of death, nonfatal myocardial infarction, unstable angina, or late revascularization (>90 days). Kaplan-Meier and Cox proportional hazards analyses were performed to test the performance of visual and quantitative assessments in predicting MACE.ResultsDuring follow-up examinations, 2,760 (14.2%) MACE occurred. MACE rates increased with worsening of visual assessments, that is, the rate for normal MACE was 2.0%, 3.2% for probably normal, 4.2% for equivocal, and 7.4% for abnormal (all p < 0.001). MACE rates increased with increasing stress TPD from 1.3% for the TPD category of 0% to 7.8% for the TPD category of >10% (p < 0.0001). The adjusted hazard ratio (HR) for MACE increased even in equivocal assessment (HR: 1.56; 95% confidence interval [CI]: 1.37 to 1.78) and in the TPD category of ≤3% to <5% (HR: 1.74; 95% CI: 1.41 to 2.14; all p < 0.001). The rate of MACE in patients visually assessed as normal still increased from 1.3% (TPD = 0%) to 3.4% (TPD ≥5%) (p < 0.0001).ConclusionsQuantitative analysis allows precise granular risk stratification in comparison to visual reading, even for cases with normal clinical reading.

Project description:UnlabelledThe International Atomic Energy Agency (IAEA) has a long tradition of supporting development of methodologies for national networks providing quality audits in radiotherapy. A series of co-ordinated research projects (CRPs) has been conducted by the IAEA since 1995 assisting national external audit groups developing national audit programs. The CRP 'Development of Quality Audits for Radiotherapy Dosimetry for Complex Treatment Techniques' was conducted in 2009-2012 as an extension of previously developed audit programs.Material and methodsThe CRP work described in this paper focused on developing and testing two steps of dosimetry audit: verification of heterogeneity corrections, and treatment planning system (TPS) modeling of small MLC fields, which are important for the initial stages of complex radiation treatments, such as IMRT. The project involved development of a new solid slab phantom with heterogeneities containing special measurement inserts for thermoluminescent dosimeters (TLD) and radiochromic films. The phantom and the audit methodology has been developed at the IAEA and tested in multi-center studies involving the CRP participants.ResultsThe results of multi-center testing of methodology for two steps of dosimetry audit show that the design of audit procedures is adequate and the methodology is feasible for meeting the audit objectives. A total of 97% TLD results in heterogeneity situations obtained in the study were within 3% and all results within 5% agreement with the TPS predicted doses. In contrast, only 64% small beam profiles were within 3?mm agreement between the TPS calculated and film measured doses. Film dosimetry results have highlighted some limitations in TPS modeling of small beam profiles in the direction of MLC leave movements.DiscussionThrough multi-center testing, any challenges or difficulties in the proposed audit methodology were identified, and the methodology improved. Using the experience of these studies, the participants could incorporate the auditing procedures in their national programs.

Dataset Information

Inter-reader variability of SPECT MPI readings in low- and middle-income countries: Results from the IAEA-MPI Audit Project (I-MAP).

Publications

Inter-reader variability of SPECT MPI readings in low- and middle-income countries: Results from the IAEA-MPI Audit Project (I-MAP).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets