Dataset Information

Inter- and intra-reader agreement for gadoxetic acid-enhanced MRI parameter readings in patients with chronic liver diseases.

ABSTRACT:

Objectives

To examine inter- and intra-observer agreement for four simple hepatobiliary phase (HBP)-based scores on gadoxetic acid (GA)-enhanced MRI and their correlation with liver function in patients with mixed chronic liver disease (CLD).

Methods

This single-center, retrospective study included 287 patients (62% male, 38% female, mean age 53.5 ± 13.7 years) with mixed CLD (20.9% hepatitis C, 19.2% alcoholic liver disease, 8% hepatitis B) who underwent GA-enhanced MRI of the liver for clinical care between 2010 and 2015. Relative liver enhancement (RLE), contrast uptake index (CUI), hepatic uptake index (HUI), and liver-to-spleen contrast index (LSI) were calculated by two radiologists independently using unenhanced and GA-enhanced HPB (obtained 20 min after GA administration) images; 50 patients selected at random were reviewed twice by one reader to assess intra-observer reliability. Agreement was assessed by intraclass correlation coefficient (ICC). The albumin-bilirubin (ALBI) score, the model of end-stage liver disease (MELD), and the Child-Turcotte-Pugh (CTP) score were calculated as standards of reference for hepatic function.

Results

Intra-observer ICCs ranged from 0.814 (0.668-0.896) for CUI to 0.969 (0.945-0.983) for RLE. Inter-observer ICCs ranged from 0.777 (0.605-0.874) for HUI to 0.979 (0.963-0.988) for RLE. All HBP-based scores correlated significantly (all p < 0.001) with the ALBI, MELD, and CTP scores and were able to discriminate patients with a MELD score ≥ 15 versus ≤ 14, with area under the curve values ranging from 0.760 for RLE to 0.782 for HUI.

Conclusion

GA-enhanced, MRI-derived, HBP-based parameters showed excellent inter- and intra-observer agreement. All HBP-based parameters correlated with clinical and laboratory scores of hepatic dysfunction, with no significant differences between each other.

Key points

• Radiological parameters that quantify the hepatic uptake of gadoxetic acid are highly reproducible. • These parameters can be used interchangeably because they correlate with each other and with scores of hepatic dysfunction. • Assessment of these parameters may be helpful in monitoring disease progression.

SUBMITTER: Beer L

PROVIDER: S-EPMC6828941 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesThe Prostate Imaging Quality (PI-QUAL) score assesses the quality of multiparametric MRI (mpMRI). A score of 1 means all sequences are below the minimum standard of diagnostic quality, 3 implies that the scan is of sufficient diagnostic quality, and 5 means that all three sequences are of optimal diagnostic quality. We investigated the inter-reader reproducibility of the PI-QUAL score in patients enrolled in the NeuroSAFE PROOF trial.MethodsWe analysed the scans of 103 patients on different MR systems and vendors from 12 different hospitals. Two dedicated radiologists highly experienced in prostate mpMRI independently assessed the PI-QUAL score for each scan. Interobserver agreement was assessed using Cohen's kappa with standard quadratic weighting (κw) and percent agreement.ResultsThe agreement for each single PI-QUAL score was strong (κw = 0.85 and percent agreement = 84%). A similar agreement (κw = 0.82 and percent agreement = 84%) was observed when the scans were clustered into three groups (PI-QUAL 1-2 vs PI-QUAL 3 vs PI-QUAL 4-5). The agreement in terms of diagnostic quality for each single sequence was highest for T2-weighted imaging (92/103 scans; 89%), followed by dynamic contrast-enhanced sequences (91/103; 88%) and diffusion-weighted imaging (80/103; 78%).ConclusionWe observed strong reproducibility in the assessment of PI-QUAL between two radiologists with high expertise in prostate mpMRI. At present, PI-QUAL offers clinicians the only available tool for evaluating and reporting the quality of prostate mpMRI in a systematic manner but further refinements of this scoring system are warranted.Key points• Inter-reader agreement for each single Prostate Imaging Quality (PI-QUAL) score (i.e., PI-QUAL 1 to PI-QUAL 5) was strong, with weighted kappa = 0.85 (95% confidence intervals: 0.51 - 1) and percent agreement = 84%. • Interobserver agreement was strong when the scans were clustered into three groups according to the ability (or not) to rule in and to rule out clinically significant prostate cancer (i.e., PI-QUAL 1-2 vs PI-QUAL 3 vs PI-QUAL 4-5), with weighted kappa = 0.82 (95% confidence intervals: 0.68 - 0.96) and percent agreement = 84%. • T2-weighted acquisitions were the most compliant with the Prostate Imaging Reporting and Data System (PI-RADS) v. 2.0 technical recommendations and were the sequences of highest diagnostic quality for both readers in 95/103 (92%) scans, followed by dynamic contrast enhanced acquisition with 81/103 (79%) scans and lastly by diffusion-weighted imaging with 79/103 (77%) scans.

Project description:BACKGROUND: The Back Pain Cohort of Southern Denmark (BaPa Cohort) was initiated with the aim of evaluating the clinical relevance of magnetic resonance imaging (MRI) in the diagnosis of early spondyloarthritis (SpA). In order to facilitate the collection of MRI data for this study, an electronic evaluation form was developed including both SpA-related and degenerative axial changes. The objective of the current study was to assess the intra- and inter-observer agreement of the MRI changes assessed. METHODS: Three radiologists evaluated 48 MRI scans of the whole spine and the sacroiliac joints from a subsample of the BaPa Cohort, consisting of patients with non-specific low back pain and patients with different stages of SpA features. The spine was evaluated for SpA-related and degenerative MRI changes and the SIJ for SpA-related changes. Inter- and intra-observer agreements were calculated with kappa statistics. In the interpretation of the kappa coefficient, the standards for strength of agreement reported by Landis and Koch were followed. RESULTS: A total of 48 patients, 40% men and mean age of 31 years (range 18-40 years), were evaluated once by all three readers and re-evaluated by two of the readers after 4-12 weeks. For MRI changes in the spine, substantial to almost perfect observer agreement was found for the location and the size of vertebral signal changes and for disc degeneration and disc contour. For the sacroiliac joints, substantial or almost perfect observer agreement was found for the grading of bone marrow oedema and fatty marrow deposition, the depth of bone marrow oedema and for subchondral sclerosis. Global assessment of the SpA diagnosis had substantial to almost perfect observer agreements. CONCLUSION: The acceptable agreement for key MRI changes in the spine and sacroiliac joints makes it possible to use these MRI changes in the BaPa Cohort study and other studies investigating MRI changes in patients with non-specific low back pain and suspected SpA.

Project description:BackgroundSeveral criteria have been used to assess agreement between replicate slide readings of malaria parasite density. Such criteria may be based on percent difference, or absolute difference, or a combination. Neither the rationale for choosing between these types of criteria, nor that for choosing the magnitude of difference which defines acceptable agreement, are clear. The current paper seeks a procedure which avoids the disadvantages of these current options and whose parameter values are more clearly justified.Methods and resultsVariation of parasite density within a slide is expected, even when it has been prepared from a homogeneous sample. This places lower limits on sensitivity and observer agreement, quantified by the Poisson distribution. This means that, if a criterion of fixed percent difference criterion is used for satisfactory agreement, the number of discrepant readings is over-estimated at low parasite densities. With a criterion of fixed absolute difference, the same happens at high parasite densities. For an ideal slide, following the Poisson distribution, a criterion based on a constant difference in square root counts would apply for all densities. This can be back-transformed to a difference in absolute counts, which, as expected, gives a wider range of acceptable agreement at higher average densities. In an example dataset from Tanzania, observed differences in square root counts correspond to a 95% limits of agreement of -2,800 and +2,500 parasites/microl at average density of 2,000 parasites/microl, and -6,200 and +5,700 parasites/microl at 10,000 parasites/microl. However, there were more outliers beyond those ranges at higher densities, meaning that actual coverage of these ranges was not a constant 95%, but decreased with density. In a second study, a trial of microscopist training, the corresponding ranges of agreement are wider and asymmetrical: -8,600 to +5,200/microl, and -19,200 to +11,700/microl, respectively. By comparison, the optimal limits of agreement, corresponding to Poisson variation, are +/- 780 and +/- 1,800 parasites/microl, respectively. The focus of this approach on the volume of blood read leads to other conclusions. For example, no matter how large a volume of blood is read, some densities are too low to be reliably detected, which in turn means that disagreements on slide positivity may simply result from within-slide variation, rather than reading errors.ConclusionsThe proposed method defines limits of acceptable agreement in a way which allows for the natural increase in variability with parasite density. This includes defining the levels of between-reader variability, which are consistent with random variation: disagreements within these limits should not trigger additional readings. This approach merits investigation in other settings, in order to determine both the extent of its applicability, and appropriate numerical values for limits of agreement.

Project description:Background and objectiveFocal therapy (FT) is increasingly recognized as a promising approach for managing localized prostate cancer (PCa), notably reducing treatment-related morbidities. However, post-treatment anatomical changes present significant challenges for surveillance using current imaging techniques. This study aimed to evaluate the inter-reader agreement and efficacy of the Prostate Imaging after Focal Ablation (PI-FAB) scoring system in detecting clinically significant prostate cancer (csPCa) on post-FT multiparametric magnetic resonance imaging (mpMRI).MethodsA retrospective cohort study was conducted involving patients who underwent primary FT for localized csPCa between 2013 and 2023, followed by post-FT mpMRI and a prostate biopsy. Two expert genitourinary radiologists retrospectively evaluated post-FT mpMRI using PI-FAB. The key measures included inter-reader agreement of PI-FAB scores, assessed by quadratic weighted Cohen's kappa (κ), and the system's efficacy in predicting in-field recurrence of csPCa, with a PI-FAB score cutoff of 3. Additional diagnostic metrics including sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and overall accuracy were also evaluated.Key findings and limitationsScans from 38 patients were analyzed, revealing a moderate level of agreement in PI-FAB scoring (κ = 0.56). Both radiologists achieved sensitivity of 93% in detecting csPCa, although specificity, PPVs, NPVs, and accuracy varied.Conclusions and clinical implicationsThe PI-FAB scoring system exhibited high sensitivity with moderate inter-reader agreement in detecting in-field recurrence of csPCa. Despite promising results, its low specificity and PPV necessitate further refinement. These findings underscore the need for larger studies to validate the clinical utility of PI-FAB, potentially aiding in standardizing post-treatment surveillance.Patient summaryFocal therapy has emerged as a promising approach for managing localized prostate cancer, but limitations in current imaging techniques present significant challenges for post-treatment surveillance. The Prostate Imaging after Focal Ablation (PI-FAB) scoring system showed high sensitivity for detecting in-field recurrence of clinically significant prostate cancer. However, its low specificity and positive predictive value necessitate further refinement. Larger, more comprehensive studies are needed to fully validate its clinical utility.

Project description:BACKGROUND:Consistency of results between different readers is an important issue in medical imaging, as it affects portability of results between institutions and may affect patient care. The International Atomic Energy Agency (IAEA) in pursuing its mission of fostering peaceful applications of nuclear technologies has supported several training activities in the field of nuclear cardiology (NC) and SPECT myocardial perfusion imaging (MPI) in particular. The aim of this study was to verify the outcome of those activities through an international clinical audit on MPI where participants were requested to report on studies distributed from a core lab. METHODS:The study was run in two phases: in phase 1, SPECT MPI studies were distributed as raw data and full processing was requested as per local practice. In phase 2, images from studies pre-processed at the core lab were distributed. Data to be reported included summed stress score (SSS); summed rest score (SRS); summed difference score (SDS); left ventricular (LV) ejection fraction (EF) and end- diastolic volume (EDV). Qualitative appraisals included the assessment of perfusion and presence of ischemia, scar or mixed patterns, presence of transient ischemic dilation (TID), and risk for cardiac events (CE). Twenty-four previous trainees from low- and middle-income countries participated (core participants group) and their results were assessed for inter-observer variability in each of the two phases, and for changes between phases. The same evaluations were performed for a group of eleven international experts (experts group). Results were also compared between the groups. RESULTS:Expert readers showed an excellent level of agreement for all parameters in both phase 1 and 2. For core participants, the concordance of all parameters in phase 1 was rated as good to excellent. Two parameters which were re-evaluated in phase 2, namely SSS and SRS, showed an increased level of concordance, up to excellent in both cases. Reporting of categorical variables by expert readers remained almost unchanged between the two phases, while core participants showed an increase in phase 2. Finally, pooled LVEF values did not show a significant difference between core participants and experts. However, significant differences were found between LVEF values obtained using different software packages for cardiac analysis. CONCLUSIONS:In this study, inter-observer agreement was moderate-to-good for core group readers and good-to-excellent for expert readers. The quality of reporting is affected by the quality of processing. These results confirm the important role of the IAEA training activities in improving imaging in low- and middle-income countries.