Dataset Information

Superior reproducibility and repeatability in automated quantitative pupillometry compared to standard manual assessment, and quantitative pupillary response parameters present high reliability in critically ill cardiac patients.

ABSTRACT:

Background

Quantitative pupillometry is part of multimodal neuroprognostication of comatose patients after out-of-hospital cardiac arrest (OHCA). However, the reproducibility, repeatability, and reliability of quantitative pupillometry in this setting have not been investigated.

Methods

In a prospective blinded validation study, we compared manual and quantitative measurements of pupil size. Observer and device variability for all available parameters are expressed as mean difference (bias), limits of agreement (LoA), and reliability expressed as intraclass correlation coefficients (ICC) with a 95% confidence interval.

Results

Fifty-six unique quadrupled sets of measurement derived from 14 sedated and comatose patients (mean age 70±12 years) were included. For manually measured pupil size, inter-observer bias was -0.14±0.44 mm, LoA of -1.00 to 0.71 mm, and ICC at 0.92 (0.86-0.95). For quantitative pupillometry, we found bias at 0.03±0.17 mm, LoA of -0.31 to 0.36 mm and ICCs at 0.99. Quantitative pupillometry also yielded lower bias and LoA and higher ICC for intra-observer and inter-device measurements. Correlation between manual and automated pupillometry was better in larger pupils, and quantitative pupillometry had less variability and higher ICC, when assessing small pupils. Further, observers failed to detect 26% of the quantitatively estimated abnormal reactivity with manual assessment. We found ICC >0.91 for all quantitative pupillary response parameters (except for latency with ICC 0.81-0.91).

Conclusion

Automated quantitative pupillometry has excellent reliability and twice the reproducibility and repeatability than manual pupillometry. This study further presents novel estimates of variability for all quantitative pupillary response parameters with excellent reliability.

SUBMITTER: Nyholm B

PROVIDER: S-EPMC9333219 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMagnetic resonance cholangiopancreatography (MRCP) is an important tool for noninvasive imaging of biliary disease, however, its assessment is currently subjective, resulting in the need for objective biomarkers.PurposeTo investigate the accuracy, scan/rescan repeatability, and cross-scanner reproducibility of a novel quantitative MRCP tool on phantoms and in vivo. Additionally, to report normative ranges derived from the healthy cohort for duct measurements and tree-level summary metrics.Study typeProspective.Phantoms/subjectsPhantoms: two bespoke designs, one with varying tube-width, curvature, and orientation, and one exhibiting a complex structure based on a real biliary tree. Subjects Twenty healthy volunteers, 10 patients with biliary disease, and 10 with nonbiliary liver disease.Sequence/field strengthMRCP data were acquired using heavily T2 -weighted 3D multishot fast/turbo spin echo acquisitions at 1.5T and 3T.AssessmentDigital instances of the phantoms were synthesized with varying resolution and signal-to-noise ratio. Physical 3D-printed phantoms were scanned across six scanners (two field strengths for each of three manufacturers). Human subjects were imaged on four scanners (two fieldstrengths for each of two manufacturers).Statistical testsBland-Altman analysis and repeatability coefficient (RC).ResultsAccuracy of the diameter measurement approximated the scanning resolution, with 95% limits of agreement (LoA) from -1.1 to 1.0 mm. Excellent phantom repeatability was observed, with LoA from -0.4 to 0.4 mm. Good reproducibility was observed across the six scanners for both phantoms, with a range of LoA from -1.1 to 0.5 mm. Inter- and intraobserver agreement was high. Quantitative MRCP detected strictures and dilatations in the phantom with 76.6% and 85.9% sensitivity and 100% specificity in both. Patients and healthy volunteers exhibited significant differences in metrics including common bile duct (CBD) maximum diameter (7.6 mm vs. 5.2 mm P = 0.002), and overall biliary tree volume 12.36 mL vs. 4.61 mL, P = 0.0026).Data conclusionThe results indicate that quantitative MRCP provides accurate, repeatable, and reproducible measurements capable of objectively assessing cholangiopathic change. Evidence Level: 1 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2020;52:807-820.

Project description:The aim of this study is to investigate the inter and intra-rater reliability, repeatability, and reproducibility of pulmonary transit time (PTT) measurement in patients using contrast enhanced ultrasound (CEUS), as an indirect measure of preload and left ventricular function.Mean transit times (MTT) were measured by drawing a region of interest (ROI) in right and left cardiac ventricle in the CEUS loops. Acoustic intensity dilution curves were obtained from the ROIs. MTTs were calculated by applying model-based fitting on the dilution curves. PTT was calculated as the difference of the MTTs. Eight raters with different levels of experience measured the PTT (time moment 1) and repeated the measurement within a week (time moment 2). Reliability and agreement were assessed using intra-class correlations (ICC) and Bland-Altman analysis. Repeatability was tested by estimating the variance of means (ANOVA) of three injections in each patient at different doses. Reproducibility was tested by the ICC of the two time moments.Fifteen patients with heart failure were included. The mean PTT was 11.8 ± 3.1 s at time moment 1 and 11.7 ± 2.9 s at time moment 2. The inter-rater reliability for PTT was excellent (ICC = 0.94). The intra-rater reliability per rater was between 0.81-0.99. Bland-Altman analysis revealed a bias of 0.10 s within the rater groups. Reproducibility for PTT showed an ICC = 0.94 between the two time moments. ANOVA showed no significant difference between the means of the three different doses F = 0.048 (P = 0.95). The mean and standard deviation for PTT estimates at three different doses was 11.6 ± 3.3 s.PTT estimation using CEUS shows a high inter- and intra-rater reliability, repeatability at three different doses, and reproducibility by ROI drawing. This makes the minimally invasive PTT measurement using contrast echocardiography ready for clinical evaluation in patients with heart failure and for preload estimation.

Project description:BACKGROUND:Quantitative diffusion-weighted MRI (DW-MRI) and dynamic contrast-enhanced MRI (DCE-MRI) have the potential to impact patient care by providing noninvasive biological information in breast cancer. PURPOSE/HYPOTHESIS:To quantify the repeatability, reproducibility, and accuracy of apparent diffusion coefficient (ADC) and T1 -mapping of the breast in community radiology practices. STUDY TYPE:Prospective. SUBJECTS/PHANTOM:Ice-water DW-MRI and T1 gel phantoms were used to assess accuracy. Normal subjects (n?=?3) and phantoms across three sites (one academic, two community) were used to assess reproducibility. Test-retest analysis at one site in normal subjects (n?=?12) was used to assess repeatability. FIELD STRENGTH/SEQUENCE:3T Siemens Skyra MRI quantitative DW-MRI and T1 -mapping. ASSESSMENT:Quantitative DW-MRI and T1 -mapping parametric maps of phantoms and fibroglandular and adipose tissue of the breast. STATISTICAL TESTS:Average values of breast tissue were quantified and Bland-Altman analysis was performed to assess the repeatability of the MRI techniques, while the Friedman test assessed reproducibility. RESULTS:ADC measurements were reproducible across sites, with an average difference of 1.6% in an ice-water phantom and 7.0% in breast fibroglandular tissue. T1 measurements in gel phantoms had an average difference of 2.8% across three sites, whereas breast fibroglandular and adipose tissue had 8.4% and 7.5% average differences, respectively. In the repeatability study, we found no bias between first and second scanning sessions (P?=?0.1). The difference between repeated measurements was independent of the mean for each MRI metric (P?=?0.156, P?=?0.862, P?=?0.197 for ADC, T1 of fibroglandular tissue, and T1 of adipose tissue, respectively). DATA CONCLUSION:Community radiology practices can perform repeatable, reproducible, and accurate quantitative T1 -mapping and DW-MRI. This has the potential to dramatically expand the number of sites that can participate in multisite clinical trials and increase clinical translation of quantitative MRI techniques for cancer response assessment. LEVEL OF EVIDENCE:1 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2018.

Project description:PurposeAn ever-growing number of predictive models used to inform clinical decision making have included quantitative, computer-extracted imaging biomarkers, or "radiomic features." Broadly generalizable validity of radiomics-assisted models may be impeded by concerns about reproducibility. We offer a qualitative synthesis of 41 studies that specifically investigated the repeatability and reproducibility of radiomic features, derived from a systematic review of published peer-reviewed literature.Methods and materialsThe PubMed electronic database was searched using combinations of the broad Haynes and Ingui filters along with a set of text words specific to cancer, radiomics (including texture analyses), reproducibility, and repeatability. This review has been reported in compliance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. From each full-text article, information was extracted regarding cancer type, class of radiomic feature examined, reporting quality of key processing steps, and statistical metric used to segregate stable features.ResultsAmong 624 unique records, 41 full-text articles were subjected to review. The studies primarily addressed non-small cell lung cancer and oropharyngeal cancer. Only 7 studies addressed in detail every methodologic aspect related to image acquisition, preprocessing, and feature extraction. The repeatability and reproducibility of radiomic features are sensitive at various degrees to processing details such as image acquisition settings, image reconstruction algorithm, digital image preprocessing, and software used to extract radiomic features. First-order features were overall more reproducible than shape metrics and textural features. Entropy was consistently reported as one of the most stable first-order features. There was no emergent consensus regarding either shape metrics or textural features; however, coarseness and contrast appeared among the least reproducible.ConclusionsInvestigations of feature repeatability and reproducibility are currently limited to a small number of cancer types. Reporting quality could be improved regarding details of feature extraction software, digital image manipulation (preprocessing), and the cutoff value used to distinguish stable features.