Accuracy, repeatability, and interplatform reproducibility of T1 quantification methods used for DCE-MRI: Results from a multicenter phantom study.
Ontology highlight
ABSTRACT:
SUBMITTER: Bane O
PROVIDER: S-EPMC5821553 | biostudies-literature | 2018 May
REPOSITORIES: biostudies-literature
Publications
Accuracy, repeatability, and interplatform reproducibility of T<sub>1</sub> quantification methods used for DCE-MRI: Results from a multicenter phantom study.
Bane Octavia O Hectors Stefanie J SJ Wagner Mathilde M Arlinghaus Lori L LL Aryal Madhava P MP Cao Yue Y Chenevert Thomas L TL Fennessy Fiona F Huang Wei W Hylton Nola M NM Kalpathy-Cramer Jayashree J Keenan Kathryn E KE Malyarenko Dariya I DI Mulkern Robert V RV Newitt David C DC Russek Stephen E SE Stupic Karl F KF Tudorica Alina A Wilmes Lisa J LJ Yankeelov Thomas E TE Yen Yi-Fei YF Boss Michael A MA Taouli Bachir B
Magnetic resonance in medicine 20170914 5
<h4>Purpose</h4>To determine the in vitro accuracy, test-retest repeatability, and interplatform reproducibility of T<sub>1</sub> quantification protocols used for dynamic contrast-enhanced MRI at 1.5 and 3 T.<h4>Methods</h4>A T<sub>1</sub> phantom with 14 samples was imaged at eight centers with a common inversion-recovery spin-echo (IR-SE) protocol and a variable flip angle (VFA) protocol using seven flip angles, as well as site-specific protocols (VFA with different flip angles, variable repe ...[more]
Similar Datasets
Project description:Quantitative diffusion-weighted MRI (DW-MRI) and dynamic contrast-enhanced MRI (DCE-MRI) have the potential to impact patient care by providing noninvasive biological information in breast cancer. To quantify the repeatability, reproducibility, and accuracy of apparent diffusion coefficient (ADC) and T1 -mapping of the breast in community radiology practices. Prospective. Ice-water DW-MRI and T1 gel phantoms were used to assess accuracy. Normal subjects (n = 3) and phantoms across three sites (one academic, two community) were used to assess reproducibility. Test-retest analysis at one site in normal subjects (n = 12) was used to assess repeatability. 3T Siemens Skyra MRI quantitative DW-MRI and T1 -mapping. Quantitative DW-MRI and T1 -mapping parametric maps of phantoms and fibroglandular and adipose tissue of the breast. Average values of breast tissue were quantified and Bland-Altman analysis was performed to assess the repeatability of the MRI techniques, while the Friedman test assessed reproducibility. ADC measurements were reproducible across sites, with an average difference of 1.6% in an ice-water phantom and 7.0% in breast fibroglandular tissue. T1 measurements in gel phantoms had an average difference of 2.8% across three sites, whereas breast fibroglandular and adipose tissue had 8.4% and 7.5% average differences, respectively. In the repeatability study, we found no bias between first and second scanning sessions (P = 0.1). The difference between repeated measurements was independent of the mean for each MRI metric (P = 0.156, P = 0.862, P = 0.197 for ADC, T1 of fibroglandular tissue, and T1 of adipose tissue, respectively). Community radiology practices can perform repeatable, reproducible, and accurate quantitative T1 -mapping and DW-MRI. This has the potential to dramatically expand the number of sites that can participate in multisite clinical trials and increase clinical translation of quantitative MRI techniques for cancer response assessment. 1 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2018.
| S-EPMC6151298 | biostudies-literature
Project description:PURPOSE:The aim of this study was to develop a portable perfusion phantom and validate its utility in quantitative dynamic contrast-enhanced magnetic resonance imaging of the abdomen. METHODS:A portable perfusion phantom yielding a reproducible contrast enhancement curve (CEC) was developed. A phantom package including perfusion and static phantoms were imaged simultaneously with each of three healthy human volunteers in two different 3T MR scanners. Look-up tables correlating reference (known) contrast concentrations with measured ones were created using either the static or perfusion phantom. Contrast maps of image slices showing four organs (liver, spleen, pancreas, and paravertebral muscle) were generated before and after data correction using the look-up tables. The contrast concentrations at 4.5 min after dosing in each of the four organs were averaged for each volunteer. The mean contrast concentrations (4 organs × 3 volunteers = 12) were compared for the two scanners, and the intra-class correlation coefficient (ICC) was calculated. Also, the ICC of the mean Ktrans values between the two scanners was calculated before and after data correction. RESULTS:The repeatability coefficient of CECs of perfusion phantom was higher than 0.997 in all measurements. The ICC of the tissue contrast concentrations between the two scanners was 0.693 before correction, but increased to 0.974 after correction using the look-up tables (LUTs) of perfusion phantom. However, the ICC was not increased after correction using static phantom (ICC: 0.617). Similarly, the ICC of the Ktrans values was 0.899 before correction, but increased to 0.996 after correction using perfusion phantom LUTs. The ICC of the Ktrans values, however, was not increased when static phantom LUTs were used (ICC: 0.866). CONCLUSIONS:The perfusion phantom reduced variability in quantitating contrast concentration and Ktrans values of human abdominal tissues across different MR units, but static phantom did not. The perfusion phantom has the potential to facilitate multi-institutional clinical trials employing quantitative DCE-MRI to evaluate various abdominal malignancies.
| S-EPMC5646228 | biostudies-literature
Project description:BACKGROUND:The T1 Mapping and Extracellular volume (ECV) Standardization (T1MES) program explored T1 mapping quality assurance using a purpose-developed phantom with Food and Drug Administration (FDA) and Conformité Européenne (CE) regulatory clearance. We report T1 measurement repeatability across centers describing sequence, magnet, and vendor performance. METHODS:Phantoms batch-manufactured in August 2015 underwent 2?years of structural imaging, B0 and B1, and "reference" slow T1 testing. Temperature dependency was evaluated by the United States National Institute of Standards and Technology and by the German Physikalisch-Technische Bundesanstalt. Center-specific T1 mapping repeatability (maximum one scan per week to minimum one per quarter year) was assessed over mean 358 (maximum 1161) days on 34 1.5?T and 22 3?T magnets using multiple T1 mapping sequences. Image and temperature data were analyzed semi-automatically. Repeatability of serial T1 was evaluated in terms of coefficient of variation (CoV), and linear mixed models were constructed to study the interplay of some of the known sources of T1 variation. RESULTS:Over 2?years, phantom gel integrity remained intact (no rips/tears), B0 and B1 homogenous, and "reference" T1 stable compared to baseline (% change at 1.5?T, 1.95?±?1.39%; 3?T, 2.22?±?1.44%). Per degrees Celsius, 1.5?T, T1 (MOLLI 5s(3s)3s) increased by 11.4?ms in long native blood tubes and decreased by 1.2?ms in short post-contrast myocardium tubes. Agreement of estimated T1 times with "reference" T1 was similar across Siemens and Philips CMR systems at both field strengths (adjusted R2 ranges for both field strengths, 0.99-1.00). Over 1?year, many 1.5?T and 3?T sequences/magnets were repeatable with mean CoVs <?1 and 2% respectively. Repeatability was narrower for 1.5?T over 3?T. Within T1MES repeatability for native T1 was narrow for several sequences, for example, at 1.5?T, Siemens MOLLI 5s(3s)3s prototype number 448B (mean CoV?=?0.27%) and Philips modified Look-Locker inversion recovery (MOLLI) 3s(3s)5s (CoV 0.54%), and at 3?T, Philips MOLLI 3b(3s)5b (CoV 0.33%) and Siemens shortened MOLLI (ShMOLLI) prototype 780C (CoV 0.69%). After adjusting for temperature and field strength, it was found that the T1 mapping sequence and scanner software version (both P?<?0.001 at 1.5?T and 3?T), and to a lesser extent the scanner model (P?=?0.011, 1.5?T only), had the greatest influence on T1 across multiple centers. CONCLUSION:The T1MES CE/FDA approved phantom is a robust quality assurance device. In a multi-center setting, T1 mapping had performance differences between field strengths, sequences, scanner software versions, and manufacturers. However, several specific combinations of field strength, sequence, and scanner are highly repeatable, and thus, have potential to provide standardized assessment of T1 times for clinical use, although temperature correction is required for native T1 tubes at least.
| S-EPMC7204222 | biostudies-literature
Project description:PurposeTo develop a disposable point-of-care portable perfusion phantom (DP4) and validate its clinical utility in a multi-institutional setting for quantitative dynamic contrast-enhanced magnetic resonance imaging (qDCE-MRI).MethodsThe DP4 phantom was designed for single-use and imaged concurrently with a human subject so that the phantom data can be utilized as the reference to detect errors in qDCE-MRI measurement of human tissues. The change of contrast-agent concentration in the phantom was measured using liquid chromatography-mass spectrometry. The repeatability of the contrast enhancement curve (CEC) was assessed with five phantoms in a single MRI scanner. Five healthy human subjects were recruited to evaluate the reproducibility of qDCE-MRI measurements. Each subject was imaged concurrently with the DP4 phantom at two institutes using three 3T MRI scanners from three different vendors. Pharmacokinetic (PK) parameters in the regions of liver, spleen, pancreas, and paravertebral muscle were calculated based on the Tofts model (TM), extended Tofts model (ETM), and shutter speed model (SSM). The reproducibility of each PK parameter over three measurements was evaluated with the intraclass correlation coefficient (ICC) and compared before and after DP4-based error correction.ResultsThe contrast-agent concentration in the DP4 phantom was linearly increased over 10 min (0.17 mM/min, measurement accuracy: 96%) after injecting gadoteridol (100 mM) at a constant rate (0.24 ml/s, 4 ml). The repeatability of the CEC within the phantom was 0.997 when assessed by the ICC. The reproducibility of the volume transfer constant, Ktrans , was the highest of the PK parameters regardless of the PK models. The ICCs of Ktrans in the TM, ETM, and SSM before DP4-based error correction were 0.34, 0.39, and 0.72, respectively, while those increased to 0.93, 0.98, and 0.86, respectively, after correction.ConclusionsThe DP4 phantom is reliable, portable, and capable of significantly improving the reproducibility of qDCE-MRI measurements.
| S-EPMC9188826 | biostudies-literature
Project description:Reduced pancreas volume, as measured by non-contrast magnetic resonance imaging (MRI), is observed in individuals with newly-diagnosed type 1 diabetes (T1D) and declines over the first year after diagnosis. In this study, we determined the repeatability and inter-reader reproducibility of pancreas volume measurements by MRI. Test-retest scans in individuals with or without T1D (n?=?16) had an intraclass correlation coefficient (ICC) of 0.985 (95% CI 0.961 to 0.995) for pancreas volume. Independent pancreas outlines by two board-certified radiologists (n?=?30) yielded an ICC of 0.945 (95% CI 0.889 to 0.973). The mean Dice coefficient, a measurement of the degree of overlap between pancreas regions of interest between the two readers, was 0.77. Prandial state did not influence pancreatic measurements, as stomach volume did not correlate with pancreas volume. These data demonstrate that MRI measurements of pancreas volume between two readers are repeatable and reproducible with ICCs that correspond to excellent clinical significance (ICC?>?0.9), are not related to changes in stomach volume, and could be a useful tool for clinical investigation of diabetes and other pancreas pathologies.
| S-EPMC7076034 | biostudies-literature
Project description:The repeatability and reproducibility of radiomic features extracted from CT scans need to be investigated to evaluate the temporal stability of imaging features with respect to a controlled scenario (test-retest), as well as their dependence on acquisition parameters such as slice thickness, or tube current. Only robust and stable features should be used in prognostication/prediction models to improve generalizability across multiple institutions. In this study, we investigated the repeatability and reproducibility of radiomic features with respect to three different scanners, variable slice thickness, tube current, and use of intravenous (IV) contrast medium, combining phantom studies and human subjects with non-small cell lung cancer. In all, half of the radiomic features showed good repeatability (ICC > 0.9) independent of scanner model. Within acquisition protocols, changes in slice thickness was associated with poorer reproducibility compared to the use of IV contrast. Broad feature classes exhibit different behaviors, with only few features appearing to be the most stable. 108 features presented both good repeatability and reproducibility in all the experiments, most of them being wavelet and Laplacian of Gaussian features.
| S-EPMC7820018 | biostudies-literature
Project description:It has recently been suggested that multicenter preclinical stroke studies should be carried out to improve translation from bench to bedside, but the accuracy of magnetic resonance imaging (MRI) scanners routinely used in experimental stroke has not yet been evaluated. We aimed to assess and compare geometric accuracy of preclinical scanners and examine the longitudinal stability of one scanner using a simple quality assurance (QA) protocol. Six 7 Tesla animal scanners across six different preclinical imaging centers throughout Europe were used to scan a small structural phantom and estimate linear scaling errors in all orthogonal directions and volumetric errors. Between-scanner imaging consisted of a standard sequence and each center's preferred sequence for the assessment of infarct size in rat models of stroke. The standard sequence was also used to evaluate the drift in accuracy of the worst performing scanner over a period of six months following basic gradient calibration. Scaling and volumetric errors using the standard sequence were less variable than corresponding errors using different stroke sequences. The errors for one scanner, estimated using the standard sequence, were very high (above 4% scaling errors for each orthogonal direction, 18.73% volumetric error). Calibration of the gradient coils in this system reduced scaling errors to within ±1.0%; these remained stable during the subsequent 6-month assessment. In conclusion, despite decades of use in experimental studies, preclinical MRI still suffers from poor and variable geometric accuracy, influenced by the use of miscalibrated systems and various types of sequences for the same purpose. For effective pooling of data in multicenter studies, centers should adopt standardized procedures for system QA and in vivo imaging.
| S-EPMC5014410 | biostudies-literature
Project description:Quantitative kurtosis phantoms are sought by multicenter clinical trials to establish accuracy and precision of quantitative imaging biomarkers on the basis of diffusion kurtosis imaging (DKI) parameters. We designed and evaluated precision, reproducibility, and long-term stability of a novel isotropic (i)DKI phantom fabricated using four families of chemicals based on vesicular and lamellar mesophases of liquid crystal materials. The constructed iDKI phantoms included negative control monoexponential diffusion materials to independently characterize noise and model-induced bias in quantitative kurtosis parameters. Ten test-retest DKI studies were performed on four scanners at three imaging centers over a six-month period. The tested prototype phantoms exhibited physiologically relevant apparent diffusion, Dapp, and kurtosis, Kapp, parameters ranging between 0.4 and 1.1 (×10-3 mm2/s) and 0.8 and 1.7 (unitless), respectively. Measured kurtosis phantom Kapp exceeded maximum fit model bias (0.1) detected for negative control (zero kurtosis) materials. The material-specific parameter precision [95% CI for Dapp: 0.013-0.022(×10-3 mm2/s) and for Kapp: 0.009-0.076] derived from the test-retest analysis was sufficient to characterize thermal and temporal stability of the prototype DKI phantom through correlation analysis of inter-scan variability. The present study confirms a promising chemical design for stable quantitative DKI phantom based on vesicular mesophase of liquid crystal materials. Improvements to phantom preparation and temperature monitoring procedures have potential to enhance precision and reproducibility for future multicenter iDKI phantom studies.
| S-EPMC6403043 | biostudies-literature
Project description:BackgroundMagnetic resonance cholangiopancreatography (MRCP) is an important tool for noninvasive imaging of biliary disease, however, its assessment is currently subjective, resulting in the need for objective biomarkers.PurposeTo investigate the accuracy, scan/rescan repeatability, and cross-scanner reproducibility of a novel quantitative MRCP tool on phantoms and in vivo. Additionally, to report normative ranges derived from the healthy cohort for duct measurements and tree-level summary metrics.Study typeProspective.Phantoms/subjectsPhantoms: two bespoke designs, one with varying tube-width, curvature, and orientation, and one exhibiting a complex structure based on a real biliary tree. Subjects Twenty healthy volunteers, 10 patients with biliary disease, and 10 with nonbiliary liver disease.Sequence/field strengthMRCP data were acquired using heavily T2 -weighted 3D multishot fast/turbo spin echo acquisitions at 1.5T and 3T.AssessmentDigital instances of the phantoms were synthesized with varying resolution and signal-to-noise ratio. Physical 3D-printed phantoms were scanned across six scanners (two field strengths for each of three manufacturers). Human subjects were imaged on four scanners (two fieldstrengths for each of two manufacturers).Statistical testsBland-Altman analysis and repeatability coefficient (RC).ResultsAccuracy of the diameter measurement approximated the scanning resolution, with 95% limits of agreement (LoA) from -1.1 to 1.0 mm. Excellent phantom repeatability was observed, with LoA from -0.4 to 0.4 mm. Good reproducibility was observed across the six scanners for both phantoms, with a range of LoA from -1.1 to 0.5 mm. Inter- and intraobserver agreement was high. Quantitative MRCP detected strictures and dilatations in the phantom with 76.6% and 85.9% sensitivity and 100% specificity in both. Patients and healthy volunteers exhibited significant differences in metrics including common bile duct (CBD) maximum diameter (7.6 mm vs. 5.2 mm P = 0.002), and overall biliary tree volume 12.36 mL vs. 4.61 mL, P = 0.0026).Data conclusionThe results indicate that quantitative MRCP provides accurate, repeatable, and reproducible measurements capable of objectively assessing cholangiopathic change. Evidence Level: 1 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2020;52:807-820.
| S-EPMC7496952 | biostudies-literature
Project description:Recent innovations in quantitative magnetic resonance imaging (MRI) measurement methods have led to improvements in accuracy, repeatability, and acquisition speed, and have prompted renewed interest to reevaluate the medical value of quantitative T1. The purpose of this study was to determine the bias and reproducibility of T1 measurements in a variety of MRI systems with an eye toward assessing the feasibility of applying diagnostic threshold T1 measurement across multiple clinical sites. We used the International Society of Magnetic Resonance in Medicine/National Institute of Standards and Technology (ISMRM/NIST) system phantom to assess variations of T1 measurements, using a slow, reference standard inversion recovery sequence and a rapid, commonly-available variable flip angle sequence, across MRI systems at 1.5 tesla (T) (two vendors, with number of MRI systems n = 9) and 3 T (three vendors, n = 18). We compared the T1 measurements from inversion recovery and variable flip angle scans to ISMRM/NIST phantom reference values using Analysis of Variance (ANOVA) to test for statistical differences between T1 measurements grouped according to MRI scanner manufacturers and/or static field strengths. The inversion recovery method had minor over- and under-estimations compared to the NMR-measured T1 values at both 1.5 T and 3 T. Variable flip angle measurements had substantially greater deviations from the NMR-measured T1 values than the inversion recovery measurements. At 3 T, the measured variable flip angle T1 for one vendor is significantly different than the other two vendors for most of the samples throughout the clinically relevant range of T1. There was no consistent pattern of discrepancy between vendors. We suggest establishing rigorous quality control procedures for validating quantitative MRI methods to promote confidence and stability in associated measurement techniques and to enable translation of diagnostic threshold from the research center to the entire clinical community.
| S-EPMC8244851 | biostudies-literature