Dataset Information

Degenerative findings in lumbar spine MRI: an inter-rater reliability study involving three raters.

ABSTRACT:

Background

For diagnostic procedures to be clinically useful, they must be reliable. The interpretation of lumbar spine MRI scans is subject to variability and there is a lack of studies where reliability of multiple degenerative pathologies are rated simultaneously. The objective of our study was to determine the inter-rater reliability of three independent raters evaluating degenerative pathologies seen with lumbar spine MRI.

Methods

Fifty-nine people, 35 patients with low back pain (LBP) or LBP and leg pain and 24 people without LBP or leg pain, received an MRI of the lumbar spine. Three raters (one radiologist and two chiropractors) evaluated the MRIs for the presence and severity of eight degenerative spinal pathologies using a standardized format: Spondylolisthesis, scoliosis, annular fissure, disc degeneration, disc contour, nerve root compromise, spinal stenosis and facet joint degeneration. Findings were identified and classified at disc level according to type and severity. Raters were instructed to evaluate all study sample persons once to assess inter-rater reliability (fully crossed design). Reliability was calculated using Gwet's Agreement Coefficients (AC₁ and AC₂) and Cohen's Kappa (?) and Conger's extension of Cohen's. Gwet's probabilistic benchmarking method to the Landis and Koch scale was used. MRI-findings achieving substantial reliability was considered acceptable.

Results

Inter-rater reliability for all raters combined, ranged from (Gwet's AC₁ or AC₂): 0.64-0.99 and according to probabilistic benchmarking to the Landis and Koch scale equivalent to moderate to almost perfect reliability. Overall reliability level for individual pathologies was almost perfect reliability for spondylolisthesis, spinal stenosis, scoliosis and annular fissure, substantial for nerve root compromise and disc degeneration, and moderate for facet joint degeneration and disc contour.

Conclusion

Inter-rater reliability for 3 raters, evaluating 177 disc levels, was found to be overall acceptable for 6 out of 8 degenerative MRI-findings in the lumbar spine. Ratings of facet joint degeneration and disc contour achieved moderate reliability and was considered unacceptable.

SUBMITTER: Doktor K

PROVIDER: S-EPMC7011264 | biostudies-literature | 2020 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Degenerative findings in lumbar spine MRI: an inter-rater reliability study involving three raters.

Doktor Klaus K Jensen Tue Secher TS Christensen Henrik Wulff HW Fredberg Ulrich U Kindt Morten M Boyle Eleanor E Hartvigsen Jan J

Chiropractic & manual therapies 20200211 1

<h4>Background</h4>For diagnostic procedures to be clinically useful, they must be reliable. The interpretation of lumbar spine MRI scans is subject to variability and there is a lack of studies where reliability of multiple degenerative pathologies are rated simultaneously. The objective of our study was to determine the inter-rater reliability of three independent raters evaluating degenerative pathologies seen with lumbar spine MRI.<h4>Methods</h4>Fifty-nine people, 35 patients with low back ...[more]

PMID: 32041626

Similar Datasets

Project description:PurposeTo characterize the inter- and intraobserver variability of qualitative, non-disk contour degenerative findings of the lumbar spine at magnetic resonance (MR) imaging.Materials and methodsThe case accrual method used to perform this institutional review board-approved, HIPAA-compliant retrospective study was the random selection of 111 interpretable MR examination cases of subjects from the Spine Patient Outcomes Research Trial. The subjects were aged 18-87 years (mean, 53 years +/- 16 [standard deviation]). Four independent readers rated the cases according to defined criteria. A subsample of 40 MR examination cases was selected for reevaluation at least 1 month later. The following findings were assessed: spondylolisthesis, disk degeneration, marrow endplate abnormality (Modic changes), posterior anular hyperintense zone (HIZ), and facet arthropathy. Inter- and intraobserver agreement in rating the data was summarized by using weighted kappa statistics.ResultsInterobserver agreement was good (kappa = 0.66) in rating disk degeneration and moderate in rating spondylolisthesis (kappa = 0.55), Modic changes (kappa = 0.59), facet arthropathy (kappa = 0.54), and posterior HIZ (kappa = 0.44). Interobserver agreement in rating the extent of Modic changes was moderate: kappa Values were 0.43 for determining superior anteroposterior extent, 0.47 for determining superior craniocaudal extent, 0.57 for determining inferior anteroposterior extent, and 0.48 for determining inferior craniocaudal extent. Intraobserver agreement was good in rating spondylolisthesis (kappa = 0.66), disk degeneration (kappa = 0.74), Modic changes (kappa = 0.64), facet arthropathy (kappa = 0.69), and posterior HIZ (kappa = 0.67). Intraobserver agreement in rating the extent of Modic changes was moderate, with kappa values of 0.54 for superior anteroposterior, 0.60 for inferior anteroposterior, 0.50 for superior craniocaudal, and 0.60 for inferior craniocaudal extent determinations.ConclusionThe interpretation of general lumbar spine MR characteristics has sufficient reliability to warrant the further evaluation of these features as potential prognostic indicators.

Project description:BackgroundThe thoracic spine (TS) has been neglected in the study of the spine despite its essential role in the stability and posture of the entire spinal complex. Therefore, there is an inevitable need to investigate the reproducibility of different thoracic spinal posture measures used in subjects with TS pain.MethodsThirty-two subjects (16 females and 16 males, mean age 39 years) were evaluated by two physiotherapists on the same day to gauge inter-rater reliability and on two consecutive days to gauge intra-rater reliability. TS posture was assessed by observation, and thoracic spine mobility was measured by manual assessment of segmental flexion and extension mobility in a seated position. Additionally, posterior-to-anterior accessory mobility in a prone position was assessed manually. Moreover, cervicothoracic flexion in a seated position, thoracic posture, and thoracic flexion and extension mobility in a standing position were assessed with a tape measure, and flexion and extension mobility in a seated position and TS posture in seated and standing positions were measured with an inclinometer. The intraclass correlation coefficient (ICC), standard error of measurement (SEM), mean difference (MD), Bland-Altman (B&A) plot features and coefficient of repeatability (CR) were calculated.ResultsThe mean and standard deviation (SD) of the duration of TS pain was 22 (SD 45) months, with the intensity of pain being rated at 27 (SD 21) mm on a visual analogue scale (VAS). Intra-rater reliability was very strong (ICC ≥ 0.80) for the evaluation of seated and standing upper TS posture, standing whole TS posture and seated lower TS posture with an inclinometer. Moreover, TS posture evaluation with a measuring tape, posture inspection in a seated position, and manual assessment of segmental extension were found to have very strong intra-rater reliability. Inter-rater reliability was very strong for inclinometer measurements of standing and seated upper TS posture as well as standing whole TS posture.ConclusionIntra-rater reliability was higher than inter-rater reliability in most of the evaluated measurements. Overall, posture measurements with an inclinometer were more reliable than mobility measurements with the same instrument. The manual assessments can be used reliably when same evaluator performs the examination.Trial registrationClinical Trials, NCT01884818. Registered 24 June 2013, https://clinicaltrials.gov/ct2/show/NCT01884818?cond=thoracic+spine&cntry=FI&rank=1.

Project description:BackgroundThe common manual measurement technique of spinal sagittal alignment on X-rays is susceptible to rater-dependent variability, which has not been adequately considered in previous publications. This study investigates the effect of those variations in the characterization of patients receiving lumbar spondylodesis.MethodsGeneral alignment parameters on pre- and postoperative X-rays were evaluated by four raters in 43 prospectively sampled patients undergoing monolevel spondylodesis. The Intra-class Correlation Coefficient (ICC) for each rater pair and all raters together was calculated for inter-rater reliability. For the operation-induced change of the sagittal alignment in every patient the Wilcoxon test was applied to compare for each rater separately.ResultsThe ICCs were "good" (>0.75) to "excellent" (>0.9) for all raters together and for 45 of the 48 single rater pairs (93.75%). All revealed a significant increase of the addressed segmental lordosis and disc height and no significant change for spinopelvic parameters and sagittal vertical axis from pre- to postoperative. The lumbar lordosis showed a significant increase through the operation of +2.5° (p = 0.014) and +3.7° (p = 0.015) in two raters and no difference for the other ones (+2.1°, p = 0.171; -2.2°, p = 0.522).ConclusionsThe pre- to postoperative change of lumbar lordosis revealed different significance levels for different raters, although the ICCs were formally good. Accordingly, the evaluation by only one rater would lead to different conclusions. Due to this susceptibility of alignment measurements to rater-dependent variability, the exact evaluation process should be described in every publication and the consistency of significant results be validated through multiple raters.Trials registrationThe trial was approved by the local ethics committee and listed at the national clinical trials register ( DRKS00004514 , date of registration: 08/11/2012).

Project description:BackgroundMagnetic Resonance Imaging (MRI) is an important tool in preoperative evaluation of patients with lumbar spinal stenosis (LSS). Reported reliability of various MRI findings in LSS varies from fair to excellent. There are inconsistencies in the evaluated parameters and the methodology of the studies. The purpose of this study was to evaluate the reliability of the preoperative MRI findings in patients with LSS between musculoskeletal radiologists and orthopaedic spine surgeons, using established evaluation methods and imaging data from a prospective trial.MethodsConsecutive lumbar MRI examinations of candidates for surgical treatment of LSS from the Norwegian Spinal Stenosis and Degenerative Spondylolisthesis (NORDSTEN) study were independently evaluated by two musculoskeletal radiologists and two orthopaedic spine surgeons. The observers had a range of experience between six and 13 years and rated five categorical parameters (foraminal and central canal stenosis, facet joint osteoarthritis, redundant nerve roots and intraspinal synovial cysts) and one continuous parameter (dural sac cross-sectional area). All parameters were re-rated after 6 weeks by all the observers. Inter- and intraobserver agreement was assessed by Gwet's agreement coefficient (AC1) for categorical parameters and Intraclass Correlation Coefficient (ICC) for the dural sac cross-sectional area.ResultsMRI examinations of 102 patients (mean age 66 ± 8 years, 53 men) were evaluated. The overall interobserver agreement was substantial or almost perfect for all categorical parameters (AC1 range 0.67 to 0.98), except for facet joint osteoarthritis, where the agreement was moderate (AC1 0.39). For the dural sac cross-sectional area, the overall interobserver agreement was good or excellent (ICC range 0.86 to 0.96). The intraobserver agreement was substantial or almost perfect/ excellent for all parameters (AC1 range 0.63 to 1.0 and ICC range 0.93 to 1.0).ConclusionsThere is high inter- and intraobserver agreement between radiologists and spine surgeons for preoperative MRI findings of LSS. However, the interobserver agreement is not optimal for evaluation of facet joint osteoarthritis.Trial registrationwww.ClinicalTrials.gov identifier: NCT02007083 , registered December 2013.

Project description:There is a shortage of agreement studies relevant for measuring changes over time in lumbar intervertebral disc structures. The objectives of this study were: 1) to develop a method for measurement of intervertebral disc height, anterior and posterior disc material and dural sac diameter using MRI, 2) to evaluate intra- and inter-rater agreement and reliability for the measurements included, and 3) to identify factors compromising agreement.Measurements were performed on MRIs from 16 people with and 16 without lumbar disc herniation, purposefully chosen to represent all possible disc contours among participants in a general population study cohort. Using the new method, MRIs were measured twice by one rater and once by a second rater. Agreement on the sagittal start- and end-slice was evaluated using weighted Kappa. Length and volume measurements were conducted on available slices between intervertebral foramens, and cross-sectional areas (CSA) were calculated from length measurements and slice thickness. Results were reported as Bland and Altman's limits of agreement (LOA) and intraclass correlation coefficients (ICC).Weighted Kappa (Kw (95% CI)) for start- and end-slice were: intra-: 0.82(0.60;0.97) & 0.71(0.43;0.93); inter-rater: 0.56(0.29;0.78) & 0.60(0.35;0.81). For length measurements, LOA ranged from [-1.0;1.0] mm to [-2.0;2.3] mm for intra-; and from [-1.1; 1.4] mm to [-2.6;2.0] mm for inter-rater. For volume measurements, LOA ranged from [-293;199] mm3 to [-582;382] mm3 for intra-, and from [-17;801] mm3 to [-450;713] mm3 for inter-rater. For CSAs, LOA ranged between [-21.3; 18.8] mm2 and [-31.2; 43.7] mm2 for intra-, and between [-10.8; 16.4] mm2 and [-64.6; 27.1] mm2 for inter-rater. In general, LOA as a proportion of mean values gradually decreased with increasing size of the measured structures. Agreement was compromised by difficulties in identifying the vertebral corners, the anterior and posterior boundaries of the intervertebral disc and the dural sac posterior boundary. With two exceptions, ICCs were above 0.81.Length measurements and calculated CSAs of disc morphology and dural sac diameter from MRIs showed acceptable intra- and inter-rater agreement and reliability. However, caution should be taken when measuring very small structures and defining anatomical landmarks.

Dataset Information

Degenerative findings in lumbar spine MRI: an inter-rater reliability study involving three raters.

Background

Methods

Results

Conclusion

Publications

Degenerative findings in lumbar spine MRI: an inter-rater reliability study involving three raters.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets