Dataset Information

Degenerative findings on MRI of the cervical spine: an inter- and intra-rater reliability study.

ABSTRACT:

Background

Knowledge about the assessment reliability of common cervical spine changes is a prerequisite for precise and consistent communication about Magnetic Resonance Imaging (MRI) findings. The purpose of this study was to determine the inter- and intra-rater reliability of degenerative findings when assessing cervical spine MRI.

Methods

Fifty cervical spine MRIs from subjects with neck pain were used. A radiologist, a chiropractor and a second-year resident of rheumatology independently assessed kyphosis, disc height, disc contour, vertebral endplate signal changes, spinal canal stenosis, neural foraminal stenosis, and osteoarthritis of the uncovertebral and zygapophyseal joints. An evaluation manual was composed containing classifications and illustrative examples, and ten of the MRIs were evaluated twice followed by consensus meetings to refine the classifications. Next, the three readers independently assessed the full sample. Reliability measures were reported using prevalence estimates and unweighted kappa (?) statistics.

Results

The overall inter-rater reliability was substantial (????0.61) for the majority of variables and moderate only for zygapophyseal osteoarthritis (??=?0.56). Intra-rater reliability estimates were higher for all findings.

Conclusions

The present classifications for some of the most common cervical degenerative findings yielded mainly substantial inter-rater reliability estimates and substantial to almost perfect intra-rater reliability estimates. .

Trial registration

Regional Data Protection Agency (J.no. 1-16-02-86-16). The letter of exemption from the Regional Ethical Committee is available from the author on request (case no. 86 / 2017).

SUBMITTER: Moll LT

PROVIDER: S-EPMC6190655 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Degenerative findings on MRI of the cervical spine: an inter- and intra-rater reliability study.

Moll Line Thorndal LT Kindt Morten Wasmod MW Stapelfeldt Christina Malmose CM Jensen Tue Secher TS

Chiropractic & manual therapies 20181016

<h4>Background</h4>Knowledge about the assessment reliability of common cervical spine changes is a prerequisite for precise and consistent communication about Magnetic Resonance Imaging (MRI) findings. The purpose of this study was to determine the inter- and intra-rater reliability of degenerative findings when assessing cervical spine MRI.<h4>Methods</h4>Fifty cervical spine MRIs from subjects with neck pain were used. A radiologist, a chiropractor and a second-year resident of rheumatology i ...[more]

PMID: 30356854

Similar Datasets

Project description:BackgroundFor diagnostic procedures to be clinically useful, they must be reliable. The interpretation of lumbar spine MRI scans is subject to variability and there is a lack of studies where reliability of multiple degenerative pathologies are rated simultaneously. The objective of our study was to determine the inter-rater reliability of three independent raters evaluating degenerative pathologies seen with lumbar spine MRI.MethodsFifty-nine people, 35 patients with low back pain (LBP) or LBP and leg pain and 24 people without LBP or leg pain, received an MRI of the lumbar spine. Three raters (one radiologist and two chiropractors) evaluated the MRIs for the presence and severity of eight degenerative spinal pathologies using a standardized format: Spondylolisthesis, scoliosis, annular fissure, disc degeneration, disc contour, nerve root compromise, spinal stenosis and facet joint degeneration. Findings were identified and classified at disc level according to type and severity. Raters were instructed to evaluate all study sample persons once to assess inter-rater reliability (fully crossed design). Reliability was calculated using Gwet's Agreement Coefficients (AC1 and AC2) and Cohen's Kappa (κ) and Conger's extension of Cohen's. Gwet's probabilistic benchmarking method to the Landis and Koch scale was used. MRI-findings achieving substantial reliability was considered acceptable.ResultsInter-rater reliability for all raters combined, ranged from (Gwet's AC1 or AC2): 0.64-0.99 and according to probabilistic benchmarking to the Landis and Koch scale equivalent to moderate to almost perfect reliability. Overall reliability level for individual pathologies was almost perfect reliability for spondylolisthesis, spinal stenosis, scoliosis and annular fissure, substantial for nerve root compromise and disc degeneration, and moderate for facet joint degeneration and disc contour.ConclusionInter-rater reliability for 3 raters, evaluating 177 disc levels, was found to be overall acceptable for 6 out of 8 degenerative MRI-findings in the lumbar spine. Ratings of facet joint degeneration and disc contour achieved moderate reliability and was considered unacceptable.

Project description:BackgroundThe thoracic spine (TS) has been neglected in the study of the spine despite its essential role in the stability and posture of the entire spinal complex. Therefore, there is an inevitable need to investigate the reproducibility of different thoracic spinal posture measures used in subjects with TS pain.MethodsThirty-two subjects (16 females and 16 males, mean age 39 years) were evaluated by two physiotherapists on the same day to gauge inter-rater reliability and on two consecutive days to gauge intra-rater reliability. TS posture was assessed by observation, and thoracic spine mobility was measured by manual assessment of segmental flexion and extension mobility in a seated position. Additionally, posterior-to-anterior accessory mobility in a prone position was assessed manually. Moreover, cervicothoracic flexion in a seated position, thoracic posture, and thoracic flexion and extension mobility in a standing position were assessed with a tape measure, and flexion and extension mobility in a seated position and TS posture in seated and standing positions were measured with an inclinometer. The intraclass correlation coefficient (ICC), standard error of measurement (SEM), mean difference (MD), Bland-Altman (B&A) plot features and coefficient of repeatability (CR) were calculated.ResultsThe mean and standard deviation (SD) of the duration of TS pain was 22 (SD 45) months, with the intensity of pain being rated at 27 (SD 21) mm on a visual analogue scale (VAS). Intra-rater reliability was very strong (ICC ≥ 0.80) for the evaluation of seated and standing upper TS posture, standing whole TS posture and seated lower TS posture with an inclinometer. Moreover, TS posture evaluation with a measuring tape, posture inspection in a seated position, and manual assessment of segmental extension were found to have very strong intra-rater reliability. Inter-rater reliability was very strong for inclinometer measurements of standing and seated upper TS posture as well as standing whole TS posture.ConclusionIntra-rater reliability was higher than inter-rater reliability in most of the evaluated measurements. Overall, posture measurements with an inclinometer were more reliable than mobility measurements with the same instrument. The manual assessments can be used reliably when same evaluator performs the examination.Trial registrationClinical Trials, NCT01884818. Registered 24 June 2013, https://clinicaltrials.gov/ct2/show/NCT01884818?cond=thoracic+spine&cntry=FI&rank=1.

Project description:ObjectivesTo investigate the intra- and inter-rater reliability of the total radiomics quality score (RQS) and the reproducibility of individual RQS items' score in a large multireader study.MethodsNine raters with different backgrounds were randomly assigned to three groups based on their proficiency with RQS utilization: Groups 1 and 2 represented the inter-rater reliability groups with or without prior training in RQS, respectively; group 3 represented the intra-rater reliability group. Thirty-three original research papers on radiomics were evaluated by raters of groups 1 and 2. Of the 33 papers, 17 were evaluated twice with an interval of 1 month by raters of group 3. Intraclass coefficient (ICC) for continuous variables, and Fleiss' and Cohen's kappa (k) statistics for categorical variables were used.ResultsThe inter-rater reliability was poor to moderate for total RQS (ICC 0.30-055, p < 0.001) and very low to good for item's reproducibility (k - 0.12 to 0.75) within groups 1 and 2 for both inexperienced and experienced raters. The intra-rater reliability for total RQS was moderate for the less experienced rater (ICC 0.522, p = 0.009), whereas experienced raters showed excellent intra-rater reliability (ICC 0.91-0.99, p < 0.001) between the first and second read. Intra-rater reliability on RQS items' score reproducibility was higher and most of the items had moderate to good intra-rater reliability (k - 0.40 to 1).ConclusionsReproducibility of the total RQS and the score of individual RQS items is low. There is a need for a robust and reproducible assessment method to assess the quality of radiomics research.Clinical relevance statementThere is a need for reproducible scoring systems to improve quality of radiomics research and consecutively close the translational gap between research and clinical implementation.Key points• Radiomics quality score has been widely used for the evaluation of radiomics studies. • Although the intra-rater reliability was moderate to excellent, intra- and inter-rater reliability of total score and point-by-point scores were low with radiomics quality score. • A robust, easy-to-use scoring system is needed for the evaluation of radiomics research.

Project description:BACKGROUND:There is a growing trend in the use of mobile health (mHealth) technologies in traditional Chinese medicine (TCM) and telemedicine, especially during the coronavirus disease (COVID-19) outbreak. Tongue diagnosis is an important component of TCM, but also plays a role in Western medicine, for example in dermatology. However, the procedure of obtaining tongue images has not been standardized and the reliability of tongue diagnosis by smartphone tongue images has yet to be evaluated. OBJECTIVE:The first objective of this study was to develop an operating classification scheme for tongue coating diagnosis. The second and main objective of this study was to determine the intra-rater and inter-rater reliability of tongue coating diagnosis using the operating classification scheme. METHODS:An operating classification scheme for tongue coating was developed using a stepwise approach and a quasi-Delphi method. First, tongue images (n=2023) were analyzed by 2 groups of assessors to develop the operating classification scheme for tongue coating diagnosis. Based on clinicians' (n=17) own interpretations as well as their use of the operating classification scheme, the results of tongue diagnosis on a representative tongue image set (n=24) were compared. After gathering consensus for the operating classification scheme, the clinicians were instructed to use the scheme to assess tongue features of their patients under direct visual inspection. At the same time, the clinicians took tongue images of the patients with smartphones and assessed tongue features observed in the smartphone image using the same classification scheme. The intra-rater agreements of these two assessments were calculated to determine which features of tongue coating were better retained by the image. Using the finalized operating classification scheme, clinicians in the study group assessed representative tongue images (n=24) that they had taken, and the intra-rater and inter-rater reliability of their assessments was evaluated. RESULTS:Intra-rater agreement between direct subject inspection and tongue image inspection was good to very good (Cohen ? range 0.69-1.0). Additionally, when comparing the assessment of tongue images on different days, intra-rater reliability was good to very good (? range 0.7-1.0), except for the color of the tongue body (?=0.22) and slippery tongue fur (?=0.1). Inter-rater reliability was moderate for tongue coating (Gwet AC2 range 0.49-0.55), and fair for color and other features of the tongue body (Gwet AC2=0.34). CONCLUSIONS:Taken together, our study has shown that tongue images collected via smartphone contain some reliable features, including tongue coating, that can be used in mHealth analysis. Our findings thus support the use of smartphones in telemedicine for detecting changes in tongue coating.

Project description:ObjectivesThe objectives of this study were to asses (1) inter-rater and intrarater reliability of ultrasound imaging in patients with hip osteoarthritis, and (2) agreement between ultrasound and X-ray findings of hip osteoarthritis using validated Outcome Measures in Rheumatology ultrasound definitions for pathology.DesignAn inter-rater and intrarater reliability study.SettingA single-centre study conducted at a regional hospital.Participants50 patients >39 years of age referred for radiography due to hip pain and suspected hip osteoarthritis were included. Exclusion criteria were previous hip surgery in the painful hip, suspected fracture or malignant changes in the hip.InterventionBilateral ultrasound examinations (n=92) were performed continuously by two experienced operators blinded to clinical information and other imaging findings. After 4-6 weeks, one operator reassessed the images. X-rays were assessed by a third imaging specialist.Primary and secondary outcome measuresInter-rater and intrarater reliability and agreement between ultrasound imaging and X-ray were assessed using Cohen's ordinal kappa statistics for binary categorical variables and weighted kappa for ordered categorical variables.ResultsKappa values (κ) for inter-rater reliability were 0.9 and 0.8 for hip effusion/synovitis and osteoarthritis grading, respectively. For acetabular and femoral osteophytes, femoral cartilage changes and labrum changes κ ranged from 0.4 to 0.7. Intrarater reliability had κ equal or higher compared with inter-rater reliability. Agreement between ultrasound and X-ray findings ranged from κ=0.2 to κ=0.5.ConclusionThis study demonstrated substantial to almost perfect reliability on the most common ultrasound findings related to hip osteoarthritis and osteoarthritis grading. Agreement on the grade of osteoarthritis between ultrasound and X-ray was moderate. Overall, these results support ultrasound imaging as a reliable tool in the assessment of hip osteoarthritis.

Project description:BackgroundThe CHEERS is a self-administered tool to measure gaps, weaknesses, and strengths of an early childhood education and care (ECEC) centre-based nutrition and physical activity environment. ECEC settings have the potential to profoundly influence early dietary and physical activity behaviours. Content validation of the CHEERS tool has been previously reported. The purpose of this study was to develop reliability and validity evidence for the CHEERS audit tool and the proposed subscales of food served, healthy eating environment, program planning, and physical activity environment in ECEC centre-based programs.MethodsThis cross-sectional study consisted of 2 phases: Phase 1 included inter-, intra-rater and Cronbach's ?. A subset of this sample was invited to participate in a second survey (Trial 2) for intra-rater assessment within 3 weeks of completing the first survey (Trial 1). Phase 2 included concurrent validity assessment between a nutrition expert and the ECEC director using within a one-week period.ResultsOne hundred two directors and 85 educators (total of 187) returned the survey. Of these, there were 75 matched pairs for inter-rater reliability analysis providing a CHEERS ICC score of 0.59 and ICC scores ranging from 0.40 to 0.58 for the subscales. The ICC for intra-rater reliability of the CHEERS score was 0.81 for 40 participants completing the survey a second time and a range of 0.72 to 0.79 for the subscales. The CHEERS tool demonstrated very good internal consistency (??=?0.91) and ? scores ranging from 0.73 to 0.79 for the subscales. In phase 2, concurrent validation was ICC?=?0.65 (n?=?30) CHEERS scores with a range of 0.42 to 0.69 for the subscales.ConclusionsThis study provides evidence of inter-, intra-rater reliability, internal consistency, and concurrent validity of an environmental assessment audit tool to assess the nutrition and physical activity environment of ECEC centre-based programs. The results demonstrate that the self-administered CHEERS instrument is stable overtime and between evaluators at the same ECEC centre. The scores obtained with CHEERS self-administered audit tool are reasonably accurate compared to an expert rater (dietitian) assessment. This study adds additional support to establishing the psychometric soundness of the CHEERS tool.

Project description:ObjectivesThe reliability of ultrasonic strain elastography (SEL) used to detect abnormalities in the supraspinatus tendon is unclear. Thus, the aim of this study was to investigate the reliability of SEL in the supraspinatus tendon.DesignAn intra-rater and inter-rater reliability study.SettingA single-centre study conducted at the University of Southern Denmark.ParticipantsTwenty participants with shoulder pain and MRI-verified supraspinatus tendinosis and 20 asymptomatic participants (no MRI).Primary and secondary outcome measuresRaw values (RAW) and ratios (deltoid muscle (DELT) and gel pad (GEL) as reference tissues) were calculated and mean values of measurements from three regions of the supraspinatus tendon were reported. Colour scale ratings and number of yellow/red lesions from the three areas were also included.ResultsIntra-rater reliability showed intraclass correlation coefficients (ICCs) for RAW, DELT and GEL: 0.97 (minimal detectable change (MDC): 0.28 (6.36% of the mean)), 0.89 (MDC: 2.91 (20.37%)) and 0.73 (MDC: 1.61 (58.82%)), respectively. The ICCs for inter-rater reliability were 0.89 (MDC: 0.47 (10.53%)), 0.78 (MDC: 3.69 (25.51%)) and 0.70 (MDC: 1.75 (62.63%)), respectively.For colour scale ratings, intra-rater reliability (linear weighted kappa) ranged from 0.76 to 0.79, with the inter-rater reliability from 0.71 to 0.81. For the number of lesions, intra-rater reliability ranged from 0.40 to 0.82 and inter-rater reliability from 0.24 to 0.67.ConclusionsIntra-rater and inter-rater reliability were excellent for raw values and for ratios with deltoid muscle as the reference tissue, and good for ratios with gel pad as the reference tissue. The reliability of colour scale ratings was substantial-to-almost perfect, and for the number of lesions fair-to-almost perfect.Although high reliability was found, validity and responsiveness of these elastographic methods needs further investigation.Ethics approvalThe study protocol was approved by the Ethics Committee for the Region of South Denmark (S-20160115) and reported to the Danish Data Protection Agency (2014-41-3266).

Dataset Information

Degenerative findings on MRI of the cervical spine: an inter- and intra-rater reliability study.

Background

Methods

Results

Conclusions

Trial registration

Publications

Degenerative findings on MRI of the cervical spine: an inter- and intra-rater reliability study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets