Inter- and intra-observer variability of ultrasonographic arm muscle thickness measurement by critical care physicians.
Ontology highlight
ABSTRACT:
SUBMITTER: Hadda V
PROVIDER: S-EPMC5525479 | biostudies-other | 2017 Jul-Sep
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Muscle wasting is common among critically ill patients with sepsis and has a significant effect on clinical outcome. However, appropriate tool for measurement of muscle loss is debatable. Ultrasonography (USG) has been used for objective assessment of quadriceps muscle thickness among these patients; however, there is limited data on its reliability.This study was aimed to assess the reliability of quadriceps muscle thickness as measured by critical care physicians.This cross-sectional study included twenty patients with sepsis. Quadriceps muscle thickness was measured on right mid-thigh at a predefined point by two critical care fellows using bedside USG. Intra- and inter-observer reliability of the measurements was assessed by intra-class correlation coefficient (ICC).Hundred and twenty quadriceps muscle thickness measurements, three by each of the two critical care fellows, were done in twenty patients with sepsis. First, second, and third measurements (mean ± standard deviation) taken by the first observer (RK) were 35.030 ± 3.546 mm, 35.055 ± 3.307 mm, and 35.245 ± 3.027 mm, respectively. The three values recorded by the second observer (AD) were 35.585 ± 3.746 mm, 35.1 ± 3.006 mm, and 34.89 ± 2.556 mm, respectively. ICC for observer 1 and 2 was 0.925 (95% confidence interval [CI]: 0.851-0.967) and 0.835 (95% CI: 0.689-0.925), respectively. The mean difference of measurement between two observers was 0.082 mm (95% CI: -1.194-1.031). The mean ICC (95% CI) for inter-observer reliability was 0.992 (0.979-0.997); P < 0.001.This study shows that ultrasound is a reliable tool for the measurement of quadriceps muscle thickness by critical care physicians with excellent inter- and intra-class reliability.
| S-EPMC5538093 | biostudies-other
Project description:BackgroundTear lipid morphology is important for normal tear function. Recently, there have been clinical studies using interferometry to assess lipid layer thickness (LLT). The aim of the study is to examine the repeatability of a commercially available interferometer.MethodsTwo observers measured LLT in twenty Asian subjects (20 eyes) using an interferometer (LipiView® ocular surface interferometer, TearScience Inc, Morrisville, NC). Dry eye symptoms, tear break up time (TBUT) and corneal fluorescein staining were also prospectively evaluated.ResultsData for 20 participants are presented for either right or left eye (randomly selected). The mean LLT ± standard deviation of these participants was 53.53 ± 14.59 nm. When a single observer repeated the imaging on the same day, the coefficient of repeatability was 16 nm and the 95% limits of agreement were between -11 nm and 18 nm. When a different observer repeated the scan, the coefficient of repeatability was 13 nm and limits of agreement were -9 nm and 16 nm. LLT was not significantly associated with TBUT, presence of any corneal staining in any corneal zones, or symptomatic status.ConclusionWith the repeatability of measurements being known, the significance of LLT changes measured by this interferometer may be better interpreted. In this small Asian study, the LLT was lower than previously reported studies.
| S-EPMC4462010 | biostudies-literature
Project description:BackgroundSeveral radiographic measurements of the humerus can be used to evaluate the treatment outcome of supracondylar fractures in children. Because of the cartilaginous nature of the immature elbow, interpretation of radiographs around this area is sometimes challenging and can be unreliable. This study was conducted to determine the inter-observer and intra-observer reliability of the six commonly used radiographic measurements of the distal humerus.MethodThe Baumann angle, humero-ulna angle, metaphyseal-diaphyseal angle, radial epiphyseal angle, shaft-condylar angle and lateral capitellohumeral angle of the humerus were measured by two observers on the radiographs of uninjured elbows from 58 children. The values between each measurement were compared and correlated using a Pearson coefficient of correlation to determine the inter-observer and intra-observer reliability.ResultsAll of the radiographic parameters showed excellent intra-observer reliability with the correlation coefficient values of the Baumann angle, humero-ulna angle, metaphyseal-diaphyseal angle, radial epiphyseal angle, shaft-condylar angle, lateral capitellohumeral angle as 0.945, 0.95, 0.909, 0.888, 0.961 and 0.975 (p < 0.001), respectively. The inter-observer reliability of the Baumann and humero-ulna angles were also found to be highly correlated at r = 0.843 (p < 0.001) and 0.878 (p < 0.001), respectively. The metaphyseal-diaphyseal angle had poor reliability with r = 0.136 (p = 0.291) while the radial epiphyseal angle, shaft-condylar angle, and lateral capitellohumeral angle demonstrated good reliability with r = 0.675 (p < 0.001), 0.747 (p < 0.001), and 0.686 (p < 0.001), respectively.ConclusionThe Baumann angle and humero-ulna angle measurements of distal humerus showed excellent inter- and intra-observer reliability. Both parameters represent repeatable and reliable methods for determining the outcome of supracondylar humeral fractures in pediatric population.
| S-EPMC6612040 | biostudies-literature
Project description:BackgroundRadial probe endobronchial ultrasound (R-EBUS) is often utilized in guided bronchoscopy for the diagnosis of peripheral pulmonary lesions. R-EBUS probe positioning has been shown to correlate with diagnostic yield, but overall diagnostic yield with this technology has been inconsistent across the published literature. Currently there is no standardization for R-EBUS image interpretation, which may result in variability in grading concentricity of lesions and subsequently procedure performance. This was a survey-based study evaluating variability among practicing pulmonologists in R-EBUS image interpretation.MethodsR-EBUS images from peripheral bronchoscopy cases were sent to 10 practicing Interventional Pulmonologists at two different time points (baseline and 3 months). Participants were asked to grade the images as concentric, eccentric, or no image. Cohen's Kappa-coefficient was calculated for inter- and intra-observer variability.ResultsA total of 100 R-EBUS images were included in the survey. There was 100% participation with complete survey responses from all 10 participants. Overall kappa-statistic for inter-observer variability for Survey 1 and 2 was 0.496 and 0.477 respectively. Overall kappa-statistic for intra-observer variability between the two surveys was 0.803.ConclusionsThere is significant variability between pulmonologists when characterizing R-EBUS images. However, there is strong intra-rater agreement from each participant between surveys. A standardized approach and grading system for radial EBUS patterns may improve inter-observer variability in order to optimize our clinical use and research efforts in the field.
| S-EPMC10894385 | biostudies-literature
Project description:Discern inter- and intra-observer variability in the classification of extracapsular extension (ECE) in p16+ oropharyngeal (OP) SCC comparing pathologists' own criteria versus those of a well-defined classification system.Five pathologists reviewed 50 digitally scanned nodal metastasis slides in three Rounds. Round One was by their own criteria as ECE present or absent, and Rounds Two and Three were with a defined ECE system: Grade 0 (no ECE), 0c (no ECE - thick capsule; no infiltration), 1 (ECE - cells beyond capsule), and 2 (soft tissue metastasis - cells in soft tissue without residual node). Round Three assessed intra-observer variability after an 8 month washout period.In Round One, all five agreed on only 48% of cases (n=24). Fleiss's Kappa value was 0.508 (95% CI: 0.357-0.644). For Rounds Two and Three, Grades 0 and 0c and Grades 1 and 2 were separately grouped as ECE absent or present. In Round Two, all five agreed on 68% of cases (n=34). Fleiss' Kappa was 0.635 (95% CI: 0.472-0.783), indicating statistically significantly better agreement. In Round Three, all five agreed on 64% of cases (n=32) giving a Fleiss's Kappa of 0.639. Pathologists agreed with their prior reads in approximately 90% of cases (average n=45.4, range n=42-49), an average intra-observer Cohen's Kappa of 0.8 (range: 0.68-0.95). Inter- and intra-observer variability rates for classification of soft tissue metastasis (ECE2) were substantially worse.There is substantial inter-, and modest intra-, observer variability among head and neck pathologists for ECE in p16+ OPSCC, which is modestly improved by a defined system.
| S-EPMC4875754 | biostudies-literature
Project description:BackgroundMusculoskeletal disorders particularly in the back and lower extremities are common among marines. Here, movement-control tests are considered clinically useful for screening and follow-up evaluation. However, few studies have addressed the reliability of clinical tests, and no such published data exists for marines. The present aim was therefore to determine the inter- and intra-observer reliability of clinically convenient tests emphasizing movement control of the back and hip among marines. A secondary aim was to investigate the sensitivity and specificity of these clinical tests for discriminating musculoskeletal pain disorders in this group of military personnel.MethodsThis inter- and intra-observer reliability study used a test-retest approach with six standardized clinical tests focusing on movement control for back and hip. Thirty-three marines (age 28.7 yrs, SD 5.9) on active duty volunteered and were recruited. They followed an in-vivo observation test procedure that covered both low- and high-load (threshold) tasks relevant for marines on operational duty. Two independent observers simultaneously rated performance as "correct" or "incorrect" following a standardized assessment protocol. Re-testing followed 7-10 days thereafter. Reliability was analysed using kappa (κ) coefficients, while discriminative power of the best-fitting tests for back- and lower-extremity pain was assessed using a multiple-variable regression model.ResultsInter-observer reliability for the six tests was moderate to almost perfect with κ-coefficients ranging between 0.56-0.95. Three tests reached almost perfect inter-observer reliability with mean κ-coefficients > 0.81. However, intra-observer reliability was fair-to-moderate with mean κ-coefficients between 0.22-0.58. Three tests achieved moderate intra-observer reliability with κ-coefficients > 0.41. Combinations of one low- and one high-threshold test best discriminated prior back pain, but results were inconsistent for lower-extremity pain.ConclusionsOur results suggest that clinical tests of movement control of back and hip are reliable for use in screening protocols using several observers with marines. However, test-retest reproducibility was less accurate, which should be considered in follow-up evaluations. The results also indicate that combinations of low- and high-threshold tests have discriminative validity for prior back pain, but were inconclusive for lower-extremity pain.
| S-EPMC3552977 | biostudies-literature
Project description:To determine inter-observer and inter-examination variability of manual attenuation measurements of the vertebrae in low-dose unenhanced chest computed tomography (CT).Three hundred and sixty-seven lung cancer screening trial participants who underwent baseline and repeat unenhanced low-dose CT after 3 months because of an indeterminate lung nodule were included. The CT attenuation value of the first lumbar vertebrae (L1) was measured in all CTs by one observer to obtain inter-examination reliability. Six observers performed measurements in 100 randomly selected CTs to determine agreement with limits of agreement and Bland-Altman plots and reliability with intraclass correlation coefficients (ICCs). Reclassification analyses were performed using a threshold of 110 HU to define osteoporosis.Inter-examination reliability was excellent with an ICC of 0.92 (p?<?0.001). Inter-examination limits of agreement ranged from -26 to 28 HU with a mean difference of 1?±?14 HU. Inter-observer reliability ICCs ranged from 0.70 to 0.91. Inter-examination variability led to 11.2 % reclassification of participants and inter-observer variability led to 22.1 % reclassification.Vertebral attenuation values can be manually quantified with good to excellent inter-examination and inter-observer reliability on unenhanced low-dose chest CT. This information is valuable for early detection of osteoporosis on low-dose chest CT.• Vertebral attenuation values can be manually quantified on low-dose unenhanced CT reliably. • Vertebral attenuation measurements may be helpful in detecting subclinical low bone density. • This could become of importance in the detection of osteoporosis.
| S-EPMC4972882 | biostudies-other
Project description:PurposeTo evaluate variability of central corneal thickness measurement (CCT) devices using a hitherto unprecedented number of CCT devices.MethodsCCT was measured consecutively in 122 normal corneas of 61 subjects with seven different devices using three distinct measurement technologies: Scheimpflug, Ultrasound, and Optical Coherence Tomography (OCT). Per device deviation from the mean CCT value per eye was used to determine which of the devices performed best, compared to the mean value.ResultsCirrus OCT yielded the lowest deviation. Deviations of the individual devices from the mean CCT of each eye were (OS/OD) 12.8±5.0/14.9±9.4 ?m for Topcon noncontact specular microscopy (NCSM), 11.3±5.9/10.6±7.3 ?m for Pentacam, 10.7±5.2/10.4±4.8 ?m for Spectralis OCT, 6.0±3.9/6.2±4.9 ?m for Topcon DRI OCT, 5.1±3.4/5.9±10.3 ?m for AngioVue OCT, 4.8±4.1/5.7±4.6 ?m for US pachymetry, and 4.2±3.2/5.7±4.6 ?m for Cirrus OCT. The maximum differences between US pachymetry and the other devices were very high (up to 120 ?m).ConclusionCentral corneal thickness may be under- or overestimated due to high interdevice variations. Measuring CCT with one device only may lead to inappropriate clinical and surgical recommendations. OCT showed superior results.
| S-EPMC6136793 | biostudies-literature
Project description:Computed tomography (CT)-based method of three dimensional (3D) analysis (MIMICS®, Materialise, Leuven, Belgium) is reported as very useful software for evaluation of OPLL, but its reliability and reproducibility are obscure. This study was conducted to evaluate the accuracy of MIMICS® system, and inter- and intra-observer reliability in the measurement of OPLL.Three neurosurgeons independently analyzed the randomly selected 10 OPLL cases with medical image processing software (MIMICS®) which create 3D model with Digital Imaging and Communication in Medicine (DICOM) data from CT images after brief explanation was given to examiners before the image construction steps. To assess the reliability of inter- and intra-examiner intraclass correlation coefficient (ICC), 3 examiners measured 4 parameters (volume, length, width, and length) in 10 cases 2 times with 1-week interval.The inter-examiner ICCs among 3 examiners were 0.996 (95% confidence interval [CI], 0.987-0.999) for volume measurement, 0.973 (95% CI, 0.907-0.978) for thickness, 0.969 (95% CI, 0.895-0.993) for width, and 0.995 (95% CI, 0.983-0.999) for length. The intra-examiner ICCs were 0.994 (range, 0.991-0.996) for volume, 0.996 (range, 0.944-0.998) for length, 0.930 (range, 0.873-0.947) for width, and 0.987 (range, 0.985-0.995) for length.The medical image processing software (MIMICS®) provided detailed quantification OPLL volume with minimal error of inter- and intra-observer reliability in the measurement of OPLL.
| S-EPMC5544367 | biostudies-other
Project description:We extracted RNA from C57BL/6 mouse neutrophils to measure inter-individual variability in gene expression. 5 of the 10 blood samples were analyzed separately, the other 5 were pooled then split into 5 technical replicates to measure technical variability. We could then measure inter-individual variability in gene expression and compare it to the amplitude of miRNA-guided repression by miR-223.
2016-09-21 | GSE59549 | GEO