Dataset Information

Evaluation of inter- and intra-operator reliability of manual segmentation of femoral metastatic lesions.

ABSTRACT:

Purpose

Accurate identification of metastatic lesions is important for improvement in biomechanical models that calculate the fracture risk of metastatic bones. The aim of this study was therefore to assess the inter- and intra-operator reliability of manual segmentation of femoral metastatic lesions.

Methods

CT scans of 54 metastatic femurs (19 osteolytic, 17 osteoblastic, and 18 mixed) were segmented two times by two operators. Dice coefficients (DCs) were calculated adopting the quantification that a DC˃0.7 indicates good reliability.

Results

Generally, rather poor inter- and intra-operator reliability of lesion segmentation were found. Inter-operator DCs were 0.54 (± 0.28) and 0.50 (± 0.32) for the first and second segmentations, respectively, whereas intra-operator DCs were 0.56 (± 0.28) for operator I and 0.71 (± 0.23) for operator II. Larger lesions scored significantly higher DCs in comparison with smaller lesions. Of the femurs with larger mean segmentation volumes, 83% and 93% were segmented with good inter- and intra-operator DCs (> 0.7), respectively. There was no difference between the mean DCs of osteolytic, osteoblastic, and mixed lesions.

Conclusion

Manual segmentation of femoral bone metastases is very challenging and resulted in unsatisfactory mean reliability values. There is a need for development of a segmentation protocol to reduce the inter- and intra-operator segmentation variation as the first step and use of computer-assisted segmentation tools as a second step as this study shows that manual segmentation of femoral metastatic lesions is highly challenging.

SUBMITTER: Ataei A

PROVIDER: S-EPMC8580934 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:PurposeThe aim was to quantify inter- and intra-observer variability in manually delineated hepatocellular carcinoma (HCC) lesion contours and the resulting impact on radioembolization (RE) dosimetry.MethodsTen patients with HCC lesions treated with Y-90 RE and imaged with post-therapy Y-90 PET/CT were selected for retrospective analysis. Three radiologists contoured 20 lesions manually on baseline multiphase contrast-enhanced MRIs, and two of the radiologists re-contoured at two additional sessions. Contours were transferred to co-registered PET/CT-based Y-90 dose maps. Volume-dependent recovery coefficients were applied for partial volume correction (PVC) when reporting mean absorbed dose. To understand how uncertainty varies with tumor size, we fit power models regressing relative uncertainty in volume and in mean absorbed dose on contour volume. Finally, we determined effects of segmentation uncertainty on tumor control probability (TCP), as calculated using logistic models developed in a previous RE study.ResultsThe average lesion volume ranged from 1.8 to 194.5 mL, and the mean absorbed dose ranged from 23.4 to 1629.0 Gy. The mean inter-observer Dice coefficient for lesion contours was significantly less than the mean intra-observer Dice coefficient (0.79 vs. 0.85, p < 0.001). Uncertainty in segmented volume, as measured by the Coefficient of Variation (CV), ranged from 4.2 to 34.7% with an average of 17.2%. The CV in mean absorbed dose had an average value of 5.4% (range 1.2-13.1%) without PVC while it was 15.1% (range 1.5-55.2%) with PVC. Using the fitted models for uncertainty as a function of volume on our prior data, the mean change in TCP due to segmentation uncertainty alone was estimated as 16.2% (maximum 48.5%).ConclusionsThough we find relatively high inter- and intra-observer reliability overall, uncertainty in tumor contouring propagates into non-negligible uncertainty in dose metrics and outcome prediction for individual cases that should be considered in dosimetry-guided treatment.

Project description:Muscle diffusion tensor imaging (mDTI) is a promising surrogate biomarker in the evaluation of muscular injuries and neuromuscular diseases. Since mDTI metrics are known to vary between different muscles, separation of different muscles is essential to achieve muscle-specific diffusion parameters. The commonly used technique to assess DTI metrics is parameter maps based on manual segmentation (MSB). Other techniques comprise tract-based approaches, which can be performed in a previously defined volume. This so-called volume-based tractography (VBT) may offer a more robust assessment of diffusion metrics and additional information about muscle architecture through tract properties. The purpose of this study was to assess DTI metrics of human calf muscles calculated with two segmentation techniques-MSB and VBT-regarding their inter-rater reliability in healthy and dystrophic calf muscles. 20 healthy controls and 18 individuals with different neuromuscular diseases underwent an MRI examination in a 3T scanner using a 16-channel Torso XL coil. DTI metrics were assessed in seven calf muscles using MSB and VBT. Coefficients of variation (CV) were calculated for both techniques. MSB and VBT were performed by two independent raters to assess inter-rater reliability by ICC analysis and Bland-Altman plots. Next to analysis of DTI metrics, the same assessments were also performed for tract properties extracted with VBT. For both techniques, low CV were found for healthy controls (≤13%) and neuromuscular diseases (≤17%). Significant differences between methods were found for all diffusion metrics except for λ1. High inter-rater reliability was found for both MSB and VBT (ICC ≥ 0.972). Assessment of tract properties revealed high inter-rater reliability (ICC ≥ 0.974). Both segmentation techniques can be used in the evaluation of DTI metrics in healthy controls and different NMD with low rater dependency and high precision but differ significantly from each other. Our findings underline that the same segmentation protocol must be used to ensure comparability of mDTI data.

Project description:BackgroundSeveral radiographic measurements of the humerus can be used to evaluate the treatment outcome of supracondylar fractures in children. Because of the cartilaginous nature of the immature elbow, interpretation of radiographs around this area is sometimes challenging and can be unreliable. This study was conducted to determine the inter-observer and intra-observer reliability of the six commonly used radiographic measurements of the distal humerus.MethodThe Baumann angle, humero-ulna angle, metaphyseal-diaphyseal angle, radial epiphyseal angle, shaft-condylar angle and lateral capitellohumeral angle of the humerus were measured by two observers on the radiographs of uninjured elbows from 58 children. The values between each measurement were compared and correlated using a Pearson coefficient of correlation to determine the inter-observer and intra-observer reliability.ResultsAll of the radiographic parameters showed excellent intra-observer reliability with the correlation coefficient values of the Baumann angle, humero-ulna angle, metaphyseal-diaphyseal angle, radial epiphyseal angle, shaft-condylar angle, lateral capitellohumeral angle as 0.945, 0.95, 0.909, 0.888, 0.961 and 0.975 (p < 0.001), respectively. The inter-observer reliability of the Baumann and humero-ulna angles were also found to be highly correlated at r = 0.843 (p < 0.001) and 0.878 (p < 0.001), respectively. The metaphyseal-diaphyseal angle had poor reliability with r = 0.136 (p = 0.291) while the radial epiphyseal angle, shaft-condylar angle, and lateral capitellohumeral angle demonstrated good reliability with r = 0.675 (p < 0.001), 0.747 (p < 0.001), and 0.686 (p < 0.001), respectively.ConclusionThe Baumann angle and humero-ulna angle measurements of distal humerus showed excellent inter- and intra-observer reliability. Both parameters represent repeatable and reliable methods for determining the outcome of supracondylar humeral fractures in pediatric population.