Dataset Information

Systematic Review and Meta-Analysis of Vesical Imaging-Reporting and Data System (VI-RADS) Inter-Observer Reliability: An Added Value for Muscle Invasive Bladder Cancer Detection.

ABSTRACT: The Vesical Imaging-Reporting and Data System (VI-RADS) has been introduced to provide preoperative bladder cancer staging and has proved to be reliable in assessing the presence of muscle invasion in the pre-TURBT (trans-urethral resection of bladder tumor). We aimed to assess through a systematic review and meta-analysis the inter-reader variability of VI-RADS criteria for discriminating non-muscle vs. muscle invasive bladder cancer (NMIBC, MIBC). PubMed, Web of Science, Cochrane, and Embase were searched up until 30 July 2020. The Quality Appraisal of Diagnostic Reliability (QAREL) checklist was utilized to assess the quality of included studies and a pooled measure of inter-rater reliability (Cohen's Kappa [?] and/or Intraclass correlation coefficients (ICCs)) was calculated. Further sensitivity analysis, subgroup analysis, and meta-regression were conducted to investigate the contribution of moderators to heterogeneity. In total, eight studies between 2018 and 2020, which evaluated a total of 1016 patients via 21 interpreting genitourinary (GU) radiologists, met inclusion criteria and were critically examined. No study was considered to be significantly flawed with publication bias. The pooled weighted mean ? estimate was 0.83 (95%CI: 0.78-0.88). Heterogeneity was present among the studies (Q = 185.92, d.f. = 7, p < 0.001; I2 = 92.7%). Meta-regression analyses showed that the relative % of MIBC diagnosis and cumulative reader's experience to influence the estimated outcome (Coeff: 0.019, SE: 0.007; p= 0.003 and 0.036, SE: 0.009; p = 0.001). In the present study, we confirm excellent pooled inter-reader agreement of VI-RADS to discriminate NMIBC from MIBC underlying the importance that standardization and reproducibility of VI-RADS may confer to multiparametric magnetic resonance (mpMRI) for preoperative BCa staging.

SUBMITTER: Del Giudice F

PROVIDER: S-EPMC7602537 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Systematic Review and Meta-Analysis of Vesical Imaging-Reporting and Data System (VI-RADS) Inter-Observer Reliability: An Added Value for Muscle Invasive Bladder Cancer Detection.

Del Giudice Francesco F Pecoraro Martina M Vargas Hebert Alberto HA Cipollari Stefano S De Berardinis Ettore E Bicchetti Marco M Chung Benjamin I BI Catalano Carlo C Narumi Yoshifumi Y Catto James W F JWF Panebianco Valeria V

Cancers 20201015 10

The Vesical Imaging-Reporting and Data System (VI-RADS) has been introduced to provide preoperative bladder cancer staging and has proved to be reliable in assessing the presence of muscle invasion in the pre-TURBT (trans-urethral resection of bladder tumor). We aimed to assess through a systematic review and meta-analysis the inter-reader variability of VI-RADS criteria for discriminating non-muscle vs. muscle invasive bladder cancer (NMIBC, MIBC). PubMed, Web of Science, Cochrane, and Embase w ...[more]

PMID: 33076505

Similar Datasets

Project description:BackgroundThe treatment and prognosis for muscle-invasive bladder cancer (MIBC) and non-muscle-invasive bladder cancer (NMIBC) are different. We aimed to construct a nomogram based on the multiparametric MRI (mpMRI) radiomics signature and the Vesical Imaging-Reporting and Data System (VI-RADS) score for the preoperative differentiation of MIBC from NMIBC.MethodThe retrospective study involved 185 pathologically confirmed bladder cancer (BCa) patients (training set: 129 patients, validation set: 56 patients) who received mpMRI before surgery between August 2014 to April 2020. A total of 2,436 radiomics features were quantitatively extracted from the largest lesion located on the axial T2WI and from dynamic contrast-enhancement images. The minimum redundancy maximum relevance (mRMR) algorithm was used for feature screening. The selected features were introduced to construct radiomics signatures using three classifiers, including least absolute shrinkage and selection operator (LASSO), support vector machines (SVM) and random forest (RF) in the training set. The differentiation performances of the three classifiers were evaluated using the area under the curve (AUC) and accuracy. Univariable and multivariable logistic regression were used to develop a nomogram based on the optimal radiomics signature and clinical characteristics. The performance of the radiomics signatures and the nomogram was assessed and validated in the validation set.ResultsCompared to the RF and SVM classifiers, the LASSO classifier had the best capacity for muscle invasive status differentiation in both the training (accuracy: 90.7%, AUC: 0.934) and validation sets (accuracy: 87.5%, AUC: 0.906). Incorporating the radiomics signature and VI-RADS score, the nomogram demonstrated better discrimination and calibration both in the training set (accuracy: 93.0%, AUC: 0.970) and validation set (accuracy: 89.3%, AUC: 0.943). Decision curve analysis showed the clinical usefulness of the nomogram.ConclusionsThe mpMRI radiomics signature may be useful for the preoperative differentiation of muscle-invasive status in BCa. The proposed nomogram integrating the radiomics signature with the VI-RADS score may further increase the differentiation power and improve clinical decision making.

Project description:BACKGROUND:The METastasis Reporting and Data System for Prostate Cancer (MET-RADS-P) guidelines are designed to enable reproducible assessment in detecting and quantifying metastatic disease response using whole-body magnetic resonance imaging (WB-MRI) in patients with advanced prostate cancer (APC). The purpose of our study was to evaluate the inter-observer agreement of WB-MRI examination reports produced by readers of different expertise when using the MET-RADS-P guidelines. METHODS:Fifty consecutive paired WB-MRI examinations, performed from December 2016 to February 2018 on 31 patients, were retrospectively examined to compare reports by a Senior Radiologist (9?years of experience in WB-MRI) and Resident Radiologist (after a 6-months training) using MET-RADS-P guidelines, for detection and for primary/dominant and secondary response assessment categories (RAC) scores assigned to metastatic disease in 14 body regions. Inter-observer agreement regarding RAC score was evaluated for each region by using weighted-Cohen's Kappa statistics (K). RESULTS:The number of metastatic regions reported by the Senior Radiologist (249) and Resident Radiologist (251) was comparable. For the primary/dominant RAC pattern, the agreement between readers was excellent for the metastatic findings in cervical, dorsal, and lumbosacral spine, pelvis, limbs, lungs and other sites (K:0.81-1.0), substantial for thorax, retroperitoneal nodes, other nodes and liver (K:0.61-0.80), moderate for pelvic nodes (K:0.56), fair for primary soft tissue and not assessable for skull due to the absence of findings. For the secondary RAC pattern, agreement between readers was excellent for the metastatic findings in cervical spine (K:0.93) and retroperitoneal nodes (K:0.89), substantial for those in dorsal spine, pelvis, thorax, limbs and pelvic nodes (K:0.61-0.80), and moderate for lumbosacral spine (K:0.44). CONCLUSIONS:We found inter-observer agreement between two readers of different expertise levels to be excellent in bone, but mixed in other body regions. Considering the importance of bone metastases in patients with APC, our results favor the use of MET-RADS-P in response to the growing clinical need for monitoring of metastasis in these patients.

Project description:BackgroundMusculoskeletal disorders particularly in the back and lower extremities are common among marines. Here, movement-control tests are considered clinically useful for screening and follow-up evaluation. However, few studies have addressed the reliability of clinical tests, and no such published data exists for marines. The present aim was therefore to determine the inter- and intra-observer reliability of clinically convenient tests emphasizing movement control of the back and hip among marines. A secondary aim was to investigate the sensitivity and specificity of these clinical tests for discriminating musculoskeletal pain disorders in this group of military personnel.MethodsThis inter- and intra-observer reliability study used a test-retest approach with six standardized clinical tests focusing on movement control for back and hip. Thirty-three marines (age 28.7 yrs, SD 5.9) on active duty volunteered and were recruited. They followed an in-vivo observation test procedure that covered both low- and high-load (threshold) tasks relevant for marines on operational duty. Two independent observers simultaneously rated performance as "correct" or "incorrect" following a standardized assessment protocol. Re-testing followed 7-10 days thereafter. Reliability was analysed using kappa (κ) coefficients, while discriminative power of the best-fitting tests for back- and lower-extremity pain was assessed using a multiple-variable regression model.ResultsInter-observer reliability for the six tests was moderate to almost perfect with κ-coefficients ranging between 0.56-0.95. Three tests reached almost perfect inter-observer reliability with mean κ-coefficients > 0.81. However, intra-observer reliability was fair-to-moderate with mean κ-coefficients between 0.22-0.58. Three tests achieved moderate intra-observer reliability with κ-coefficients > 0.41. Combinations of one low- and one high-threshold test best discriminated prior back pain, but results were inconsistent for lower-extremity pain.ConclusionsOur results suggest that clinical tests of movement control of back and hip are reliable for use in screening protocols using several observers with marines. However, test-retest reproducibility was less accurate, which should be considered in follow-up evaluations. The results also indicate that combinations of low- and high-threshold tests have discriminative validity for prior back pain, but were inconclusive for lower-extremity pain.

Dataset Information

Systematic Review and Meta-Analysis of Vesical Imaging-Reporting and Data System (VI-RADS) Inter-Observer Reliability: An Added Value for Muscle Invasive Bladder Cancer Detection.

Publications

Systematic Review and Meta-Analysis of Vesical Imaging-Reporting and Data System (VI-RADS) Inter-Observer Reliability: An Added Value for Muscle Invasive Bladder Cancer Detection.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets