Dataset Information

Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging.

ABSTRACT: Diagnosing the causes of low back pain is a challenging task, prone to errors. A novel approach to increase diagnostic accuracy in medical decision making is collective intelligence, which refers to the ability of groups to outperform individual decision makers in solving problems. We investigated whether combining the independent ratings of chiropractors, chiropractic radiologists and medical radiologists can improve diagnostic accuracy when interpreting diagnostic images of the lumbosacral spine. Evaluations were obtained from two previously published studies: study 1 consisted of 13 raters independently rating 300 lumbosacral radiographs; study 2 consisted of 14 raters independently rating 100 lumbosacral magnetic resonance images. In both studies, raters evaluated the presence of "abnormalities", which are indicators of a serious health risk and warrant immediate further examination. We combined independent decisions of raters using a majority rule which takes as final diagnosis the decision of the majority of the group. We compared the performance of the majority rule to the performance of single raters. Our results show that with increasing group size (i.e., increasing the number of independent decisions) both sensitivity and specificity increased in both data-sets, with groups consistently outperforming single raters. These results were found for radiographs and MR image reading alike. Our findings suggest that combining independent ratings can improve the accuracy of lumbosacral diagnostic image reading.

SUBMITTER: Kurvers RHJM

PROVIDER: S-EPMC5882099 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundOperative indications for supination-external rotation (SER) ankle fractures depend on the integrity of the medial structures. Despite the importance of assessing deep deltoid ligament injuries, the accuracy of common diagnostic tests has not been established.Questions/purposesThe objective of this study was to compare the ability of injury (non-stress) and stress radiographs and magnetic resonance imaging (MRI) to diagnose deep deltoid ligament ruptures in operative SER ankle fractures.MethodsPatients were included who underwent surgical fixation of SER ankle fractures and had appropriate injury and manual stress test radiographs, pre-operative ankle MRI, and intra-operative assessment of deep deltoid integrity by direct visualization. The medial clear space (MCS) was considered positive for all values over 5 mm on the injury or stress mortise radiographs. MRI analysis of the deep deltoid ligament injury was performed by blinded fellowship-trained musculoskeletal radiologists. Intra-operative direct visualization and assessment of the deltoid was performed using a direct medial ankle approach at the time of operative fracture fixation.ResultsUsing intra-operative visualization as the gold standard, MCS measurements and MRI had differing abilities to diagnose a deep deltoid rupture. In cases where the MCS was less than 5 mm on injury radiographs and stress tests were performed, MCS measurements were much less accurate than MRI in predicting deltoid ruptures (46% versus 79%, respectively) with a high false positive rate (80%). In contrast, an MCS measurement of greater than 5 mm on injury radiographs was a strong predictor of deep deltoid rupture (accuracy of 95%).ConclusionCompared with direct visualization of the deltoid ligament intra-operatively, these data support proceeding with surgery when the MCS on injury radiographs is greater than 5 mm without any additional stress tests or advanced imaging. When the MCS is less than 5 mm, we recommend MRI analysis because of its increased accuracy and decreased false positive rate. Improving our ability to diagnose deltoid ruptures will contribute to more effective management of patients with SER ankle fractures.

Project description:BackgroundMyocardial perfusion cardiovascular magnetic resonance (CMR) is a well-established method for detection of ischemic heart disease. However, ECG gating problems can result in image degradation and non-diagnostic scans, particularly in patients with arrhythmias.MethodsA turboFLASH saturation recovery pulse sequence was used without any ECG triggering. One saturation pulse followed by 4-5 slices of undersampled radial k-space images was acquired rapidly, on the order of 40-50 msec per image. The acquisition of the set of 4-5 slices was continuously repeated approximately 4 times per second. An iterative constrained reconstruction method was used to reconstruct the ungated images. The ungated perfusion images were post-processed into three different sets of images (ungated, self-gated to near systole, and self-gated to near diastole). To test the ungated approach and compare the different processing methods, 8 patients scheduled for coronary angiography underwent stress and rest perfusion imaging with the ungated acquisition. Six patients had a history of atrial fibrillation (AF). Three blinded readers assessed image quality and presence/absence of disease.ResultsAll 8 subjects successfully completed the perfusion CMR protocol and 7/8 underwent coronary angiography. Three patients were in atrial fibrillation during CMR. Overall, the CMR images were of high quality as assessed by the three readers. There was little difference in image quality between patients in AF compared to those in sinus rhythm (3.6±0.7 vs. 3.3±0.5). Stress/rest perfusion imaging showed normal perfusion in 4 patients, fixed perfusion defects in 2 patients, and reversible perfusion defects in 2 patients, corresponding with angiographic results. Pooled results from the independent readers gave a sensitivity of 0.92 (CI 0.65-0.99) and specificity of 0.92 (CI 0.65-0.99) for the detection of coronary artery disease using ungated perfusion imaging. The same sensitivity, and a specificity of 1 (CI 0.76-1), was achieved when the images were self-gated after acquisition into near systole or near diastole.ConclusionsUngated radial dynamic perfusion CMR can give high quality imaging in patients in sinus rhythm and during atrial fibrillation. In this small cohort, high diagnostic accuracy was possible with this rapid perfusion imaging sequence. An ungated approach simplifies the acquisition and could expand the role of perfusion CMR to include patients with arrhythmia and those with gating problems.

Project description:BackgroundChest radiography to diagnose and screen for pulmonary tuberculosis has limitations, especially due to inter-reader variability. Automating the interpretation has the potential to overcome this drawback and to deliver objective and reproducible results. The CAD4TB software is a computer-aided detection system that has shown promising preliminary findings. Evaluation studies in different settings are needed to assess diagnostic accuracy and practicability of use.MethodsCAD4TB was evaluated on chest radiographs of patients with symptoms suggestive of pulmonary tuberculosis enrolled in two cohort studies in Tanzania. All patients were characterized by sputum smear microscopy and culture including subsequent antigen or molecular confirmation of Mycobacterium tuberculosis (M.tb) to determine the reference standard. Chest radiographs were read by the software and two human readers, one expert reader and one clinical officer. The sensitivity and specificity of CAD4TB was depicted using receiver operating characteristic (ROC) curves, the area under the curve calculated and the performance of the software compared to the results of human readers.ResultsOf 861 study participants, 194 (23%) were culture-positive for M.tb. The area under the ROC curve of CAD4TB for the detection of culture-positive pulmonary tuberculosis was 0.84 (95% CI 0.80-0.88). CAD4TB was significantly more accurate for the discrimination of smear-positive cases against non TB patients than for smear-negative cases (p-value<0.01). It differentiated better between TB cases and non TB patients among HIV-negative compared to HIV-positive individuals (p<0.01). CAD4TB significantly outperformed the clinical officer, but did not reach the accuracy of the expert reader (p = 0.02), for a tuberculosis specific reading threshold.ConclusionCAD4TB accurately distinguished between the chest radiographs of culture-positive TB cases and controls. Further studies on cost-effectiveness, operational and ethical aspects should determine its place in diagnostic and screening algorithms.

Dataset Information

Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets