Diagnostic accuracy of tablet-based software for the detection of concussion.
Ontology highlight
ABSTRACT:
SUBMITTER: Yang S
PROVIDER: S-EPMC5501428 | biostudies-literature | 2017
REPOSITORIES: biostudies-literature
Publications
Diagnostic accuracy of tablet-based software for the detection of concussion.
Yang Suosuo S Flores Benjamin B Magal Rotem R Harris Kyrsti K Gross Jonathan J Ewbank Amy A Davenport Sasha S Ormachea Pablo P Nasser Waleed W Le Weidong W Peacock W Frank WF Katz Yael Y Eagleman David M DM
PloS one 20170707 7
Despite the high prevalence of traumatic brain injuries (TBI), there are few rapid and straightforward tests to improve its assessment. To this end, we developed a tablet-based software battery ("BrainCheck") for concussion detection that is well suited to sports, emergency department, and clinical settings. This article is a study of the diagnostic accuracy of BrainCheck. We administered BrainCheck to 30 TBI patients and 30 pain-matched controls at a hospital Emergency Department (ED), and 538 ...[more]
Similar Datasets
Project description:The objective of this paper is to describe general approaches of diagnostic test accuracy (DTA) that are available for the quantitative synthesis of data using R software. We conduct a DTA that summarizes statistics for univariate analysis and bivariate analysis. The package commands of R software were "metaprop" and "metabin" for sensitivity, specificity, and diagnostic odds ratio; forest for forest plot; reitsma of "mada" for a summarized receiver-operating characteristic (ROC) curve; and "metareg" for meta-regression analysis. The estimated total effect sizes, test for heterogeneity and moderator effect, and a summarized ROC curve are reported using R software. In particular, we focus on how to calculate the effect sizes of target studies in DTA. This study focuses on the practical methods of DTA rather than theoretical concepts for researchers whose fields of study were non-statistics related. By performing this study, we hope that many researchers will use R software to determine the DTA more easily, and that there will be greater interest in related research.
| S-EPMC6545496 | biostudies-literature
Project description:ObjectivesTo investigate the impact of deep learning (DL) on radiologists' detection accuracy and reading efficiency of rib fractures on CT.MethodsBlunt chest trauma patients (n = 198) undergoing thin-slice CT were enrolled. Images were read by two radiologists (R1, R2) in three sessions: S1, unassisted reading; S2, assisted by DL as the concurrent reader; S3, DL as the second reader. The fractures detected by the readers and total reading time were documented. The reference standard for rib fractures was established by an expert panel. The sensitivity and false-positives per scan were calculated and compared among S1, S2, and S3.ResultsThe reference standard identified 865 fractures on 713 ribs (102 patients) The sensitivity of S1, S2, and S3 was 82.8, 88.9, and 88.7% for R1, and 83.9, 88.7, and 88.8% for R2, respectively. The sensitivity of S2 and S3 was significantly higher compared to S1 for both readers (all p < 0.05). The sensitivity between S2 and S3 did not differ significantly (both p > 0.9). The false-positive per scan had no difference between sessions for R1 (p = 0.24) but was lower for S2 and S3 than S1 for R2 (both p < 0.05). Reading time decreased by 36% (R1) and 34% (R2) in S2 compared to S1.ConclusionsUsing DL as a concurrent reader can improve the detection accuracy and reading efficiency for rib fracture.Advances in knowledgeDL can be integrated into the radiology workflow to improve the accuracy and reading efficiency of CT rib fracture detection.
| S-EPMC7934317 | biostudies-literature
Project description:PURPOSE:To investigate the diagnostic performance of perfusion single-photon emission computed tomography/computed tomography (Q-SPECT/CT) in patients suspected to have pulmonary embolism (PE) but with indeterminate computed tomographic pulmonary angiography (CTPA) or planar ventilation/perfusion (V/Q) scans. METHODS:This retrospective study included two groups of patients. Group I consisted of 49 patients with nondiagnostic CTPA. These 49 patients underwent subsequent V/Q scans. Further Q-SPECTs were obtained in patients with indeterminate planar images and fused with existing CTPA. Group II consisted of 182 non-CTPA patients with indeterminate V/Q scans. These 182 patients underwent further Q-SPECT and separate noncontrast low-dose CT chest. Fusion Q-SPECT/CT scans were obtained through FDA-approved software and interpreted according to published criteria as positive, negative, or indeterminate for PE. Upon retrospective analyses, the final diagnosis was made using composite reference standards including all available clinical and imaging information for at least 6-month follow-up. RESULTS:In group I patients, 1 was positive, 24 were negative, and another 24 (49 %, 24/49) were indeterminate. In the subsequent 24 Q-SPECT/CTPAs, 4 were positive, 19 were negative, and 1 was indeterminate (4.2 %, 1/24). In group II patients, 9 (4.9 %, 9/182) were indeterminate, 33 were positive, and 140 were negative. The combined nondiagnostic rate for Q-SPECT/CT was only 4.9 % (10/206). There was six false-negative and one false-positive Q-SPECT/CT examinations. The sensitivity, specificity, and positive and negative predictive value of Q-SPECT/CT were 85.7 % (36/42), 99.4 % (153/154), 97.3 % (36/37) and 96.2 % (153/159), respectively. CONCLUSIONS:Q-SPECT/CT improves the diagnostic rate with promising accuracy in diagnosing PE that yields a satisfactory clinical verdict, especially when the CTPA and planar V/Q scan are indeterminate.
| S-EPMC4630324 | biostudies-literature
Project description:Screening and diagnostic tests are applied for the classification of people into diseased and non-diseased populations. Although diagnostic accuracy measures are used to evaluate the correctness of classification in clinical research and practice, there has been limited research on their uncertainty. The objective for this work was to develop a tool for calculating the uncertainty of diagnostic accuracy measures, as diagnostic accuracy is fundamental to clinical decision-making. For this reason, the freely available interactive program Diagnostic Uncertainty has been developed in the Wolfram language. The program provides six modules with nine submodules for calculating and plotting the standard measurement, sampling and combined uncertainty and the resultant confidence intervals of various diagnostic accuracy measures of screening or diagnostic tests, which measure a normally distributed measurand, applied at a single point in time in samples of non-diseased and diseased populations. This is done for differing sample sizes, mean and standard deviation of the measurand, diagnostic threshold and standard measurement uncertainty of the test. The application of the program is demonstrated with an illustrative example of glucose measurements in samples of diabetic and non-diabetic populations, that shows the calculation of the uncertainty of diagnostic accuracy measures. The presented interactive program is user-friendly and can be used as a flexible educational and research tool in medical decision-making, to calculate and explore the uncertainty of diagnostic accuracy measures.
| S-EPMC7997227 | biostudies-literature
Project description:BACKGROUND:The Veterans Affairs Portland Healthcare System developed a medication history collection software that displays prescription names and medication images. OBJECTIVE:This article measures the frequency of medication discrepancy reporting using the medication history collection software and compares with the frequency of reporting using a paper-based process. This article also determines the accuracy of each method by comparing both strategies to a best possible medication history. STUDY DESIGN:Randomized, controlled, single-blind trial. SETTING:Three community-based primary care clinics associated with the Veterans Affairs Portland Healthcare System: a 300-bed teaching facility and ambulatory care network serving Veteran soldiers in the Pacific Northwest United States. PARTICIPANTS:Of 212 patients with primary care appointments, 209 patients fulfilled the study requirements. INTERVENTION:Patients randomized to a software-directed medication history or a paper-based medication history. Randomization and allocation to treatment groups were performed using a computer-based random number generator. Assignments were placed in a sealed envelope and opened after participant consent. The research coordinator did not know or have access to the treatment assignment until the time of presentation. MAIN OUTCOME MEASURES:The primary analysis compared the discrepancy detection rates between groups with respect to the health record and a best possible medication history. RESULTS:Of 3,500 medications reviewed, we detected 1,435 discrepancies. Forty-six percent of those discrepancies were potentially high risk for causing an adverse drug event. There was no difference in detection rates between treatment arms. Software sensitivity was 83% and specificity was 91%; paper sensitivity was 81% and specificity was 94%. No participants were lost to follow-up. CONCLUSION:The medication history collection software is an efficient and scalable method for gathering a medication history and detecting high-risk discrepancies. Although it included medication images, the technology did not improve accuracy over a paper list when compared with a best possible medication history. TRIAL REGISTRATION:ClinicalTrials.gov Identifier: NCT02135731.
| S-EPMC5931918 | biostudies-literature
Project description:Screening and diagnostic tests are used to classify people with and without a disease. Diagnostic accuracy measures are used to evaluate the correctness of a classification in clinical research and practice. Although this depends on the uncertainty of measurement, there has been limited research on their relation. The objective of this work was to develop an exploratory tool for the relation between diagnostic accuracy measures and measurement uncertainty, as diagnostic accuracy is fundamental to clinical decision-making, while measurement uncertainty is critical to quality and risk management in laboratory medicine. For this reason, a freely available interactive program was developed for calculating, optimizing, plotting and comparing various diagnostic accuracy measures and the corresponding risk of diagnostic or screening tests measuring a normally distributed measurand, applied at a single point in time in non-diseased and diseased populations. This is done for differing prevalence of the disease, mean and standard deviation of the measurand, diagnostic threshold, standard measurement uncertainty of the tests and expected loss. The application of the program is illustrated with a case study of glucose measurements in diabetic and non-diabetic populations. The program is user-friendly and can be used as an educational and research tool in medical decision-making.
| S-EPMC7555914 | biostudies-literature
Project description:BackgroundIn low resource settings, Salmonella serovars frequently cause bloodstream infections. This study investigated the diagnostic performance of immunochromatographic rapid diagnostic tests (RDTs), which detect Salmonella antigens, when applied to stored grown blood culture broth.Material/methodsThe SD Bioline One Step Salmonella Typhi Ag Rapid Detection Kit (Standard Diagnostics, Republic of Korea), marketed for the detection of Salmonella enterica serovar Typhi (Salmonella Typhi) in stool and the Salmonella Ag Rapid Test (Creative Diagnostics, USA), marketed for the detection of all Salmonella serotypes in stool, were selected for evaluation based on a pre-test evaluation of six RDT products. The limits of detection (LOD) for culture suspensions were established and the selected RDT products were assessed on 19 freshly grown spiked blood culture broth samples and 413 stored clinical blood culture broth samples, collected in Cambodia and the Democratic Republic of the Congo.ResultsThe LOD of both products was established as 107-108 CFU/ml. When applied to clinical blood culture broth samples, the diagnostic sensitivity and specificity of the SD Bioline RDT were respectively 100% and 79.7% for the detection of Salmonella Typhi; 94.4% (65/69) of false-positive results were caused by Salmonella Enteritidis. When considering the combined detection of Salmonella Typhi and Enteritidis (both group D Salmonella), sensitivity and specificity were 97.9% and 98.5% respectively. For Creative Diagnostics, diagnostic sensitivity was 78.3% and specificity 91.0% for all Salmonella serotypes combined; 88.3% (53/60) of false negative results were caused by Salmonella Paratyphi A.ConclusionsWhen applied to grown blood culture broths, the SD Bioline RDT had a good sensitivity and specificity for the detection of Salmonella Typhi and Salmonella Enteritidis. The Creative Diagnostics product had a moderate sensitivity and acceptable specificity for the detection of all Salmonella serovars combined and needs further optimization. A RDT that reliably detects Salmonella Paratyphi A is needed.
| S-EPMC5843332 | biostudies-literature
Project description:Nowadays, the gold standard method for malaria diagnosis is a staining of thick and thin blood film examined by expert laboratorists. It requires well-trained laboratorists, which is a time consuming task, and is un-automated protocol. For this study, Maladiag Software was developed to predict malaria infection in suspected malaria patients. The demographic data of patients, examination for malaria parasites, and complete blood count (CBC) profiles were analyzed. Binary logistic regression was used to create the equation for the malaria diagnosis. The diagnostic parameters of the equation were tested on 4,985 samples (703 infected and 4,282 control samples). The equation indicated 81.2% sensitivity and 80.3% specificity for predicting infection of malaria. The positive likelihood and negative likelihood ratio were 4.12 (95% CI = 4.01-4.23) and 0.23 (95% CI = 0.22-0.25), respectively. This parameter also had odds ratios (P value < 0.0001, OR = 17.6, 95% CI = 16.0-19.3). The equation can predict malaria infection after adjust for age, gender, nationality, monocyte (%), platelet count, neutrophil (%), lymphocyte (%), and the RBC count of patients. The diagnostic accuracy was 0.877 (Area under curve, AUC) (95% CI = 0.871-0.883). The system, when used in combination with other clinical and microscopy methods, might improve malaria diagnoses and enhance prompt treatment.
| S-EPMC4642325 | biostudies-other
Project description:ObjectivesTo predict kidney fibrosis in patients with chronic kidney disease using radiomics of two-dimensional ultrasound (B-mode) and Sound Touch Elastography (STE) images in combination with clinical features.MethodsThe Mindray Resona 7 ultrasonic diagnostic apparatus with SC5-1U convex array probe (bandwidth frequency of 1-5 MHz) was used to perform two-dimensional ultrasound and STE software. The severity of cortical tubulointerstitial fibrosis was divided into three grades: mild interstitial fibrosis and tubular atrophy (IFTA), fibrotic area < 25%; moderate IFTA, fibrotic area 26-50%; and severe IFTA, fibrotic area > 50%. After extracting radiomics from B-mode and STE images in these patients, we analyzed two classification schemes: mild versus moderate-to-severe IFTA, and mild-to-moderate versus severe IFTA. A nomogram was constructed based on multiple logistic regression analyses, combining clinical and radiomics. The performance of the nomogram for differentiation was evaluated using receiver operating characteristic (ROC), calibration, and decision curves.ResultsA total of 150 patients undergoing kidney biopsy were enrolled (mild IFTA: n = 74; moderate IFTA: n = 33; severe IFTA: n = 43) and randomized into training (n = 105) and validation cohorts (n = 45). To differentiate between mild and moderate-to-severe IFTA, a nomogram incorporating STE radiomics, albumin, and estimated glomerular filtration (eGFR) rate achieved an area under the ROC curve (AUC) of 0.91 (95% confidence interval [CI]: 0.85-0.97) and 0.85 (95% CI: 0.77-0.98) in the training and validation cohorts, respectively. Between mild-to-moderate and severe IFTA, the nomogram incorporating B-mode and STE radiomics features, age, and eGFR achieved an AUC of 0.93 (95% CI: 0.89-0.98) and 0.83 (95% CI: 0.70-0.95) in the training and validation cohorts, respectively. Finally, we performed a decision curve analysis and found that the nomogram using both radiomics and clinical features exhibited better predictability than any other model (DeLong test, p < 0.05 for the training and validation cohorts).ConclusionA nomogram based on two-dimensional ultrasound and STE radiomics and clinical features served as a non-invasive tool capable of differentiating kidney fibrosis of different severities.Key points• Radiomics calculated based on the ultrasound imaging may be used to predict the severities of kidney fibrosis. • Radiomics may be used to identify clinical features associated with the progression of tubulointerstitial fibrosis in patients with CKD. • Non-invasive ultrasound imaging-based radiomics method with accuracy aids in detecting renal fibrosis with different IFTA severities.
| S-EPMC10017610 | biostudies-literature
Project description:Overall accuracy measures of medical tests are often used with unclear interpretations. To develop methods of calculating the overall accuracy of medical tests in the patient population. Algebraic equations based on Bayes' theorem. A new approach is proposed for calculating overall accuracy in the patient population. Examples and applications using published data are presented. The overall accuracy is the proportion of the correct test results. We introduce a clear distinction between the overall accuracy measures of medical tests that are aimed at the detection of a disease in a screening of populations for public health purposes in the general population and the overall accuracy measures of tests aimed at determining a diagnosis in individuals in a clinical setting. We show that the overall detection accuracy measure is obtained in a specific study that explores test accuracy among persons with known diagnoses and may be useful for public health screening tests. It is different from the overall diagnostic accuracy that could be calculated in the clinical setting for the evaluation of medical tests aimed at determining the individual patients' diagnoses. We show that the overall detection accuracy is constant and is not affected by the prevalence of the disease. In contrast, the overall diagnostic accuracy changes and is dependent on the prevalence. Moreover, it ranges according to the ratio between the sensitivity and specificity. Thus, when the sensitivity is greater than the specificity, the overall diagnostic accuracy increases with increasing prevalence, and vice versa, that is, when the sensitivity is lower than the specificity, the overall diagnostic accuracy decreases with increasing prevalence so that another test might be more useful for diagnostic procedures. Our paper suggests a new and more appropriate methodology for estimating the overall diagnostic accuracy of any medical test. This may be important for helping clinicians avoid errors.
| S-EPMC6186004 | biostudies-literature