Dataset Information

Usage Patterns of Web-Based Stroke Calculators in Clinical Decision Support: Retrospective Analysis.

ABSTRACT:

Background

Clinical scores are frequently used in the diagnosis and management of stroke. While medical calculators are increasingly important support tools for clinical decisions, the uptake and use of common medical calculators for stroke remain poorly characterized.

Objective

We aimed to describe use patterns in frequently used stroke-related medical calculators for clinical decisions from a web-based support system.

Methods

We conducted a retrospective study of calculators from MDCalc, a web-based and mobile app-based medical calculator platform based in the United States. We analyzed metadata tags from MDCalc's calculator use data to identify all calculators related to stroke. Using relative page views as a measure of calculator use, we determined the 5 most frequently used stroke-related calculators between January 2016 and December 2018. For all 5 calculators, we determined cumulative and quarterly use, mode of access (eg, app or web browser), and both US and international distributions of use. We compared cumulative use in the 2016-2018 period with use from January 2011 to December 2015.

Results

Over the study period, we identified 454 MDCalc calculators, of which 48 (10.6%) were related to stroke. Of these, the 5 most frequently used calculators were the CHA₂DS₂-VASc score for atrial fibrillation stroke risk calculator (5.5% of total and 32% of stroke-related page views), the Mean Arterial Pressure calculator (2.4% of total and 14.0% of stroke-related page views), the HAS-BLED score for major bleeding risk (1.9% of total and 11.4% of stroke-related page views), the National Institutes of Health Stroke Scale (NIHSS) score calculator (1.7% of total and 10.1% of stroke-related page views), and the CHADS₂ score for atrial fibrillation stroke risk calculator (1.4% of total and 8.1% of stroke-related page views). Web browser was the most common mode of access, accounting for 82.7%-91.2% of individual stroke calculator page views. Access originated most frequently from the most populated regions within the United States. Internationally, use originated mostly from English-language countries. The NIHSS score calculator demonstrated the greatest increase in page views (238.1% increase) between the first and last quarters of the study period.

Conclusions

The most frequently used stroke calculators were the CHA₂DS₂-VASc, Mean Arterial Pressure, HAS-BLED, NIHSS, and CHADS₂. These were mainly accessed by web browser, from English-speaking countries, and from highly populated areas. Further studies should investigate barriers to stroke calculator adoption and the effect of calculator use on the application of best practices in cerebrovascular disease.

SUBMITTER: Kummer B

PROVIDER: S-EPMC8369374 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThere is a pressing need for digital tools that can leverage big data to help clinicians select effective antibiotic treatments in the absence of timely susceptibility data. Clinical presentation and local epidemiology can inform therapy selection to balance the risk of antimicrobial resistance and patient risk. However, data and clinical expertise must be appropriately integrated into clinical workflows.ObjectiveThe aim of this study is to leverage available data in electronic health records, to develop a data-driven, user-centered, clinical decision support system to navigate patient safety and population health.MethodsWe analyzed 5 years of susceptibility testing (1,078,510 isolates) and patient data (30,761 patients) across a large academic medical center. After curating the data according to the Clinical and Laboratory Standards Institute guidelines, we analyzed and visualized the impact of risk factors on clinical outcomes. On the basis of this data-driven understanding, we developed a probabilistic algorithm that maps these data to individual cases and implemented iBiogram, a prototype digital empiric antimicrobial clinical decision support system, which we evaluated against actual prescribing outcomes.ResultsWe determined patient-specific factors across syndromes and contexts and identified relevant local patterns of antimicrobial resistance by clinical syndrome. Mortality and length of stay differed significantly depending on these factors and could be used to generate heuristic targets for an acceptable risk of underprescription. Combined with the developed remaining risk algorithm, these factors can be used to inform clinicians' reasoning. A retrospective comparison of the iBiogram-suggested therapies versus the actual prescription by physicians showed similar performance for low-risk diseases such as urinary tract infections, whereas iBiogram recognized risk and recommended more appropriate coverage in high mortality conditions such as sepsis.ConclusionsThe application of such data-driven, patient-centered tools may guide empirical prescription for clinicians to balance morbidity and mortality with antimicrobial stewardship.

Project description:Importance: Early mobilization, out-of-bed activity, is a component of acute stroke unit care; however, stroke patient heterogeneity requires complex decision-making. Clinically credible and applicable CPGs are needed to support and optimize the delivery of care. In this study, we are specifically exploring the role of clinical practice guidelines to support individual patient-level decision-making by stroke clinicians about early mobilization post-stroke. Methods: Our study uses a novel, two-pronged approach. (1) A review of CPGs containing recommendations for early mobilization practices published after 2015 was appraised using purposely selected items from the Appraisal of Guidelines Research and Evaluation-Recommendations Excellence (AGREE-REX) tool relevant to decision-making for clinicians. (2) A cross-sectional study involving semi-structured interviews with Australian expert stroke clinicians representing content experts and CPG target users. Every CPG was independently assessed against the AGREE-REX standard by two reviewers. Expert stroke clinicians, invited via email, were recruited between June 2019 to March 2020.The main outcomes from the review was the proportion of criteria addressed for each AGREE-REX item by individual and all CPG(s). The main cross-sectional outcomes were the distributions of stroke clinicians' responses about the utility of CPGs, specific areas of uncertainty in early mobilization decision-making, and suggested parameters for inclusion in future early mobilization CPGs. Results: In 18 identified CPGs, many did not adequately address the "Evidence" and "Applicability to Patients" AGREE-REX items. Out of 30 expert stroke clinicians (11 physicians [37%], 11 physiotherapists [37%], 8 nurses [26%]; median [IQR] years of experience, 14 [10-25]), 47% found current CPGs "too broad or vague," while 40% rely on individual clinical judgement and interpretation of the evidence to select an evidence-based choice of action. The areas of uncertainty in decision-making revealed four key suggestions: (1) more granular descriptions of patient and stroke characteristics for appropriate tailoring of decisions, (2) clear statements about when clinical flexibility is appropriate, (3) detailed description of the intervention dose, and (4) physical assessment criteria including safety parameters. Conclusions: The lack of specificity, clinical applicability, and adaptability of current CPGs to effectively respond to the heterogeneous clinical stroke context has provided a clear direction for improvement.

Project description:BackgroundDispleasure with the functionality of clinical decision support systems (CDSSs) is considered the primary challenge in CDSS development. A major difficulty in CDSS design is matching the functionality to the desired and actual clinical workflow. Computer-interpretable guidelines (CIGs) are used to formalize medical knowledge in clinical practice guidelines (CPGs) in a computable language. However, existing CIG frameworks require a specific interpreter for each CIG language, hindering the ease of implementation and interoperability.ObjectiveThis paper aims to describe a different approach to the representation of clinical knowledge and data. We intended to change the clinician's perception of a CDSS with sufficient expressivity of the representation while maintaining a small communication and software footprint for both a web application and a mobile app. This approach was originally intended to create a readable and minimal syntax for a web CDSS and future mobile app for antenatal care guidelines with improved human-computer interaction and enhanced usability by aligning the system behavior with clinical workflow.MethodsWe designed and implemented an architecture design for our CDSS, which uses the model-view-controller (MVC) architecture and a knowledge engine in the MVC architecture based on XML. The knowledge engine design also integrated the requirement of matching clinical care workflow that was desired in the CDSS. For this component of the design task, we used a work ontology analysis of the CPGs for antenatal care in our particular target clinical settings.ResultsIn comparison to other common CIGs used for CDSSs, our XML approach can be used to take advantage of the flexible format of XML to facilitate the electronic sharing of structured data. More importantly, we can take advantage of its flexibility to standardize CIG structure design in a low-level specification language that is ubiquitous, universal, computationally efficient, integrable with web technologies, and human readable.ConclusionsOur knowledge representation framework incorporates fundamental elements of other CIGs used in CDSSs in medicine and proved adequate to encode a number of antenatal health care CPGs and their associated clinical workflows. The framework appears general enough to be used with other CPGs in medicine. XML proved to be a language expressive enough to describe planning problems in a computable form and restrictive and expressive enough to implement in a clinical system. It can also be effective for mobile apps, where intermittent communication requires a small footprint and an autonomous app. This approach can be used to incorporate overlapping capabilities of more specialized CIGs in medicine.

Project description:BackgroundCCR5-coreceptor antagonists can be used for treating HIV-2 infected individuals. Before initiating treatment with coreceptor antagonists, viral coreceptor usage should be determined to ensure that the virus can use only the CCR5 coreceptor (R5) and cannot evade the drug by using the CXCR4 coreceptor (X4-capable). However, until now, no online tool for the genotypic identification of HIV-2 coreceptor usage had been available. Furthermore, there is a lack of knowledge on the determinants of HIV-2 coreceptor usage. Therefore, we developed a data-driven web service for the prediction of HIV-2 coreceptor usage from the V3 loop of the HIV-2 glycoprotein and used the tool to identify novel discriminatory features of X4-capable variants.ResultsUsing 10 runs of tenfold cross validation, we selected a linear support vector machine (SVM) as the model for geno2pheno[coreceptor-hiv2], because it outperformed the other SVMs with an area under the ROC curve (AUC) of 0.95. We found that SVMs were highly accurate in identifying HIV-2 coreceptor usage, attaining sensitivities of 73.5% and specificities of 96% during tenfold nested cross validation. The predictive performance of SVMs was not significantly different (p value 0.37) from an existing rules-based approach. Moreover, geno2pheno[coreceptor-hiv2] achieved a predictive accuracy of 100% and outperformed the existing approach on an independent data set containing nine new isolates with corresponding phenotypic measurements of coreceptor usage. geno2pheno[coreceptor-hiv2] could not only reproduce the established markers of CXCR4-usage, but also revealed novel markers: the substitutions 27K, 15G, and 8S were significantly predictive of CXCR4 usage. Furthermore, SVMs trained on the amino-acid sequences of the V1 and V2 loops were also quite accurate in predicting coreceptor usage (AUCs of 0.84 and 0.65, respectively).ConclusionsIn this study, we developed geno2pheno[coreceptor-hiv2], the first online tool for the prediction of HIV-2 coreceptor usage from the V3 loop. Using our method, we identified novel amino-acid markers of X4-capable variants in the V3 loop and found that HIV-2 coreceptor usage is also influenced by the V1/V2 region. The tool can aid clinicians in deciding whether coreceptor antagonists such as maraviroc are a treatment option and enables epidemiological studies investigating HIV-2 coreceptor usage. geno2pheno[coreceptor-hiv2] is freely available at http://coreceptor-hiv2.geno2pheno.org .

Project description:Significant underutilization of breast cancer chemoprevention remains, despite guidelines stating that physicians should recommend chemoprevention with antiestrogen therapy to high-risk women. We randomized women, ages 35 to 75 years, who met high-risk criteria for breast cancer, without a personal history of breast cancer or prior chemoprevention use, to standard educational materials alone or combined with a web-based decision aid. All healthcare providers, including primary care providers and breast specialists, were given access to a web-based decision support tool. The primary endpoint was chemoprevention uptake at 6 months. Secondary outcomes included decision antecedents (perceived breast cancer risk/worry, chemoprevention knowledge, self-efficacy) and decision quality (decision conflict, chemoprevention informed choice) based upon patient surveys administered at baseline, 1 and 6 months after randomization. Among 282 evaluable high-risk women enrolled from November 2016 to March 2020, mean age was 57 years (SD, 9.9) and mean 5-year invasive breast cancer risk was 2.98% (SD, 1.42). There was no significant difference in chemoprevention uptake at 6 months between the intervention and control groups (2.1% vs. 3.5%). Comparing the intervention and control arms at 1 month, there were significant differences among high-risk women in accurate breast cancer risk perceptions (56% vs. 39%, P = 0.017), adequate chemoprevention knowledge (49% vs. 27%, P < 0.001), mean decision conflict (34.0 vs. 47.0, P < 0.001), and informed choice (41% vs. 23%, P = 0.003). These differences were no longer significant at 6 months. Although our decision support tools did not result in a significant increase in chemoprevention uptake, we did observe improvements in decision antecedents and decision quality measures.Prevention relevanceIn this randomized controlled trial of decision support for 300 high-risk women and 50 healthcare providers, we did not observe a significant increase in chemoprevention uptake, which remained low at under 5%. However, these decision support tools may increase knowledge and informed choice about breast cancer chemoprevention.

Project description:BackgroundApproximately two-thirds of patients with major depressive disorder do not achieve remission during their first treatment. There has been increasing interest in the use of digital, artificial intelligence-powered clinical decision support systems (CDSSs) to assist physicians in their treatment selection and management, improving the personalization and use of best practices such as measurement-based care. Previous literature shows that for digital mental health tools to be successful, the tool must be easy for patients and physicians to use and feasible within existing clinical workflows.ObjectiveThis study aims to examine the feasibility of an artificial intelligence-powered CDSS, which combines the operationalized 2016 Canadian Network for Mood and Anxiety Treatments guidelines with a neural network-based individualized treatment remission prediction.MethodsOwing to the COVID-19 pandemic, the study was adapted to be completed entirely remotely. A total of 7 physicians recruited outpatients diagnosed with major depressive disorder according to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria. Patients completed a minimum of one visit without the CDSS (baseline) and 2 subsequent visits where the CDSS was used by the physician (visits 1 and 2). The primary outcome of interest was change in appointment length after the introduction of the CDSS as a proxy for feasibility. Feasibility and acceptability data were collected through self-report questionnaires and semistructured interviews.ResultsData were collected between January and November 2020. A total of 17 patients were enrolled in the study; of the 17 patients, 14 (82%) completed the study. There was no significant difference in appointment length between visits (introduction of the tool did not increase appointment length; F2,24=0.805; mean squared error 58.08; P=.46). In total, 92% (12/13) of patients and 71% (5/7) of physicians felt that the tool was easy to use; 62% (8/13) of patients and 71% (5/7) of physicians rated that they trusted the CDSS. Of the 13 patients, 6 (46%) felt that the patient-clinician relationship significantly or somewhat improved, whereas 7 (54%) felt that it did not change.ConclusionsOur findings confirm that the integration of the tool does not significantly increase appointment length and suggest that the CDSS is easy to use and may have positive effects on the patient-physician relationship for some patients. The CDSS is feasible and ready for effectiveness studies.Trial registrationClinicalTrials.gov NCT04061642; http://clinicaltrials.gov/ct2/show/NCT04061642.