User-centred design of a clinical decision support system for palliative care: Insights from healthcare professionals.
Ontology highlight
ABSTRACT: Objective
Although clinical decision support systems (CDSS) have many benefits for clinical practice, they also have several barriers to their acceptance by professionals. Our objective in this study was to design and validate The Aleph palliative care (PC) CDSS through a user-centred method, considering the predictions of the artificial intelligence (AI) core, usability and user experience (UX).Methods
We performed two rounds of individual evaluation sessions with potential users. Each session included a model evaluation, a task test and a usability and UX assessment.Results
The machine learning (ML) predictive models outperformed the participants in the three predictive tasks. System Usability Scale (SUS) reported 62.7 ± 14.1 and 65 ± 26.2 on a 100-point rating scale for both rounds, respectively, while User Experience Questionnaire - Short Version (UEQ-S) scores were 1.42 and 1.5 on the -3 to 3 scale.Conclusions
The think-aloud method and including the UX dimension helped us to identify most of the workflow implementation issues. The system has good UX hedonic qualities; participants were interested in the tool and responded positively to it. Performance regarding usability was modest but acceptable.
SUBMITTER: Blanes-Selva V
PROVIDER: S-EPMC9837281 | biostudies-literature | 2023 Jan-Dec
REPOSITORIES: biostudies-literature
Publications
User-centred design of a clinical decision support system for palliative care: Insights from healthcare professionals.
Blanes-Selva Vicent V Asensio-Cuesta Sabina S Doñate-Martínez Ascensión A Pereira Mesquita Felipe F García-Gómez Juan M JM
Digital health 20230110
<h4>Objective</h4>Although clinical decision support systems (CDSS) have many benefits for clinical practice, they also have several barriers to their acceptance by professionals. Our objective in this study was to design and validate The <i>Aleph</i> palliative care (PC) CDSS through a user-centred method, considering the predictions of the artificial intelligence (AI) core, usability and user experience (UX).<h4>Methods</h4>We performed two rounds of individual evaluation sessions with potenti ...[more]
Similar Datasets
Project description:BACKGROUND:Emergency departments (EDs) frequently care for individuals with opioid use disorder (OUD). Buprenorphine (BUP) is an effective treatment option for patients with OUD that can safely be initiated in the ED. At present, BUP is rarely initiated as a part of routine ED care. Clinical decision support (CDS) could accelerate adoption of ED-initiated BUP into routine emergency care. OBJECTIVE:This study aimed to design and formatively evaluate a user-centered decision support tool for ED initiation of BUP for patients with OUD. METHODS:User-centered design with iterative prototype development was used. Initial observations and interviews identified workflows and information needs. The design team and key stakeholders reviewed prototype designs to ensure accuracy. A total of 5 prototypes were evaluated and iteratively refined based on input from 26 attending and resident physicians. RESULTS:Early feedback identified concerns with the initial CDS design: an alert with several screens. The timing of the alert led to quick dismissal without using the tool. User feedback on subsequent iterations informed the development of a flexible tool to support clinicians with varied levels of experience with the intervention by providing both one-click options for direct activation of care pathways and user-activated support for critical decision points. The final design resolved challenging navigation issues through targeted placement, color, and design of the decision support modules and care pathways. In final testing, users expressed that the tool could be easily learned without training and was reasonable for use during routine emergency care. CONCLUSIONS:A user-centered design process helped designers to better understand users' needs for a Web-based clinical decision tool to support ED initiation of BUP for OUD. The process identified varying needs across user experience and familiarity with the protocol, leading to a flexible design supporting both direct care pathways and user-initiated decision support.
| S-EPMC6414819 | biostudies-literature
Project description: Not available
| S-EPMC9556170 | biostudies-literature
Project description:BackgroundMobile health (mHealth) has the potential to improve access to healthcare, especially in developing countries. The proliferation of mHealth has not been accompanied by a corresponding growth in design guidelines for mHealth applications. This paper proposes a framework for mHealth application design that combines the Information Systems Research (ISR) framework and design thinking. We demonstrate a use case for the proposed framework in the form of an app to read the result of the tuberculin skin test (TST), which is used to screen for latent tuberculosis infection. The framework was used in the re-design of the TST reading app but could also be used in earlier stages of mHealth app design.MethodsThe ISR framework and design thinking were merged based on how the modes of design thinking integrate with the cycles of the ISR framework. Using the combined framework, we re-designed an mHealth app for TST reading, intended to be used primarily in a developing context by healthcare workers. Using the proposed framework, the app was iterated upon and developed with the aid of personas, observations, prototyping and questionnaires.ResultThe combined framework was applied through engagement with end-users, namely ten healthcare workers and ten graduate students. Through review of the literature and iterations of the app prototype, we identified various usability requirements and limitations. These included challenges related to image capture and a misunderstanding of instructions. These insights influenced the development and improvement of the app.ConclusionThe combined framework allowed for engagement with end-users and for low-cost, rapid development of the app while addressing contextual challenges and needs. The integration of design thinking modes with the ISR cycles was effective in achieving the objectives of each approach. The combined framework acknowledges the importance of engaging users when implementing mHealth technologies, especially in developing and under-resourced contexts. Findings from this study support the use of this framework as a guide in the design of user-centred mHealth interventions.
| S-EPMC7444488 | biostudies-literature
Project description:ObjectiveThe objective of this qualitative study is to gauge physician sentiment about an emergency department (ED) clinical decision support (CDS) system implemented in multiple adult EDs within a university hospital system. This CDS system focuses on predicting patients' likelihood of ED recidivism and/or adverse opioid-related events.MethodsThe study was conducted among adult emergency physicians working in three EDs of a single academic health system in Rhode Island. Qualitative, semistructured interviews were conducted with ED physicians. Interviews assessed physicians' prior experience with predictive analytics, thoughts on the alert's placement, design, and content, the alert's overall impact, and potential areas for improvement. Responses were aggregated and common themes identified.ResultsTwenty-three interviews were conducted (11 preimplementation and 12 postimplementation). Themes were identified regarding each physician familiarity with predictive analytics, alert rollout, alert appearance and content, and on alert sentiments. Most physicians viewed these alerts as a neutral or positive EHR addition, with responses ranging from neutral to positive. The alert placement was noted to be largely intuitive and nonintrusive. The design of the alert was generally viewed positively. The alert's content was believed to be accurate, although the decision to respond to the alert's call-to-action was physician dependent. Those who tended to ignore the alert did so for a few reasons, including already knowing the information the alert contains, the alert offering information that is not relevant to this particular patient, and the alert not containing enough information to be useful.ConclusionUltimately, this alert appears to have a marginally positive effect on ED physician workflow. At its most beneficial, the alert reminded physicians to deeply consider the care provided to high-risk populations and to potentially adjust their care and referrals. At its least beneficial, the alert did not affect physician decision-making but was not intrusive to the point of negatively impacting workflow.
| S-EPMC10482498 | biostudies-literature
Project description:BackgroundDespite the unprecedented performance of deep learning algorithms in clinical domains, full reviews of algorithmic predictions by human experts remain mandatory. Under these circumstances, artificial intelligence (AI) models are primarily designed as clinical decision support systems (CDSSs). However, from the perspective of clinical practitioners, the lack of clinical interpretability and user-centered interfaces hinders the adoption of these AI systems in practice.ObjectiveThis study aims to develop an AI-based CDSS for assisting polysomnographic technicians in reviewing AI-predicted sleep staging results. This study proposed and evaluated a CDSS that provides clinically sound explanations for AI predictions in a user-centered manner.MethodsOur study is based on a user-centered design framework for developing explanations in a CDSS that identifies why explanations are needed, what information should be contained in explanations, and how explanations can be provided in the CDSS. We conducted user interviews, user observation sessions, and an iterative design process to identify three key aspects for designing explanations in the CDSS. After constructing the CDSS, the tool was evaluated to investigate how the CDSS explanations helped technicians. We measured the accuracy of sleep staging and interrater reliability with macro-F1 and Cohen κ scores to assess quantitative improvements after our tool was adopted. We assessed qualitative improvements through participant interviews that established how participants perceived and used the tool.ResultsThe user study revealed that technicians desire explanations that are relevant to key electroencephalogram (EEG) patterns for sleep staging when assessing the correctness of AI predictions. Here, technicians wanted explanations that could be used to evaluate whether the AI models properly locate and use these patterns during prediction. On the basis of this, information that is closely related to sleep EEG patterns was formulated for the AI models. In the iterative design phase, we developed a different visualization strategy for each pattern based on how technicians interpreted the EEG recordings with these patterns during their workflows. Our evaluation study on 9 polysomnographic technicians quantitatively and qualitatively investigated the helpfulness of the tool. For technicians with <5 years of work experience, their quantitative sleep staging performance improved significantly from 56.75 to 60.59 with a P value of .05. Qualitatively, participants reported that the information provided effectively supported them, and they could develop notable adoption strategies for the tool.ConclusionsOur findings indicate that formulating clinical explanations for automated predictions using the information in the AI with a user-centered design process is an effective strategy for developing a CDSS for sleep staging.
| S-EPMC8811694 | biostudies-literature
Project description:BackgroundContinuously growing medical knowledge and the increasing amount of data make it difficult for medical professionals to keep track of all new information and to place it in the context of existing information. A variety of digital technologies and artificial intelligence-based methods are currently available as persuasive tools to empower physicians in clinical decision-making and improve health care quality. A novel diagnostic decision support system (DDSS) prototype developed by Ada Health GmbH with a focus on traceability, transparency, and usability will be examined more closely in this study.ObjectiveThe aim of this study is to test the feasibility and functionality of a novel DDSS prototype, exploring its potential and performance in identifying the underlying cause of acute dyspnea in patients at the University Hospital Basel.MethodsA prospective, observational feasibility study was conducted at the emergency department (ED) and internal medicine ward of the University Hospital Basel, Switzerland. A convenience sample of 20 adult patients admitted to the ED with dyspnea as the chief complaint and a high probability of inpatient admission was selected. A study physician followed the patients admitted to the ED throughout the hospitalization without interfering with the routine clinical work. Routinely collected health-related personal data from these patients were entered into the DDSS prototype. The DDSS prototype's resulting disease probability list was compared with the gold-standard main diagnosis provided by the treating physician.ResultsThe DDSS presented information with high clarity and had a user-friendly, novel, and transparent interface. The DDSS prototype was not perfectly suited for the ED as case entry was time-consuming (1.5-2 hours per case). It provided accurate decision support in the clinical inpatient setting (average of cases in which the correct diagnosis was the first diagnosis listed: 6/20, 30%, SD 2.10%; average of cases in which the correct diagnosis was listed as one of the top 3: 11/20, 55%, SD 2.39%; average of cases in which the correct diagnosis was listed as one of the top 5: 14/20, 70%, SD 2.26%) in patients with dyspnea as the main presenting complaint.ConclusionsThe study of the feasibility and functionality of the tool was successful, with some limitations. Used in the right place, the DDSS has the potential to support physicians in their decision-making process by showing new pathways and unintentionally ignored diagnoses. The DDSS prototype had some limitations regarding the process of data input, diagnostic accuracy, and completeness of the integrated medical knowledge. The results of this study provide a basis for the tool's further development. In addition, future studies should be conducted with the aim to overcome the current limitations of the tool and study design.Trial registrationClinicalTrials.gov NCT04827342; https://clinicaltrials.gov/ct2/show/NCT04827342.
| S-EPMC8990366 | biostudies-literature
Project description:ObjectiveLong-term acceptability among computerized clinical decision support system (CDSS) users in pediatrics is unknown. We examine user acceptance patterns over six years of our continuous computerized CDSS integration and updates.Materials and methodsUsers of Child Health Improvement through Computer Automation (CHICA), a CDSS integrated into clinical workflows and used in several urban pediatric community clinics, completed annual surveys including 11 questions covering user acceptability. We compared responses across years within a single healthcare system and between two healthcare systems. We used logistic regression to assess the odds of a favorable response to each question by survey year, clinic role, part-time status, and frequency of CHICA use.ResultsData came from 380 completed surveys between 2011 and 2016. Responses were significantly more favorable for all but one measure by 2016 (OR range 2.90-12.17, all p < 0.01). Increasing system maturity was associated with improved perceived function of CHICA (OR range 4.24-7.58, p < 0.03). User familiarity was positively associated with perceived CDSS function (OR range 3.44-8.17, p < 0.05) and usability (OR range 9.71-15.89, p < 0.01) opinions.ConclusionWe present a long-term, repeated follow-up of user acceptability of a CDSS. Favorable opinions of the CDSS were more likely in frequent users, physicians and advanced practitioners, and full-time workers. CHICA acceptability increased as it matured and users become more familiar with it. System quality improvement, user support, and patience are important in achieving wide-ranging, sustainable acceptance of CDSS.
| S-EPMC5836810 | biostudies-literature
Project description:Background:Isolation precautions are intended to prevent transmission of infectious agents, yet healthcare provider (HCP) adherence remains suboptimal. This may be due to ambiguity regarding the required precautions or to cognitive overload of HCPs. In response to the challenge of changing HCP behaviour, increasing attention should be paid to the role of engineering controls and facility design that incorporate human factors elements. In the current study, we aimed to develop an isolation precaution signage system that provides visual cues, serves as a cognitive aid at the point of care, and removes ambiguity regarding which precautions are necessary (e.g. masks, gowns, gloves, single rooms) when caring for isolated patients. Methods:We employed a user-centred, participatory design approach in which HCPs were actively involved in generating an isolation precaution signage system based on human factors design principles. HCPs were purposefully sampled for each design phase to include a representative sample of potential system users. We conducted front-end analysis through interviews and observations to identify challenges related to the existing signage and to establish design requirements for new signage. This was followed by the creation of user personas, design thinking workshops, and prototyping, which then underwent iterative cycles of evaluation. Graphical symbols were developed and tested for comprehensibility. Results:Front-end analysis revealed several barriers to use of the current signage system such as unclear target audience, low signal-to-noise ratio, and ambiguity regarding the applicable precautions. A comprehensive list of design requirements was generated. The project ultimately resulted in a collection of validated, comprehensible symbols and signs for contact, droplet, and airborne isolation, as well as the identification of several systems-level solutions for work re-organisation to improve compliance with isolation precautions. Conclusions:The introduction of visual cues in the form of signage offers a promising opportunity to make guidelines available directly at the frontline. Anecdotal evidence based on observations and interviews with HCP have shown that the current solution is superior to previous isolation signage. User-centred participatory design was a useful approach that holds potential for further improving design in healthcare settings.
| S-EPMC6862753 | biostudies-literature
Project description:BackgroundA main element of patient-centred care, Patient Decision Aids (PtDAs) facilitate shared decision-making (SDM). A recent update of the International Patient Decision Aids Standards (IPDAS) emphasised patient involvement during PtDA development, but omitted a methodology for doing so. This article reports on the value of user-centred design (UCD) methods for the development of a PtDA that aims to support inflammatory arthritis patients in their choice between disease modifying anti-rheumatic drugs (DMARDs).MethodsThe IPDAS development process model in combination with UCD methods were applied. The process was overseen by an eight-member multidisciplinary steering group. Patients and health professionals were iteratively consulted. Qualitative in-depth interviews combined with rapid prototyping were conducted with patients to assess their needs for specific functionality, content and design of the PtDA. Group meetings with health professionals were organized to assess patients' needs and to determine how the PtDA should be integrated into patient pathways. The current literature was reviewed to determine the clinical evidence to include in the PtDA. To evaluate usability among patients, they were observed using the PtDA while thinking aloud and then interviewed.ResultsThe combination of patient interviews with rapid prototyping revealed that patients wanted to compare multiple DMARDs both for their clinical aspects and implications for daily life. Health professionals mainly wanted to refer patients to a reliable, easily adjustable source of information about DMARDs. A web-based PtDA was constructed consisting of four parts: 1) general information about SDM, inflammatory arthritis and DMARDs; 2) an application to compare particular DMARDs; 3) value clarification exercises; and 4) a printed summary of patients' notes, preferences, worries and questions that they could bring to discuss with their rheumatologist.ConclusionsThe study demonstrated that UCD methods can be of great value for the development of PtDAs. The early, iterative involvement of patients and health professionals was helpful in developing a novel user-friendly PtDA that allowed patients to choose between DMARDs. The PtDA fits the values of all stakeholders and easily integrates with the patient pathway and daily workflow of health professionals. This collaborative designed PtDA may improve SDM and patient participation in arthritis care.
| S-EPMC5405550 | biostudies-literature
Project description:BackgroundChronic wounds such as diabetic foot ulcers, venous leg ulcers, and pressure ulcers are a massive burden to health care facilities. Many randomized controlled trials on different wound care elements have been conducted and published in the Cochrane Library, all of which have only a low evidential basis. Thus, health care professionals are forced to rely on their own experience when making decisions regarding wound care. To progress from experience-based practice to evidence-based wound care practice, clinical decision support systems (CDSS) that help health care providers with decision-making in a clinical workflow have been developed. These systems have proven useful in many areas of the health care sector, partly because they have increased the quality of care, and partially because they have generated a solid basis for evidence-based practice. However, no systematic reviews focus on CDSS within the field of wound care to chronic wounds.ObjectiveThe aims of this systematic literature review are (1) to identify models used in CDSS that support health care professionals treating chronic wounds, and (2) to classify each clinical decision support model according to selected variables and to create an overview.MethodsA systematic review was conducted using 6 databases. This systematic literature review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement for systematic reviews. The search strategy consisted of three facets, respectively: Facet 1 (Algorithm), Facet 2 (Wound care) and Facet 3 (Clinical decision support system). Studies based on acute wounds or trauma were excluded. Similarly, studies that presented guidelines, protocols and instructions were excluded, since they do not require progression along an active chain of reasoning from the clinicians, just their focus. Finally, studies were excluded if they had not undergone a peer review process. The following aspects were extracted from each article: authors, year, country, the sample size of data and variables describing the type of clinical decision support models. The decision support models were classified in 2 ways: quantitative decision support models, and qualitative decision support models.ResultsThe final number of studies included in the systematic literature review was 10. These clinical decision support models included 4/10 (40%) quantitative decision support models and 6/10 (60%) qualitative decision support models. The earliest article was published in 2007, and the most recent was from 2015.ConclusionsThe clinical decision support models were targeted at a variety of different types of chronic wounds. The degree of accessibility of the inference engines varied. Quantitative models served as the engine and were invisible to the health care professionals, while qualitative models required interaction with the user.
| S-EPMC6238865 | biostudies-literature