Dataset Information

Examining perceptions of the usefulness and usability of a mobile-based system for pharmacogenomics clinical decision support: a mixed methods study.

ABSTRACT: Background. Pharmacogenomic testing has the potential to improve the safety and efficacy of pharmacotherapy, but clinical application of pharmacogenetic knowledge has remained uncommon. Clinical Decision Support (CDS) systems could help overcome some of the barriers to clinical implementation. The aim of this study was to evaluate the perception and usability of a web- and mobile-enabled CDS system for pharmacogenetics-guided drug therapy-the Medication Safety Code (MSC) system-among potential users (i.e., physicians and pharmacists). Furthermore, this study sought to collect data on the practicability and comprehensibility of potential layouts of a proposed personalized pocket card that is intended to not only contain the machine-readable data for use with the MSC system but also human-readable data on the patient's pharmacogenomic profile. Methods. We deployed an emergent mixed methods design encompassing (1) qualitative interviews with pharmacists and pharmacy students, (2) a survey among pharmacogenomics experts that included both qualitative and quantitative elements and (3) a quantitative survey among physicians and pharmacists. The interviews followed a semi-structured guide including a hypothetical patient scenario that had to be solved by using the MSC system. The survey among pharmacogenomics experts focused on what information should be printed on the card and how this information should be arranged. Furthermore, the MSC system was evaluated based on two hypothetical patient scenarios and four follow-up questions on the perceived usability. The second survey assessed physicians' and pharmacists' attitude towards the MSC system. Results. In total, 101 physicians, pharmacists and PGx experts coming from various relevant fields evaluated the MSC system. Overall, the reaction to the MSC system was positive across all investigated parameters and among all user groups. The majority of participants were able to solve the patient scenarios based on the recommendations displayed on the MSC interface. A frequent request among participants was to provide specific listings of alternative drugs and concrete dosage instructions. Negligence of other patient-specific factors for choosing the right treatment such as renal function and co-medication was a common concern related to the MSC system, while data privacy and cost-benefit considerations emerged as the participants' major concerns regarding pharmacogenetic testing in general. The results of the card layout evaluation indicate that a gene-centered and tabulated presentation of the patient's pharmacogenomic profile is helpful and well-accepted. Conclusions. We found that the MSC system was well-received among the physicians and pharmacists included in this study. A personalized pocket card that lists a patient's metabolizer status along with critically affected drugs can alert physicians and pharmacists to the availability of essential therapy modifications.

SUBMITTER: Blagec K

PROVIDER: S-EPMC4768706 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Examining perceptions of the usefulness and usability of a mobile-based system for pharmacogenomics clinical decision support: a mixed methods study.

Blagec Kathrin K Romagnoli Katrina M KM Boyce Richard D RD Samwald Matthias M

PeerJ 20160208

Background. Pharmacogenomic testing has the potential to improve the safety and efficacy of pharmacotherapy, but clinical application of pharmacogenetic knowledge has remained uncommon. Clinical Decision Support (CDS) systems could help overcome some of the barriers to clinical implementation. The aim of this study was to evaluate the perception and usability of a web- and mobile-enabled CDS system for pharmacogenetics-guided drug therapy-the Medication Safety Code (MSC) system-among potential u ...[more]

PMID: 26925317

Similar Datasets

Project description:BackgroundPregnant women are often unaware of the potential risks that working conditions can cause to them and their unborn child. A mobile health (mHealth) app, the Pregnancy and Work (P and W) app, developed by a multidisciplinary team and based on an evidence-based guideline for occupational physicians, aims to provide advice on work adjustment during pregnancy.ObjectiveThis study evaluates the usability of the mHealth P and W app and the perceived usefulness of the work advice, the main goal of the app, by potential end users.MethodsA total of 12 working pregnant women participated in think aloud usability sessions and performed 9 tasks. All think aloud sessions were recorded, transcribed, and coanalyzed. The usability problems were rated for their severity in accordance with Nielsen severity scale. The completion rates and time taken for completion of tasks were registered. In addition, participants were questioned on demographics and user characteristics and were asked to evaluate the value of the app by filling in the Intrinsic Motivation Inventory (IMI) score and the System Usability Scale (SUS) questionnaire.ResultsIn total, 82 usability problems with a severity ≥1 were identified, of which 40 had severity ≥3. The main usability problems concerned the interpretation of terminology used in the app's questionnaires and difficulties in finding and understanding the work advice. Furthermore, 10 out of 12 participants were able to open the work advice page in the app. Only 7 out of these 10 participants understood and intended to follow the work advice. The overall mean IMI score was relatively high (5 out of 7), indicating that the participants did indeed value the use of the app. This IMI score corresponded to the overall mean SUS score (68 out of 100) and the mean grade given to the P and W app (7 out of 10).ConclusionsThis think aloud usability study showed that the information provided in the P and W app was considered valuable by the end users, working pregnant women, and it meets their needs; however, usability issues severely impacted the perceived usefulness of the work advice given in the app.

Project description:BackgroundPharmacogenomics (PGx) is positioned to have a widespread impact on the practice of medicine, yet physician acceptance is low. The presentation of context-specific PGx information, in the form of clinical decision support (CDS) alerts embedded in a computerized provider order entry (CPOE) system, can aid uptake. Usability evaluations can inform optimal design, which, in turn, can spur adoption.ObjectivesThe study objectives were to: (1) evaluate an early prototype, commercial CPOE system with PGx-CDS alerts in a simulated environment, (2) identify potential improvements to the system user interface, and (3) understand the contexts under which PGx knowledge embedded in an electronic health record is useful to prescribers.MethodsUsing a mixed methods approach, we presented seven cardiologists and three oncologists with five hypothetical clinical case scenarios. Each scenario featured a drug for which a gene encoding drug metabolizing enzyme required consideration of dosage adjustment. We used Morae(®) to capture comments and on-screen movements as participants prescribed each drug. In addition to PGx-CDS alerts, 'Infobutton(®)' and 'Evidence' icons provided participants with clinical knowledge resources to aid decision-making.ResultsNine themes emerged. Five suggested minor improvements to the CPOE user interface; two suggested presenting PGx information through PGx-CDS alerts using an 'Infobutton' or 'Evidence' icon. The remaining themes were strong recommendations to provide succinct, relevant guidelines and dosing recommendations of phenotypic information from credible and trustworthy sources; any more information was overwhelming. Participants' median rating of PGx-CDS system usability was 2 on a Likert scale ranging from 1 (strongly agree) to 7 (strongly disagree).ConclusionsUsability evaluation results suggest that participants considered PGx information important for improving prescribing decisions; and that they would incorporate PGx-CDS when information is presented in relevant and useful ways.

Project description:BackgroundDiagnostic errors pose significant health risks and contribute to patient mortality. With the growing accessibility of electronic health records, machine learning models offer a promising avenue for enhancing diagnosis quality. Current research has primarily focused on a limited set of diseases with ample training data, neglecting diagnostic scenarios with limited data availability.ObjectiveThis study aims to develop an information retrieval (IR)-based framework that accommodates data sparsity to facilitate broader diagnostic decision support.MethodsWe introduced an IR-based diagnostic decision support framework called CliniqIR. It uses clinical text records, the Unified Medical Language System Metathesaurus, and 33 million PubMed abstracts to classify a broad spectrum of diagnoses independent of training data availability. CliniqIR is designed to be compatible with any IR framework. Therefore, we implemented it using both dense and sparse retrieval approaches. We compared CliniqIR's performance to that of pretrained clinical transformer models such as Clinical Bidirectional Encoder Representations from Transformers (ClinicalBERT) in supervised and zero-shot settings. Subsequently, we combined the strength of supervised fine-tuned ClinicalBERT and CliniqIR to build an ensemble framework that delivers state-of-the-art diagnostic predictions.ResultsOn a complex diagnosis data set (DC3) without any training data, CliniqIR models returned the correct diagnosis within their top 3 predictions. On the Medical Information Mart for Intensive Care III data set, CliniqIR models surpassed ClinicalBERT in predicting diagnoses with <5 training samples by an average difference in mean reciprocal rank of 0.10. In a zero-shot setting where models received no disease-specific training, CliniqIR still outperformed the pretrained transformer models with a greater mean reciprocal rank of at least 0.10. Furthermore, in most conditions, our ensemble framework surpassed the performance of its individual components, demonstrating its enhanced ability to make precise diagnostic predictions.ConclusionsOur experiments highlight the importance of IR in leveraging unstructured knowledge resources to identify infrequently encountered diagnoses. In addition, our ensemble framework benefits from combining the complementary strengths of the supervised and retrieval-based models to diagnose a broad spectrum of diseases.

Project description:BACKGROUND:Despite being an important cardiovascular risk factor, hypertension has low control levels worldwide. Computerized clinical decision support systems (CDSSs) might be effective in reducing blood pressure with a potential impact in reducing cardiovascular risk. OBJECTIVE:The goal of the research was to evaluate the feasibility, usability, and utility of a CDSS, TeleHAS (tele-hipertensão arterial sistêmica, or arterial hypertension system), in the care of patients with hypertension in the context of a primary care setting in a middle-income country. METHODS:The TeleHAS app consists of a platform integrating clinical and laboratory data on a particular patient, from which it performs cardiovascular risk calculation and provides evidence-based recommendations derived from Brazilian and international guidelines for the management of hypertension and cardiovascular risk. Ten family physicians from different primary care units in the city of Montes Claros, Brazil, were randomly selected to use the CDSS for the care of hypertensive patients for 6 months. After 3 and 6 months, the feasibility, usability, and utility of the CDSS in the routine care of the health team was evaluated through a standardized questionnaire and semistructured interviews. RESULTS:Throughout the study, clinicians registered 535 patients with hypertension, at an average of 1.24 consultations per patient. Women accounted for 80% (8/10) of participant doctors, median age was 31.5 years (interquartile range 27 to 59 years). As for feasibility, 100% of medical users claimed it was possible to use the app in the primary care setting, and for 80% (8/10) of them it was easy to incorporate its use into the daily routine and home visits. Nevertheless, 70% (7/10) of physicians claimed that the time taken to fill out the CDSS causes significant delays in service. Clinicians evaluated TeleHAS as good (8/10, 80% of users), with easy completion and friendly interface (10/10, 100%) and the potential to improve patients' treatment (10/10, 100%). A total of 90% (9/10) of physicians had access to new knowledge about cardiovascular risk and hypertension through the app recommendations and found it useful to promote prevention and optimize treatment. CONCLUSIONS:In this study, a CDSS developed to assist the management of patients with hypertension was feasible in the context of a primary health care setting in a middle-income country, with good user satisfaction and the potential to improve adherence to evidence-based practices.

Project description:BackgroundReporting of medication errors is one of the essential mechanisms to identify risky health care systems and practices that lead to medication errors. Unreported medication errors are a real issue; one of the identified causes is a burdensome medication error reporting system. An anonymous and user-friendly mobile app for reporting medication errors could be an alternative method of reporting medication error in busy health care settings.ObjectiveThe objective of this paper is to report usability testing of the Medication Error Reporting App (MERA), a mobile app for reporting medication errors anonymously.MethodsQuantitative and qualitative methods were employed involving 45 different testers (pharmacists, doctors, and nurses) from a large tertiary hospital in Malaysia. Quantitative data was retrieved using task performance and rating of MERA and qualitative data were retrieved through focus group discussions. Three sessions, with 15 testers each session, were conducted from January to March 2018.ResultsThe majority of testers were pharmacists (23/45, 51%), female (35/45, 78%), and the mean age was 36 (SD 9) years. A total of 135 complete reports were successfully submitted by the testers (three reports per tester) and 79.2% (107/135) of the reports were correct. There was significant improvement in mean System Usability Scale scores in each session of the development process (P<.001) and mean time to report medication errors using the app was not significantly different between each session (P=.70) with an overall mean time of 6.7 (SD 2.4) minutes. Testers found the app easy to use, but doctors and nurses were unfamiliar with terms used especially medication process at which error occurred and type of error. Although, testers agreed the app can be used in the future for reporting, they were apprehensive about security, validation, and abuse of feedback featured in the app.ConclusionsMERA can be used to report medication errors easily by various health care personnel and it has the capacity to provide feedback on reporting. However, education on medication error reporting should be provided to doctors and nurses in Malaysia and the security of the app needs to be established to boost reporting by this method.

Project description:BackgroundBreastfeeding is proven to have lasting health benefits for both mothers and infants; however, 6-month exclusive breastfeeding rate remains below 20% in Thailand. Although the number of research literature and commercial apps for breastfeeding women is significantly growing, they are country-specific and restricted to English-speaking users. There exists a major knowledge gap on how mobile health apps could support breastfeeding in Thailand. To address these gaps, MoomMae has been developed with the intention to support Thai women in breastfeeding outside of their homes and in keeping their feeding records.ObjectiveThe aim of this study was to evaluate the usability and usefulness of MoomMae, a mobile phone app designed to support breastfeeding women.MethodsOur study was reviewed and approved by Thailand's National Science and Technology Development Agency (NSTDA) ethics committee. A total of 21 breastfeeding women with at least one Android phone or tablet were recruited via convenience and snowball sampling. The study process for each participant was as follows: the participant was requested to attend a preuse interview and given the app to use for 4 weeks. Following this period, a postuse interview was conducted to examine the usability and usefulness of the app. Both sessions were held individually and audiorecorded for qualitative analysis.ResultsThe mean scores of usability and usefulness from the postuse survey were 4.33 (SD 0.87; range 1-5) and 4.60 (SD 0.74; range 2-5). Our qualitative analysis revealed a total of 137 feedbacks: 71 related to usability and 66 associated with usefulness. A further sentimental analysis showed that comments on usability were generally negative (59 negative, 11 positive, and 1 neutral), and comments on usefulness were relatively positive (56 positive, 9 negative, and 1 neutral). We discovered 26 unique design issues and proposed recommendations for future improvement.ConclusionsOur usability and usefulness assessment of MoomMae demonstrated that MoomMae has a great potential to be a useful self-management tool for breastfeeding mothers in Thailand. The qualitative analysis suggested that the app is supportive of breastfeeding on demand, but the flow and inputs of the app should be redesigned to be more intuitive. For future implementations, the most desirable feature is a pump-reminding notification system.

Project description:BACKGROUND:Atrial fibrillation (AFib) is the most common form of heart arrhythmia and a potent risk factor for stroke. Nonvitamin K antagonist oral anticoagulants (NOACs) are routinely prescribed to manage AFib stroke risk; however, nonadherence to treatment is a concern. Additional tools that support self-care and medication adherence may benefit patients with AFib. OBJECTIVE:The aim of this study was to evaluate the perceived usability and usefulness of a mobile app designed to support self-care and treatment adherence for AFib patients who are prescribed NOACs. METHODS:A mobile app to support AFib patients was previously developed based on early stage interview and usability test data from clinicians and patients. An exploratory pilot study consisting of naturalistic app use, surveys, and semistructured interviews was then conducted to examine patients' perceptions and everyday use of the app. RESULTS:A total of 12 individuals with an existing diagnosis of nonvalvular AFib completed the 4-week study. The average age of participants was 59 years. All participants somewhat or strongly agreed that the app was easy to use, and 92% (11/12) reported being satisfied or very satisfied with the app. Participant feedback identified changes that may improve app usability and usefulness for patients with AFib. Areas of usability improvement were organized by three themes: app navigation, clarity of app instructions and design intent, and software bugs. Perceptions of app usefulness were grouped by three key variables: core needs of the patient segment, patient workflow while managing AFib, and the app's ability to support the patient's evolving needs. CONCLUSIONS:The results of this study suggest that mobile tools that target self-care and treatment adherence may be helpful to AFib patients, particularly those who are newly diagnosed. Additionally, participant feedback provided insight into the varied needs and health experiences of AFib patients, which may improve the design and targeting of the intervention. Pilot studies that qualitatively examine patient perceptions of usability and usefulness are a valuable and often underutilized method for assessing the real-world acceptability of an intervention. Additional research evaluating the AFib Connect mobile app over a longer period, and including a larger, more diverse sample of AFib patients, will be helpful for understanding whether the app is perceived more broadly to be useful and effective in supporting patient self-care and medication adherence.

Project description:BackgroundThe Centers for Disease Control and Prevention has estimated that atrial fibrillation (AF) affects between 2.7 million and 6.1 million people in the United States. Those who have AF tend to have a much higher stroke risk than others. Although most individuals with AF benefit from anticoagulation (AC) therapy, a significant majority are hesitant to start it. To add, providers often struggle in helping patients negotiate the decision to start AC therapy. To assist in the communication between patients and providers regarding preferences and knowledge about AC therapy, different strategies are being used to try and solve this problem. In this research study, we will have patients and providers utilize the AFib 2gether app with hopes that it will create a platform for shared decision making regarding the prevention of stroke in patients with AF receiving AC therapy.ObjectiveThe aim of our study is to measure several outcomes related to encounters between patients and their cardiology providers where AFib 2gether is used. These outcomes include usability and perceived usefulness of the app from the perspective of patients and providers. In addition, we will assess the extent and nature of shared decision making.MethodsEligible patients and providers will evaluate the AFib 2gether mobile app for usability and perceived usefulness in facilitating shared decision making regarding understanding the patient's risk of stroke and whether or not to start AC therapy. Both patients and providers will review the app and complete multiple questionnaires about the usability and perceived usefulness of the mobile app in a clinical setting. We will also audio-record a subset of encounters to assess for evidence of shared decision making.ResultsEnrollment in the AFib 2gether shared decision-making study is still ongoing for both patients and providers. The first participant enrolled on November 22, 2019. Analysis and publishing of results are expected to be completed in spring 2021.ConclusionsThe AFib 2gether app emerged from a desire to increase the ability of patients and providers to engage in shared decision making around understanding the risk of stroke and AC therapy. We anticipate that the AFib 2gether mobile app will facilitate patient discussion with their cardiologist and other providers. Additionally, we hope the study will help us identify barriers that providers face when placing patients on AC therapy. We aim to demonstrate the usability and perceived usefulness of the app with a future goal of testing the value of our approach in a larger sample of patients and providers at multiple medical centers across the country.Trial registrationClinicalTrials.gov NCT04118270; https://clinicaltrials.gov/ct2/show/NCT04118270.International registered report identifier (irrid)DERR1-10.2196/21986.

Dataset Information

Examining perceptions of the usefulness and usability of a mobile-based system for pharmacogenomics clinical decision support: a mixed methods study.

Publications

Examining perceptions of the usefulness and usability of a mobile-based system for pharmacogenomics clinical decision support: a mixed methods study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets