Dataset Information

Importance of testing for usability when selecting and implementing an electronic health or medical record system.

ABSTRACT:

Purpose

An oncology electronic health record (EHR) was implemented without prior usability testing. Before expanding the system to new clinics, this study was initiated to examine the role of usability testing in the evaluation of an EHR product and whether novice users could identify issues with usability that resonated with more experienced users of the system. In addition, our study evaluated whether usability issues with an already implemented system affect efficiency and satisfaction of users.

Methods

A general usability guide was developed by a group of five informaticists. Using this guide, four novice users evaluated an EHR product and identified issues. A panel of five experts reviewed the identified issues to determine agreement with and applicability to the already implemented system. A survey of 42 experienced users of the previously implemented EHR was also performed to assess efficiency and general satisfaction.

Results

The novice users identified 110 usability issues. Our expert panel agreed with 90% of the issues and recommendations for correction identified by the novice users. Our survey had a 54% response rate. The majority of the experienced users of the previously implemented system, which did not benefit from upfront usability testing, had a high degree of dissatisfaction with efficiency and general functionality but higher overall satisfaction than expected.

Conclusion

In addition to reviewing features and content of an EHR system, usability testing could improve the chances that the EHR design is integrated with existing workflow and business processes in a clear and efficient way.

SUBMITTER: Corrao NJ

PROVIDER: S-EPMC2868635 | biostudies-literature | 2010 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Importance of testing for usability when selecting and implementing an electronic health or medical record system.

Corrao Natalie J NJ Robinson Alan G AG Swiernik Michael A MA Naeim Arash A

Journal of oncology practice 20100501 3

<h4>Purpose</h4>An oncology electronic health record (EHR) was implemented without prior usability testing. Before expanding the system to new clinics, this study was initiated to examine the role of usability testing in the evaluation of an EHR product and whether novice users could identify issues with usability that resonated with more experienced users of the system. In addition, our study evaluated whether usability issues with an already implemented system affect efficiency and satisfactio ...[more]

PMID: 20808553

Similar Datasets

Project description:BackgroundObtaining accurate clinical information about recent acute care visits is extremely important for outpatient providers. However, documents used to communicate this information are often difficult to use. This puts patients at risk of adverse events. Elderly patients who are seen by more providers and have more care transitions are especially vulnerable.ObjectiveThis study aimed to (1) identify the information about elderly patients' recent acute care visits needed to coordinate their care, (2) use this information to assess discharge summaries, and (3) provide recommendations to help improve the quality of electronic health record (EHR)-generated discharge summaries, thereby increasing patient safety.MethodsA literature review, clinician interviews, and a survey of outpatient providers were used to identify and categorize data needed to coordinate care for recently discharged elderly patients. Based upon those data, 2 guidelines for creating useful discharge summaries were created. The new guidelines, along with 17 previously developed medical documentation usability heuristics, were applied to assess 4 simulated elderly patient discharge summaries.ResultsThe initial research effort yielded a list of 29 items that should always be included in elderly patient discharge summaries and a list of 7 "helpful, but not always necessary" items. Evaluation of 4 deidentified elderly patient discharge summaries revealed that none of the documents contained all 36 necessary items; between 14 and 18 were missing. The documents each had several other issues, and they differed significantly in organization, layout, and formatting.ConclusionsVariations in content and structure of discharge summaries in the United States make them unnecessarily difficult to use. Standardization would benefit both patients, by lowering the risk of care transition-related adverse events, and outpatient providers, by helping reduce frustration that can contribute to burnout. In the short term, acute care providers can help improve the quality of their discharge summaries by working with EHR vendors to follow recommendations based upon this study. Meanwhile, additional human factors work should determine the most effective way to organize and present information in discharge summaries, to facilitate effective standardization.

Project description:BackgroundElectronic health record (EHR) system transitions are challenging for healthcare organizations. High-volume, safety-critical tasks like barcode medication administration (BCMA) should be evaluated, yet standards for ensuring safety during transition have not been established.ObjectiveIdentify risks in common and problem-prone medication tasks to inform safe transition between BCMA systems and establish benchmarks for future system changes.DesignStaff nurses completed simulation-based usability testing in the legacy system (R1) and new system pre- (R2) and post-go-live (R3). Tasks included (1) Hold/Administer, (2) IV Fluids, (3) PRN Pain, (4) Insulin, (5) Downtime/PRN, and (6) Messaging. Audiovisual recordings of task performance were systematically analyzed for time, navigation, and errors. The System Usability Scale measured perceived usability and satisfaction. Post-simulation interviews captured nurses' qualitative comments and perceptions of the systems.ParticipantsFifteen staff nurses completed 2-3-h simulation sessions. Eleven completed both R1 and R2, and seven completed all three rounds. Clinical experience ranged from novice (< 1 year) to experienced (> 10 years). Practice settings included adult and pediatric patient populations in ICU, stepdown, and acute care departments.Main measuresTask completion rates/times, safety and non-safety-related use errors (interaction difficulties), and user satisfaction.Key resultsOverall success rates remained relatively stable in all tasks except two: IV Fluids task success increased substantially (R1: 17%, R2: 54%, R3: 100%) and Downtime/PRN task success decreased (R1: 92%, R2: 64%, R3: 22%). Among the seven nurses who completed all rounds, overall safety-related errors decreased 53% from R1 to R3 and 50% from R2 to R3, and average task times for successfully completed tasks decreased 22% from R1 to R3 and 38% from R2 to R3.ConclusionsUsability testing is a reasonable approach to compare different BCMA tasks to anticipate transition problems and establish benchmarks with which to monitor and evaluate system changes going forward.

Project description:Social and environmental determinants of health (SEDH) data in the electronic health record (EHR) can be inaccurate and incomplete. Providers are in a unique position to impact this issue as they both obtain and enter this data, however, the variability in screening and documentation practices currently limits the ability to mobilize SEDH data for secondary uses. This study explores whether providers' perceptions of clinical importance of SEDH or EHR usability influenced data entry by analyzing two relationships: (1) provider charting behavior and clinical consideration of SEDH and (2) provider charting behavior and ease of EHR use in charting. We performed a cross-sectional study using an 11-question electronic survey to assess self-reported practices related to clinical consideration of SEDH elements, EHR usability and SEDH documentation of all staff physicians, identified using administrative listserves, at Penn State Health Hershey Medical Center during September to October 2021. A total of 201 physicians responded to and completed the survey out of a possible 2,478 identified staff physicians (8.1% response rate). A five-point Likert scale from "never" to "always" assessed charting behavior and clinical consideration. Responses were dichotomized as consistent/inconsistent and vital/not vital respectively. EHR usability was assessed as "yes" or "no" responses. Fisher's exact tests assessed the relationship between charting behavior and clinical consideration and to compare charting practices between different SEDHs. Cumulative measures were constructed for consistent charting and ease of charting. A generalized linear mixed model (GLMM) compared SDH and EDH with respect to each cumulative measure and was quantified using odds ratios (OR) and 95% confidence intervals (CI). Our results show that provider documentation frequency of an SEDH is associated with perceived clinical utility as well as ease of charting and that providers were more likely to consistently chart on SDH versus EDH. Nuances in these relationships did exist with one notable example comparing the results of smoking (SDH) to infectious disease outbreaks (EDH). Despite similar percentages of physicians reporting that both smoking and infectious disease outbreaks are vital to care, differences in charting consistency and ease of charting between these two were seen. Taken as a whole, our results suggest that SEDH quality optimization efforts cannot consider physician perceptions and EHR usability as siloed entities and that EHR design should not be the only target for intervention. The associations found in this study provide a starting point to understand the complexity in how clinical utility and EHR usability influence charting consistency of each SEDH element, however, further research is needed to understand how these relationships intersect at various levels in the SEDH data optimization process.

Dataset Information

Importance of testing for usability when selecting and implementing an electronic health or medical record system.

Purpose

Methods

Results

Conclusion

Publications

Importance of testing for usability when selecting and implementing an electronic health or medical record system.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets