Dataset Information

Usability Evaluation of Laboratory Information Systems.

ABSTRACT: Background:Numerous studies have revealed widespread clinician frustration with the usability of electronic health records (EHRs) that is counterproductive to adoption of EHR systems to meet the aims of health-care reform. With poor system usability comes increased risk of negative unintended consequences. Usability issues could lead to user error and workarounds that have the potential to compromise patient safety and negatively impact the quality of care.[1] While there is ample research on EHR usability, there is little information on the usability of laboratory information systems (LISs). Yet, LISs facilitate the timely provision of a great deal of the information needed by physicians to make patient care decisions.[2] Medical and technical advances in genomics that require processing of an increased volume of complex laboratory data further underscore the importance of developing user-friendly LISs. This study aims to add to the body of knowledge on LIS usability. Methods:A survey was distributed among LIS users at hospitals across the United States. The survey consisted of the ten-item System Usability Scale (SUS). In addition, participants were asked to rate the ease of performing 24 common tasks with a LIS. Finally, respondents provided comments on what they liked and disliked about using the LIS to provide diagnostic insight into LIS perceived usability. Results:The overall mean SUS score of 59.7 for the LIS evaluated is significantly lower than the benchmark of 68 (P < 0.001). All LISs evaluated received mean SUS scores below 68 except for Orchard Harvest (78.7). While the years of experience using the LIS was found to be a statistically significant influence on mean SUS scores, the combined effect of years of experience and LIS used did not account for the statistically significant difference in the mean SUS score between Orchard Harvest and each of the other LISs evaluated. Conclusions:The results of this study indicate that overall usability of LISs is poor. Usability lags that of systems evaluated across 446 usability surveys.

SUBMITTER: Mathews A

PROVIDER: S-EPMC5653961 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionElectronic audit and feedback (e-A&F) systems are used worldwide for care quality improvement. They measure health professionals' performance against clinical guidelines, and some systems suggest improvement actions. However, little is known about optimal interface designs for e-A&F, in particular how to present suggested actions for improvement. We developed a novel theory-informed system for primary care (the Performance Improvement plaN GeneratoR; PINGR) that covers the four principal interface components: clinical performance summaries; patient lists; detailed patient-level information; and suggested actions. As far as we are aware, this is the first report of an e-A&F system with all four interface components.Objectives(1) Use a combination of quantitative and qualitative methods to evaluate the usability of PINGR with target end-users; (2) refine existing design recommendations for e-A&F systems; (3) determine the implications of these recommendations for patient safety.MethodsWe recruited seven primary care physicians to perform seven tasks with PINGR, during which we measured on-screen behaviour and eye movements. Participants subsequently completed usability questionnaires, and were interviewed in-depth. Data were integrated to: gain a more complete understanding of usability issues; enhance and explain each other's findings; and triangulate results to increase validity.ResultsParticipants committed a median of 10 errors (range 8-21) when using PINGR's interface, and completed a median of five out of seven tasks (range 4-7). Errors violated six usability heuristics: clear response options; perceptual grouping and data relationships; representational formats; unambiguous description; visually distinct screens for confusable items; and workflow integration. Eye movement analysis revealed the integration of components largely supported effective user workflow, although the modular design of clinical performance summaries unnecessarily increased cognitive load. Interviews and questionnaires revealed PINGR is user-friendly, and that improved information prioritisation could further promote useful user action.ConclusionsComparing our results with the wider usability literature we refine a previously published set of interface design recommendations for e-A&F. The implications for patient safety are significant regarding: user engagement; actionability; and information prioritisation. Our results also support adopting multi-method approaches in usability studies to maximise issue discovery and the credibility of findings.

Project description:AIMS AND OBJECTIVES:To evaluate online information on dysmenorrhoea, including readability, credibility, quality and usability. BACKGROUND:Menstrual pain impacts 45%-95% of women of reproductive age globally and is the leading cause of school and work absences among women. Women often seek online information on dysmenorrhoea; however, little is known about the information quality. DESIGN:This was a descriptive study to evaluate online information on dysmenorrhoea. METHODS:We imitated search strategies of the general public. Specifically, we employed the three most popular search engines worldwide-Google, Yahoo and Bing-and used lay search terms, "period pain" and "menstrual cramps." We screened 60 web pages. Following removal of duplicates and irrelevant web pages, 25 met the eligibility criteria. Two team members independently evaluated the included web pages using standardised tools. Readability was evaluated with the Flesch-Kincaid Reading Ease and Flesch-Kincaid Grade formulas; credibility, quality and usability were evaluated with established tools. We followed the STROBE checklist for reporting this study. RESULTS:For readability, the mean Flesch-Kincaid level was 10th grade. For credibility, 8% of web pages referenced scientific literature and 28% stated the author's name and qualifications. For quality, no web page employed user-driven content production; 8% of web pages referenced evidence-based guidelines, 32% of web pages had accurate content, and 4% of web pages recommended shared decision-making. Most web pages were interactive and included nontextual information. Some nontextual information was inaccurate. CONCLUSION:Online information on dysmenorrhoea has generally low readability, mixed credibility and variable quality. RELEVANCE TO CLINICAL PRACTICE:Strategies to improve health information on dysmenorrhoea include avoiding complex terms, incorporating visual aids, presenting evidence-based information and developing a decision aid to support shared decision-making. Healthcare providers should be aware of the problematic health information that individuals are exposed to and provide education about how to navigate online health information.

Project description:BackgroundThe contribution of usability flaws to patient safety issues is acknowledged but not well-investigated. Free-text descriptions of incident reports may provide useful data to identify the connection between health information technology (HIT) usability flaws and patient safety.ObjectivesThis article examines the feasibility of using incident reports about HIT to learn about the usability flaws that affect patient safety. We posed three questions: (1) To what extent can we gain knowledge about usability issues from incident reports? (2) What types of usability flaws, related usage problems, and negative outcomes are reported in incidents reports? (3) What are the reported usability issues that give rise to patient safety issues?MethodsA sample of 359 reports from the U.S. Food and Drug Administration Manufacturer and User Facility Device Experience database was examined. Descriptions of usability flaws, usage problems, and negative outcomes were extracted and categorized. A supplementary analysis was performed on the incidents which contained the full chain going from a usability flaw up to a patient safety issue to identify the usability issues that gave rise to patient safety incidents.ResultsA total of 249 reports were included. We found that incident reports can provide knowledge about usability flaws, usage problems, and negative outcomes. Thirty-six incidents report how usability flaws affected patient safety (ranging from incidents without consequence, to death) involving electronic patient scales, imaging systems, and HIT for medication management. The most significant class of involved usability flaws is related to the reliability, the understandability, and the availability of the clinical information.ConclusionIncidents reports involving HIT are an exploitable source of information to learn about usability flaws and their effects on patient safety. Results can be used to convince all stakeholders involved in the HIT system lifecycle that usability should be considered seriously to prevent patient safety incidents.

Dataset Information

Usability Evaluation of Laboratory Information Systems.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets