Performance, workload, and usability in a multiscreen, multi-device, information-rich environment.
Ontology highlight
ABSTRACT:
SUBMITTER: Saleem JJ
PROVIDER: S-EPMC7924668 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Past research in HCI has generated a number of procedures for assessing the usability of interacting systems. In these procedures there is a tendency to omit characteristics of the users, aspects of the context and peculiarities of the tasks. Building a cohesive model that incorporates these features is not obvious. A construct greatly invoked in Human Factors is human Mental Workload. Its assessment is fundamental for predicting human performance. Despite the several uses of Usability and Mental Workload, not much has been done to explore their relationship. This empirical research focused on I) the investigation of such a relationship and II) the investigation of the impact of the two constructs on human performance. A user study was carried out with participants executing a set of information-seeking tasks over three popular web-sites. A deep correlation analysis of usability and mental workload, by task, by user and by classes of objective task performance was done (I). A number of Supervised Machine Learning techniques based upon different learning strategy were employed for building models aimed at predicting classes of task performance (II). Findings strongly suggests that usability and mental workload are two non overlapping constructs and they can be jointly employed to greatly improve the prediction of human performance.
| S-EPMC6070185 | biostudies-literature
Project description:IntroductionElectronic audit and feedback (e-A&F) systems are used worldwide for care quality improvement. They measure health professionals' performance against clinical guidelines, and some systems suggest improvement actions. However, little is known about optimal interface designs for e-A&F, in particular how to present suggested actions for improvement. We developed a novel theory-informed system for primary care (the Performance Improvement plaN GeneratoR; PINGR) that covers the four principal interface components: clinical performance summaries; patient lists; detailed patient-level information; and suggested actions. As far as we are aware, this is the first report of an e-A&F system with all four interface components.Objectives(1) Use a combination of quantitative and qualitative methods to evaluate the usability of PINGR with target end-users; (2) refine existing design recommendations for e-A&F systems; (3) determine the implications of these recommendations for patient safety.MethodsWe recruited seven primary care physicians to perform seven tasks with PINGR, during which we measured on-screen behaviour and eye movements. Participants subsequently completed usability questionnaires, and were interviewed in-depth. Data were integrated to: gain a more complete understanding of usability issues; enhance and explain each other's findings; and triangulate results to increase validity.ResultsParticipants committed a median of 10 errors (range 8-21) when using PINGR's interface, and completed a median of five out of seven tasks (range 4-7). Errors violated six usability heuristics: clear response options; perceptual grouping and data relationships; representational formats; unambiguous description; visually distinct screens for confusable items; and workflow integration. Eye movement analysis revealed the integration of components largely supported effective user workflow, although the modular design of clinical performance summaries unnecessarily increased cognitive load. Interviews and questionnaires revealed PINGR is user-friendly, and that improved information prioritisation could further promote useful user action.ConclusionsComparing our results with the wider usability literature we refine a previously published set of interface design recommendations for e-A&F. The implications for patient safety are significant regarding: user engagement; actionability; and information prioritisation. Our results also support adopting multi-method approaches in usability studies to maximise issue discovery and the credibility of findings.
| S-EPMC5766660 | biostudies-literature
Project description:The zebrafish serves as a valuable animal model for both intra- and extracranial research, particularly in relation to the brain and skull. To effectively investigate the development and regeneration of adult zebrafish, a versatile in vivo imaging technique capable of showing both intra- and extracranial conditions is essential. In this paper, we utilized a high-resolution multi-functional optical coherence tomography (OCT) to obtain rich intra- and extracranial imaging outcomes of adult zebrafish, encompassing pigmentation distribution, tissue-specific information, cranial vascular imaging, and the monitoring of traumatic brain injury (TBI). Notably, it is the first that the channels through the zebrafish cranial suture, which may have a crucial function in maintaining the patency of the cranial sutures, have been observed. Rich imaging results demonstrated that a high-resolution multi-functional OCT system can provide a wealth of novel and interpretable biological information for intra- and extracranial studies of adult zebrafish.
| S-EPMC10375992 | biostudies-literature
Project description:BackgroundNumerous studies have revealed widespread clinician frustration with the usability of electronic health records (EHRs) that is counterproductive to adoption of EHR systems to meet the aims of health-care reform. With poor system usability comes increased risk of negative unintended consequences. Usability issues could lead to user error and workarounds that have the potential to compromise patient safety and negatively impact the quality of care.[1] While there is ample research on EHR usability, there is little information on the usability of laboratory information systems (LISs). Yet, LISs facilitate the timely provision of a great deal of the information needed by physicians to make patient care decisions.[2] Medical and technical advances in genomics that require processing of an increased volume of complex laboratory data further underscore the importance of developing user-friendly LISs. This study aims to add to the body of knowledge on LIS usability.MethodsA survey was distributed among LIS users at hospitals across the United States. The survey consisted of the ten-item System Usability Scale (SUS). In addition, participants were asked to rate the ease of performing 24 common tasks with a LIS. Finally, respondents provided comments on what they liked and disliked about using the LIS to provide diagnostic insight into LIS perceived usability.ResultsThe overall mean SUS score of 59.7 for the LIS evaluated is significantly lower than the benchmark of 68 (P < 0.001). All LISs evaluated received mean SUS scores below 68 except for Orchard Harvest (78.7). While the years of experience using the LIS was found to be a statistically significant influence on mean SUS scores, the combined effect of years of experience and LIS used did not account for the statistically significant difference in the mean SUS score between Orchard Harvest and each of the other LISs evaluated.ConclusionsThe results of this study indicate that overall usability of LISs is poor. Usability lags that of systems evaluated across 446 usability surveys.
| S-EPMC5653961 | biostudies-literature
Project description:Plant breeding programs evaluate varieties in series of field trials across years and locations, referred to as multi-environment trials (METs). These are an essential part of variety evaluation with the key aim of the statistical analysis of these datasets to accurately estimate the variety by environment (VE) effects. It has previously been thought that the number of varieties in common between environments, referred to as "variety connectivity," was a key driver of the reliability of genetic variance parameter estimation and that this in turn affected the reliability of predictions of VE effects. In this paper we have provided the link between the objectives of this work and those in model-based experimental design. We propose the use of the D -optimality criterion as a diagnostic to capture the information available for the residual maximum likelihood (REML) estimation of the genetic variance parameters. We demonstrate the methods for a dataset with pedigree information as well as evaluating the performance of the diagnostic using two simulation studies. This measure is shown to provide a superior diagnostic to the traditional connectivity type measure in the sense of better forecasting the uncertainty of genetic variance parameter estimates.
| S-EPMC8688772 | biostudies-literature
Project description:BackgroundThe contribution of usability flaws to patient safety issues is acknowledged but not well-investigated. Free-text descriptions of incident reports may provide useful data to identify the connection between health information technology (HIT) usability flaws and patient safety.ObjectivesThis article examines the feasibility of using incident reports about HIT to learn about the usability flaws that affect patient safety. We posed three questions: (1) To what extent can we gain knowledge about usability issues from incident reports? (2) What types of usability flaws, related usage problems, and negative outcomes are reported in incidents reports? (3) What are the reported usability issues that give rise to patient safety issues?MethodsA sample of 359 reports from the U.S. Food and Drug Administration Manufacturer and User Facility Device Experience database was examined. Descriptions of usability flaws, usage problems, and negative outcomes were extracted and categorized. A supplementary analysis was performed on the incidents which contained the full chain going from a usability flaw up to a patient safety issue to identify the usability issues that gave rise to patient safety incidents.ResultsA total of 249 reports were included. We found that incident reports can provide knowledge about usability flaws, usage problems, and negative outcomes. Thirty-six incidents report how usability flaws affected patient safety (ranging from incidents without consequence, to death) involving electronic patient scales, imaging systems, and HIT for medication management. The most significant class of involved usability flaws is related to the reliability, the understandability, and the availability of the clinical information.ConclusionIncidents reports involving HIT are an exploitable source of information to learn about usability flaws and their effects on patient safety. Results can be used to convince all stakeholders involved in the HIT system lifecycle that usability should be considered seriously to prevent patient safety incidents.
| S-EPMC6561760 | biostudies-literature
Project description:Usability factors are a major obstacle to health information technology (IT) adoption. The purpose of this paper is to review and categorize health IT usability study methods and to provide practical guidance on health IT usability evaluation. 2025 references were initially retrieved from the Medline database from 2003 to 2009 that evaluated health IT used by clinicians. Titles and abstracts were first reviewed for inclusion. Full-text articles were then examined to identify final eligibility studies. 629 studies were categorized into the five stages of an integrated usability specification and evaluation framework that was based on a usability model and the system development life cycle (SDLC)-associated stages of evaluation. Theoretical and methodological aspects of 319 studies were extracted in greater detail and studies that focused on system validation (SDLC stage 2) were not assessed further. The number of studies by stage was: stage 1, task-based or user-task interaction, n=42; stage 2, system-task interaction, n=310; stage 3, user-task-system interaction, n=69; stage 4, user-task-system-environment interaction, n=54; and stage 5, user-task-system-environment interaction in routine use, n=199. The studies applied a variety of quantitative and qualitative approaches. Methodological issues included lack of theoretical framework/model, lack of details regarding qualitative study approaches, single evaluation focus, environmental factors not evaluated in the early stages, and guideline adherence as the primary outcome for decision support system evaluations. Based on the findings, a three-level stratified view of health IT usability evaluation is proposed and methodological guidance is offered based upon the type of interaction that is of primary interest in the evaluation.
| S-EPMC3341772 | biostudies-literature
Project description:OBJECTIVE:To evaluate the influence of pharmacists' dispensing workload (PDW) on pharmacy services as measured by prescription suggestion rate (PSR) and dispensing error rate (DER). METHOD:This was an observational study in northern and southern Taiwan's two largest medical centers, from 2012 to 2018. We calculated monthly PDW as number of prescriptions divided by number of pharmacist working days. We used monthly PSR and DER as outcome indicators for pharmacists' review and dispensing services, respectively. We used Poisson regression model with generalized estimation equation methods to evaluate the influence of PDW on PSR and DER. RESULTS:The monthly mean of 463,587 (SD 32,898) prescriptions yielded mean PDW, PSR and DER of 52 (SD 3) prescriptions per pharmacist working days, 30 (SD 7) and 8 (SD 2) per 10,000 prescriptions monthly, respectively. There was significant negative impact of PDW on PSR (adjusted rate ratio, aRR: 0.9786; 95%CI: 0.9744-0.9829) and DER (aRR: 0.9567; 95%CI: 0.9477-0.9658). Stratified analyses by time periods (2012-2015 and 2016-2018) revealed the impact of PDW on PSR to be similar in both periods; but with positive association between PDW and DER in the more recent one (aRR: 1.0086, 95%CI: 1.0003-1.0169). CONCLUSIONS:Reduced pharmacist workload was associated with re-allocation of pharmacy time to provide prescription suggestions and, more recently, decrease dispensing errors. Continuous efforts to maintain appropriate workload for pharmacists are recommended to ensure prescription quality.
| S-EPMC7173874 | biostudies-literature
Project description:ObjectiveThe Health Information Technology Usability Evaluation Scale (Health-ITUES) is a validated and reliable instrument to evaluate usability of information technology (IT) tools. In this study, we aimed to establish the optimal cut-point of the Health-ITUES to identify usability of IT tools.MethodsAdult participants were recruited to a trial evaluating a mobile app for self-managing HIV. Participants completed the Health-ITUES at the 3- and 6-month follow-up. Health-ITUES is a 20-item questionnaire that assesses four subscales: impact, perceived usefulness, perceived ease of use, and user control. The total score ranged from 1 to 5 and a higher score indicates greater usability. App use was defined as the proportion of activities completed by participants in both study arms. The selection of an optimal cut-point involved a series of multiple linear regression models with 500 bootstrap replications to examine the relationship between the Health-ITUES total score and app use, controlling for potential covariates.ResultsWe included 158 participants; mean age was 49.7 years (SD 10.3), 71% were African American/Black, and 72% were non-Hispanic. Mean Health-ITUES total scores at 3 and 6 months were 4.39 (SD 0.75) and 4.43 (SD 0.75), respectively. App use completedby participants from baseline to the 3-month follow-up visits was 0.61 (SD 0.36, range 0-1.72) and from 3-month to the 6-month follow-up visits was 0.51 (SD 0.37). Participants who reported greater Health-ITUES total score completed more activities [β = 0.18, 95% Confidence Interval (CI) 0.10-0.27]. The optimal cut-point of 4.32 (95% CI: 4.25-4.56) yielded the lowest p-value to identify usability of IT tools.ConclusionsIn this study of adults with HIV, we identified an optimal cut-point of 4.32 on the Health-ITUES total score to define usability. Further studies are needed to validate this cut-point.
| S-EPMC8903058 | biostudies-literature
Project description:Background The emergency for the COVID-19 pandemic has led to greater use of home telemonitoring devices. The aim of this study was to assess the usability of continuous home-monitoring care with an oxygen saturation device on post-COVID-19 patients. Method The system consists of a digital continuous pulse oximeter and a smartphone with an App, which were provided to patients. A survey composed of a standard Post-Study System Usability Questionnaire, and a satisfaction questionnaire was exploited to conduct a usability and feasibility analysis of the service. Results A total of 29 patients (17.2% female) with a mean age of 65 ± 11.5 years were enrolled: 20 patients were smartphone users (69%) with a mean age of 60.2 ± 9.5 years, and 9 patients (31%) did not own a smartphone (mean age 76.8 ± 5.9). The monitoring period was 1 month: a total of 444 recordings were conducted, 15 recordings per patient averagely. In total, 82% of the recordings performed did not require any intervention, while 18% led to the production of a report and subsequent intervention by a nurse who verified, together with the specialist, the need to intervene (i.e. the patient accessed the clinic for medical control and/or modification of oxygen therapy). A total of 17 patients compiled a usability questionnaire. The service was perceived as useful and well-structured, although it often required caregiver support. Conclusions Using continuous home-monitoring care with an oxygen saturation device seems feasible and useful for patients who could be followed at home avoiding going back to the hospital every time a trend oximetry is needed. Further improvements in connections, data flow processes, and simplifications, based on patients’ feedback, are needed to scale up the service.
| S-EPMC10426309 | biostudies-literature