Dataset Information

Using scenarios and personas to enhance the effectiveness of heuristic usability evaluations for older adults and their care team.

ABSTRACT: Using heuristics to evaluate user experience is a common methodology for human-computer interaction studies. One challenge of this method is the inability to tailor results towards specific end-user needs. This manuscript reports on a method that uses validated scenarios and personas of older adults and care team members to enhance heuristics evaluations of the usability of commercially available personal health records for homebound older adults.Our work extends the Chisnell and Redish heuristic evaluation methodology by using a protocol that relies on multiple expert reviews of each system. It further standardizes the heuristic evaluation process through the incorporation of task-based scenarios.We were able to use the modified version of the Chisnell and Redish heuristic evaluation methodology to identify potential usability challenges of two commercially available personal health record systems. This allowed us to: (1) identify potential usability challenges for specific types of users, (2) describe improvements that would be valuable to all end-users of the system, and (3) better understand how the interactions of different users may vary within a single personal health record.The methodology described in this paper may help designers of consumer health information technology tools, such as personal health records, understand the needs of diverse end-user populations. Such methods may be particularly helpful when designing systems for populations that are difficult to recruit for end-user evaluations through traditional methods.

SUBMITTER: Kneale L

PROVIDER: S-EPMC5600518 | biostudies-literature | 2017 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using scenarios and personas to enhance the effectiveness of heuristic usability evaluations for older adults and their care team.

Kneale Laura L Mikles Sean S Choi Yong K YK Thompson Hilaire H Demiris George G

Journal of biomedical informatics 20170727

<h4>Objective</h4>Using heuristics to evaluate user experience is a common methodology for human-computer interaction studies. One challenge of this method is the inability to tailor results towards specific end-user needs. This manuscript reports on a method that uses validated scenarios and personas of older adults and care team members to enhance heuristics evaluations of the usability of commercially available personal health records for homebound older adults.<h4>Materials and methods</h4>O ...[more]

PMID: 28867476

Similar Datasets

Project description:BackgroundObtaining accurate clinical information about recent acute care visits is extremely important for outpatient providers. However, documents used to communicate this information are often difficult to use. This puts patients at risk of adverse events. Elderly patients who are seen by more providers and have more care transitions are especially vulnerable.ObjectiveThis study aimed to (1) identify the information about elderly patients' recent acute care visits needed to coordinate their care, (2) use this information to assess discharge summaries, and (3) provide recommendations to help improve the quality of electronic health record (EHR)-generated discharge summaries, thereby increasing patient safety.MethodsA literature review, clinician interviews, and a survey of outpatient providers were used to identify and categorize data needed to coordinate care for recently discharged elderly patients. Based upon those data, 2 guidelines for creating useful discharge summaries were created. The new guidelines, along with 17 previously developed medical documentation usability heuristics, were applied to assess 4 simulated elderly patient discharge summaries.ResultsThe initial research effort yielded a list of 29 items that should always be included in elderly patient discharge summaries and a list of 7 "helpful, but not always necessary" items. Evaluation of 4 deidentified elderly patient discharge summaries revealed that none of the documents contained all 36 necessary items; between 14 and 18 were missing. The documents each had several other issues, and they differed significantly in organization, layout, and formatting.ConclusionsVariations in content and structure of discharge summaries in the United States make them unnecessarily difficult to use. Standardization would benefit both patients, by lowering the risk of care transition-related adverse events, and outpatient providers, by helping reduce frustration that can contribute to burnout. In the short term, acute care providers can help improve the quality of their discharge summaries by working with EHR vendors to follow recommendations based upon this study. Meanwhile, additional human factors work should determine the most effective way to organize and present information in discharge summaries, to facilitate effective standardization.

Project description:BackgroundEffective multicomponent interventions in the community targeted at preventing frailty in at-risk older adults can promote healthy ageing. However, there is a lack of studies exploring the effectiveness of technology-enabled autonomous multi-domain community-based interventions for frailty. We developed a novel end-to-end System for Assessment and Intervention of Frailty (SAIF) with exercise, nutrition, and polypharmacy components. This pilot study aimed to explore SAIF's effectiveness in improving frailty status, physical performance and strength, and its usability in pre-frail older adults.Materials and methodsThis is a single arm 8-week pilot study in 20 community-dwelling older adults who were pre-frail, defined using the Clinical Frailty Scale (CFS) as CFS 3 + (CFS 3 and FRAIL positive) or CFS 4. For outcomes, we assessed frailty status using the modified Fried Frailty Phenotype (FFP) and CFS; physical performance using Short Physical Performance Battery (SPPB); and Hand Grip Strength (HGS) at baseline and 8-week. User experience was explored using the System Usability Scale (SUS), interest-enjoyment subscale of the Intrinsic Motivation Inventory and open-ended questions. We analyzed effectiveness using repeated-measures tests on pre-post scores, and usability using a convergent mixed-method approach via thematic analysis of open-ended responses and descriptive statistics of usability/interest-enjoyment scales.ResultsSixteen participants (71.8 ± 5.5 years) completed the 8-week study. There was a significant improvement in FFP score (-0.5, p < 0.05, effect size, r = 0.43), but not CFS (-1.0, p = 0.10, r = 0.29). Five (31.3%) improved in frailty status for both FFP and CFS. SPPB (+1.0, p < 0.05, r = 0.42) and HGS (+3.5, p < 0.05, r = 0.45) showed significant improvements. Three themes were identified: "Difficulty in module navigation" (barriers for SAIF interaction); "User engagement by gamification" (facilitators that encourage participation); and "Perceived benefits to physical health" (subjective improvements in physical well-being), which corroborated with SUS (68/100) and interest-enjoyment (3.9/5.0) scores. Taken together, user experience results cohere with the Senior Technology Acceptance and Adoption Model.ConclusionOur pilot study provides preliminary evidence of the effectiveness of SAIF in improving frailty status, physical performance and strength of pre-frail older adults, and offers user experience insights to plan the follow-up large-scale randomized controlled trial.

Project description:BackgroundFalls are the leading cause of injury-related death in older adults. Due to various constraints, objective fall risk screening is seldom performed in clinical settings. Smartphones offer a high potential to provide fall risk screening for older adults in home settings. However, there is limited understanding of whether smartphone technology for falls screening is usable by older adults who present age-related changes in perceptual, cognitive, and motor capabilities.ObjectiveThe aims of this study were to develop a fall risk mobile health (mHealth) app and to determine the usability of the fall risk app in healthy, older adults.MethodsA fall risk app was developed that consists of a health history questionnaire and 5 progressively challenging mobility tasks to measure individual fall risk. An iterative design-evaluation process of semistructured interviews was performed to determine the usability of the app on a smartphone and tablet. Participants also completed a Systematic Usability Scale (SUS). In the first round of interviews, 6 older adults participated, and in the second round, 5 older adults participated. Interviews were videotaped and transcribed, and the data were coded to create themes. Average SUS scores were calculated for the smartphone and tablet.ResultsThere were 2 themes identified from the first round of interviews, related to perceived ease of use and perceived usefulness. While instructions for the balance tasks were difficult to understand, participants found it beneficial to learn about their risk for falls, found the app easy to follow, and reported confidence in using the app on their own. Modifications were made to the app, and following the second round of interviews, participants reported high ease of use and usefulness in learning about their risk of falling. Few differences were reported between using a smartphone or tablet. Average SUS scores ranged from 79 to 84.ConclusionsOur fall risk app was found to be highly usable by older adults as reported from interviews and high scores on the SUS. When designing a mHealth app for older adults, developers should include clear and simple instructions and preventative strategies to improve health. Furthermore, if the design accommodates for age-related sensory changes, smartphones can be as effective as tablets. A mobile app to assess fall risk has the potential to be used in home settings by older adults.

Project description:BackgroundMost people having major surgery are over the age of 65. The transition out of hospital is a vulnerable time for older adults, particularly after major surgery. Research on postoperative transitions in care is growing, but it is not clear how postoperative transitions are being evaluated. The objective of this scoping review was to synthesize processes and outcomes used to evaluate postoperative transitions in care for older adults.MethodsWe conducted a scoping review that included articles evaluating a postoperative transition in care among adults aged > 65 having major elective surgery. We searched Medline (Ovid), EMBASE (Ovid), CINHAL, and Cochrane Central Register of Controlled Trials (CENTRAL) from their respective inception dates to April 6, 2021. We also searched The World Health Organization International Clinical Trials Registry Platform and ClinicalTrials.gov from their respective inception dates to April 6, 2021. Screening and data extraction was completed by reviewers in duplicate. Data relevant to study design and objective, intervention description, and process or outcome evaluations were extracted. Process evaluations were categorized using the Ideal Transitions in Care Framework, and outcome evaluations were categorized using the Institute for Healthcare Improvement Triple Aim Framework.ResultsAfter screening titles and abstracts and full-text article review, we included 20 articles in our final synthesis. There was variability in the processes and outcomes used to evaluate postoperative transitions in care. The most common outcomes evaluated were health service utilization (n = 9), including readmission and Emergency Department visits, experiential outcomes (n = 9) and quality of life (n = 7). Process evaluations included evaluating the education provided to patients to promote self-management (n = 6), coordination of care among team members (n = 3) and outpatient follow-up (n = 3). Only two articles measured frailty, one article used theory to guide their evaluations and no articles engaged knowledge users.ConclusionsThere is inconsistency in how postoperative transitions in care were evaluated. There is a need to use theories and to engage key stakeholders involved in postoperative transitions in care, including older adults and their caregivers, to identify the most appropriate approaches for developing and evaluating interventions to meaningfully improve care.

Project description:Anecdotal evidence suggested that waiting times within the older adults community mental health team (OA CMHT) had been increasing over time. An assessment and evaluation was indicated to ensure best quality care was provided for patients. A comparison was made between waiting times in January to December 2011 compared with August 2013 to July 2014. In 2011 the mean number of days until initial assessment from the point of referral was 12 days for routine cases, and 3.6 days for urgent cases. The re-audit showed the number of days increased to 15.89 days for routine cases, and 9.81 days for urgent cases. Contributory factors were reviewed, and it was felt that to address this problem, a duty worker role was necessary. The role of the duty worker was divided into triaging and allocating work. The triaging process was to ensure all urgent cases were highlighted early and acted upon. The duty worker's role was also to gather sufficient information from the referrer, to reduce the risks of inadequate knowledge delaying assessment. In addition, the allocating process required the duty worker to designate a clinician in charge of the case upon receipt of referral. This ensured that clinicians were able to offer the earliest possible appointment slot for the initial assessment, and thus reduce waiting times. Following implementation, findings from September 2014 to February 2015 showed an improvement in average waiting times, as well as an improvement in the percentage of assessments reviewed within previously set standards. For routine reviews, the mean time until assessment was 10.68 days. For urgent reviews, the mean time until initial assessment was 6.8 days. However, it was noted that majority of urgent reviews were still not being reviewed in time. The outcomes of this study demonstrated an improvement of both waiting times, and percentage of patients being seen within set standards following a single intervention. In the current climate of cost efficiency savings, it is important for services to continue to find ways to streamline and improve upon current practices, to ensure the best outcome for patients.

Dataset Information

Using scenarios and personas to enhance the effectiveness of heuristic usability evaluations for older adults and their care team.

Publications

Using scenarios and personas to enhance the effectiveness of heuristic usability evaluations for older adults and their care team.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets