Usability of a Co-designed eHealth Prototype for Caregivers: Combination Study of Three Frameworks.
Ontology highlight
ABSTRACT: Background
Co-design (or the participation of users) has shown great potential in the eHealth domain, demonstrating positive results. Nevertheless, the co-design approach cannot guarantee the usability of the system designed, and usability assessment is a complex analysis to perform, as evaluation criteria will differ depending on the usability framework (or set of criteria) used. ISO (International Organization for Standardization) on usability (ISO 9241-210), Nielsen heuristic, and Garrett element of user experience inform different yet complementary aspects of usability.Objective
This study aims to assess the usability and user experience of a co-design prototype by combining 3 complementary frameworks.Methods
To help caregivers provide care for functionally impaired older people, an eHealth tool was co-designed with caregivers, health and social service professionals, and community workers assisting caregivers. The prototype was a website that aims to support the help-seeking process for caregivers (finding resources) and allow service providers to advertise their services (offering resources). We chose an exploratory study method to assess usability in terms of each objective. The first step was to assess users' first impressions of the website. The second was a task scenario with a think-aloud protocol. The final step was a semistructured interview. All steps were performed individually (with a moderator) in a single session. The data were analyzed using 3 frameworks.Results
A total of 10 participants were recruited, 5 for each objective of the website. We were able to identify several usability problems, most of which were located in the information design and interface design dimensions (Garrett framework). Problems in both dimensions were mainly coded as effectiveness and efficiency (ISO framework) and error prevention and match between the systemand the real world (Nielsen heuristic).Conclusions
Our study provided a novel contribution about usability analysis by combining the 3 different models to classify the problems found. This combination provided a holistic understanding of the usability improvements needed. It can also be used to analyze other eHealth products.International registered report identifier (irrid)
RR2-10.2196/11634.
SUBMITTER: Tremblay M
PROVIDER: S-EPMC8411328 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:INTRODUCTION:Reimbursement decisions on orphan drugs carry significant uncertainty, and as the amount increases, so does the risk of making a wrong decision, where harms outweigh benefits. Consequently, patients often face limited access to orphan drugs. Managed access programmes (MAPs) are a mechanism for managing risk while enabling access to potentially beneficial drugs. Patients and their caregivers have expressed support for these programmes and see patient input as critical to successful implementation. However, they have yet to be systematically involved in their design. OBJECTIVE:The aim of this study was to co-design with patients and caregivers a tool for the development of managed access programmes. METHODS:Building upon established relationships with the Canadian Organization for Rare Disorders, the project team collaborated with patients and caregivers using the principles of participatory action research. Data were collected at two workshops and analysed using a thematic network approach. RESULTS:Patients and caregivers co-designed a checklist comprised of six aspects of an ideal MAP relating to accountability (programme goals); governance (MAP-specific committee oversight, patient input, international collaboration); and evidence collection (outcome measures and continuation criteria, on-going monitoring and registries). They recognized that health-care resources are finite and considered disease or drug eligibility criteria for deciding when to use a MAP (eg drugs treating diseases for which there are no other legitimate alternatives). CONCLUSIONS:A patient and caregiver-designed checklist was created, which emphasized patient involvement and transparency. Further research is needed to examine the feasibility of this checklist and roles for other stakeholders.
| S-EPMC6250858 | biostudies-other
Project description:BACKGROUND:Informal caregivers are family members or close friends who provide unpaid help to individuals with acute or chronic health conditions so that they can manage daily life tasks. The greatest source of health information is the internet for meeting the needs of caregivers. However, information on the internet may not be scientifically valid, it may be written in language that is difficult to read, and is often in very large doses. 90Second Caregiver is a health letter whose aim is to disseminate knowledge to caregivers in a user-friendly, weekly format, in order to improve their wellbeing. OBJECTIVE:The main objective was to test a sample of 90Second Caregiver health letters in order to assess their usability and to optimize the design and content of the health letters. METHODS:Usability research themes were assessed using semi-structured phone interviews, incorporating the Think Aloud method with retrospective questioning. RESULTS:Usability was assessed in the context of five main themes: understandability and learnability, completeness, relevance, and quality and credibility of the health letter content, as well as design and format. Caregivers generally provided positive feedback regarding the usability of the letters. The usability feedback was used to refine 90Second Caregiver in order to improve the design and content of the series. Based on the results of this study, it may be of maximum benefit to target the series towards individuals who are new to caregiving or part-time caregivers, given that these caregivers of the sample found the letters more useful and relevant and had the most positive usability experiences. CONCLUSIONS:The findings assisted in the improvement of the 90Second Caregiver template, which will be used to create future health letters and refine the letters that have already been created. The findings have implications for who the 90Second Caregiver series should be targeting (ie, newer or part-time caregivers) in order to be maximally impactful in improving mental health and wellbeing-related outcomes for caregivers, such as self-efficacy and caregiving knowledge. The results of this study may be generalizable to the examination of other electronic health information formats, making them valuable to future researchers testing the usability of health information products. In addition, the methods used in this study are useful for usability hypothesis generation. Lastly, our 90Second delivery approach can generate information useful for a set of similar products (eg, weekly health letters targeted towards other conditions/populations).
| S-EPMC7055838 | biostudies-literature
Project description:BackgroundMobile eHealth apps have been used as a complementary treatment to increase the quality of life of patients and provide new opportunities for the management of rheumatic diseases. Telemedicine, particularly in the areas of prevention, diagnostics, and therapy, has become an essential cornerstone in the care of patients with rheumatic diseases.ObjectiveThis study aims to improve the design and technology of YogiTherapy and evaluate its usability and quality.MethodsWe newly implemented the mobile eHealth app YogiTherapy with a modern design, the option to change language, and easy navigation to improve the app's usability and quality for patients. After refinement, we evaluated the app by conducting a study with 16 patients with AS (4 female and 12 male; mean age 48.1, SD 16.8 y). We assessed the usability of YogiTherapy with a task performance test (TPT) with a think-aloud protocol and the quality with the German version of the Mobile App Rating Scale (MARS).ResultsIn the TPT, the participants had to solve 6 tasks that should be performed on the app. The overall task completion rate in the TPT was high (84/96, 88% completed tasks). Filtering for videos and navigating to perform an assessment test caused the largest issues during the TPT, while registering in the app and watching a yoga video were highly intuitive. Additionally, 12 (75%) of the 16 participants completed the German version of MARS. The quality of YogiTherapy was rated with an average MARS score of 3.79 (SD 0.51) from a maximum score of 5. Furthermore, results from the MARS questionnaire demonstrated a positive evaluation regarding functionality and aesthetics.ConclusionsThe refined and tested YogiTherapy app showed promising results among most participants. In the future, the app could serve its function as a complementary treatment for patients with AS. For this purpose, surveys with a larger number of patients should still be conducted. As a substantial advancement, we made the app free and openly available on the iOS App and Google Play stores.
| S-EPMC10751630 | biostudies-literature
Project description:BackgroundeHealth has the potential to improve outcomes such as physical activity or balance in older adults receiving geriatric rehabilitation. However, several challenges such as scarce evidence on effectiveness, feasibility, and usability hinder the successful implementation of eHealth in geriatric rehabilitation.ObjectiveThe aim of this systematic review was to assess evidence on the effectiveness, feasibility, and usability of eHealth interventions in older adults in geriatric rehabilitation.MethodsWe searched 7 databases for randomized controlled trials, nonrandomized studies, quantitative descriptive studies, qualitative research, and mixed methods studies that applied eHealth interventions during geriatric rehabilitation. Included studies investigated a combination of effectiveness, usability, and feasibility of eHealth in older patients who received geriatric rehabilitation, with a mean age of ≥70 years. Quality was assessed using the Mixed Methods Appraisal Tool and a narrative synthesis was conducted using a harvest plot.ResultsIn total, 40 studies were selected, with clinical heterogeneity across studies. Of 40 studies, 15 studies (38%) found eHealth was at least as effective as non-eHealth interventions (56% of the 27 studies with a control group), 11 studies (41%) found eHealth interventions were more effective than non-eHealth interventions, and 1 study (4%) reported beneficial outcomes in favor of the non-eHealth interventions. Of 17 studies, 16 (94%) concluded that eHealth was feasible. However, high exclusion rates were reported in 7 studies of 40 (18%). Of 40 studies, 4 (10%) included outcomes related to usability and indicated that there were certain aging-related barriers to cognitive ability, physical ability, or perception, which led to difficulties in using eHealth.ConclusionseHealth can potentially improve rehabilitation outcomes for older patients receiving geriatric rehabilitation. Simple eHealth interventions were more likely to be feasible for older patients receiving geriatric rehabilitation, especially, in combination with another non-eHealth intervention. However, a lack of evidence on usability might hamper the implementation of eHealth. eHealth applications in geriatric rehabilitation show promise, but more research is required, including research with a focus on usability and participation.
| S-EPMC8414304 | biostudies-literature
Project description:BackgroundThe use of patient health and treatment information captured in structured and unstructured formats in computerized electronic health record (EHR) repositories could potentially augment the detection of safety signals for drug products regulated by the US Food and Drug Administration (FDA). Natural language processing and other artificial intelligence (AI) techniques provide novel methodologies that could be leveraged to extract clinically useful information from EHR resources.ObjectiveOur aim is to develop a novel AI-enabled software prototype to identify adverse drug event (ADE) safety signals from free-text discharge summaries in EHRs to enhance opioid drug safety and research activities at the FDA.MethodsWe developed a prototype for web-based software that leverages keyword and trigger-phrase searching with rule-based algorithms and deep learning to extract candidate ADEs for specific opioid drugs from discharge summaries in the Medical Information Mart for Intensive Care III (MIMIC III) database. The prototype uses MedSpacy components to identify relevant sections of discharge summaries and a pretrained natural language processing (NLP) model, Spark NLP for Healthcare, for named entity recognition. Fifteen FDA staff members provided feedback on the prototype's features and functionalities.ResultsUsing the prototype, we were able to identify known, labeled, opioid-related adverse drug reactions from text in EHRs. The AI-enabled model achieved accuracy, recall, precision, and F1-scores of 0.66, 0.69, 0.64, and 0.67, respectively. FDA participants assessed the prototype as highly desirable in user satisfaction, visualizations, and in the potential to support drug safety signal detection for opioid drugs from EHR data while saving time and manual effort. Actionable design recommendations included (1) enlarging the tabs and visualizations; (2) enabling more flexibility and customizations to fit end users' individual needs; (3) providing additional instructional resources; (4) adding multiple graph export functionality; and (5) adding project summaries.ConclusionsThe novel prototype uses innovative AI-based techniques to automate searching for, extracting, and analyzing clinically useful information captured in unstructured text in EHRs. It increases efficiency in harnessing real-world data for opioid drug safety and increases the usability of the data to support regulatory review while decreasing the manual research burden.
| S-EPMC10538589 | biostudies-literature
Project description:BackgroundSupporting patients to self-manage their chronic kidney disease (CKD) has been identified as a research priority by patients with CKD and those who care for them. Self-management has been shown to slow CKD progression and improve the quality of life of individuals living with the disease. Previous work has identified a need for a person-centered, theory-informed, web-based tool for CKD self-management that can be individualized to a patient's unique situation, priorities, and preferences. We addressed this gap using an integrated knowledge translation method and patient engagement principles.ObjectiveThe aim of this study is to conduct systematic co-design and usability testing of a web-based self-management prototype for adults with CKD (nondialysis and nontransplant) and their caregivers to enhance self-management support.MethodsA multistep, iterative system development cycle was used to co-design and test the My Kidneys My Health prototype. The 3-step process included creating website features and content using 2 sequential focus groups with patients with CKD and caregivers, heuristic testing using the 10 heuristic principles by Nielsen, and usability testing through in-person 60-minute interviews with patients with CKD and their caregivers. Patients with CKD, caregivers, clinicians, researchers, software developers, graphic designers, and policy makers were involved in all steps of this study.ResultsIn step 1, 18 participants (14 patients and 4 caregivers) attended one of the 2 sequential focus groups. The participants provided specific suggestions for simplifying navigation as well as suggestions to incorporate video, text, audio, interactive components, and visuals to convey information. A total of 5 reviewers completed the heuristic analysis (step 2), identifying items mainly related to navigation and functionality. Furthermore, 5 participants completed usability testing (step 3) and provided feedback on video production, navigation, features and functionality, and branding. Participants reported visiting the website repeatedly for the following features: personalized food tool, my health care provider question list, symptom guidance based on CKD severity, and medication advice. Usability was high, with a mean system usability score of 90 out of 100.ConclusionsThe My Kidneys My Health prototype is a systematically developed, multifaceted, web-based CKD self-management support tool guided by the theory and preferences of patients with CKD and their caregivers. The website is user friendly and provides features that improve user experience by tailoring the content and resources to their needs. A feasibility study will provide insights into the acceptability of and engagement with the prototype and identify preliminary patient-reported outcomes (eg, self-efficacy) as well as potential factors related to implementation. This work is relevant given the shift to virtual care during the current pandemic times and provides patients with support when in-person care is restricted.
| S-EPMC7902181 | biostudies-literature
Project description:Bone is a highly responsive organ, which continuously adapts to the environment it is subjected to in order to withstand metabolic demands. These events are difficult to study in this particular tissue in vivo, due to its rigid, mineralised structure and inaccessibility of the cellular component located within. This manuscript presents the development of a micron-scale bone organoid prototype, a concept that can allow the study of bone processes at the cell-tissue interface. The model is constructed with a combination of primary female osteoblastic and osteoclastic cells, seeded onto femoral head micro-trabeculae, where they recapitulate relevant phenotypes and functions. Subsequently, constructs are inserted into a simulated microgravity bioreactor (NASA-Synthecon) to model a pathological state of reduced mechanical stimulation. In these constructs, we detected osteoclastic bone resorption sites, which were different in morphology in the simulated microgravity group compared to static controls. Once encapsulated in human fibrin and exposed to analogue microgravity for 5 days, masses of bone can be observed being lost from the initial structure, allowing to simulate the bone loss process further. Constructs can function as multicellular, organotypic units. Large osteocytic projections and tubular structures develop from the initial construct into the matrix at the millimetre scale. Micron-level fragments from the initial bone structure are detected travelling along these tubules and carried to sites distant from the native structure, where new matrix formation is initiated. We believe this model allows the study of fine-level physiological processes, which can shed light into pathological bone loss and imbalances in bone remodelling.
| S-EPMC8140135 | biostudies-literature
Project description:BACKGROUND:Sport participation is associated with a risk of sports-related injuries and illnesses, and Paralympic athletes' additional medical issues can be a challenge to health care providers and medical staff. However, few prospective studies have assessed sports-related injuries and illnesses in Paralympic sport (SRIIPS) over time. Advances in mobile phone technology and networking systems offer novel opportunities to develop innovative eHealth applications for collection of athletes' self-reports. Using eHealth applications for collection of self-reported SRIIPS is an unexplored area, and before initiation of full-scale research of SRIIPS, the feasibility and usability of such an approach needs to be ascertained. OBJECTIVE:The aim of this study was to perform a 4-week pilot study and (1) evaluate the monitoring feasibility and system usability of a novel eHealth application for self-reported SRIIPS and (2) report preliminary data on SRIIPS. METHODS:An eHealth application for routine collection of data from athletes was developed and adapted to Paralympic athletes. A 4-week pilot study was performed where Paralympic athletes (n=28) were asked to weekly self-report sport exposure, training load, general well-being, pain, sleep, anxiety, and possible SRIIPS. The data collection was followed by a poststudy use assessment survey. Quantitative data related to the system use (eg, completed self-reports, missing responses, and errors) were analyzed using descriptive statistics. The qualitative feasibility and usability data provided by the athletes were condensed and categorized using thematic analysis methods. RESULTS:The weekly response rate was 95%. The athletes were of the opinion that the eHealth application was usable and feasible but stated that it was not fully adapted to Paralympic athletes and their impairments. For example, it was difficult to understand how a new injury or illness should be identified when the impairment was involved. More survey items related to the impairments were requested, as the athletes perceived that injuries and illnesses often occurred because of the impairment. Options for description of multifactorial incidents including an injury, an illness, and the impairment were also insufficient. Few technical issues were encountered, but athletes with visual impairment reported usability difficulties with the speech synthesizer. An incidence rate of 1.8 injuries and 1.7 illnesses per 100 hours of athlete exposure were recorded. The weekly pain prevalence was 56% and the impairment contributed to 20% of the reported incidents. CONCLUSIONS:The novel eHealth-based application for self-reported SRIIPS developed and tested in this pilot study was generally feasible and usable. With some adaptation to accommodate Paralympic athletes' prerequisites and improved technical support for athletes with visual impairment, this application can be recommended for use in prospective studies of SRIIPS. TRIAL REGISTRATION:ClinicalTrials.gov NCT02788500; https://clinicaltrials.gov/ct2/show/NCT02788500 (Archived by WebCite at http://www.webcitation.org/6v56OqTeP).
| S-EPMC5729228 | biostudies-literature
Project description:ObjectiveInformal caregivers (family and friends) of people with cancer are often unprepared for their caregiving role, leading to increased burden or distress. Comprehensive Health Enhancement Support System (CHESS) is a Web-based lung cancer information, communication, and coaching system for caregivers. This randomized trial reports the impact on caregiver burden, disruptiveness, and mood of providing caregivers access to CHESS versus the Internet with a list of recommended lung cancer websites.MethodsA total of 285 informal caregivers of patients with advanced nonsmall cell lung cancer were randomly assigned to a comparison group that received Internet or a treatment group that received Internet and CHESS. Caregivers were provided a computer and Internet service if needed. Written surveys were completed at pretest and during the intervention period bimonthly for up to 24 months. Analyses of covariance (ANCOVAs) compared the intervention's effect on caregivers' disruptiveness and burden (CQOLI-C), and negative mood (combined Anxiety, Depression, and Anger scales of the POMS) at 6 months, controlling for blocking variables (site, caregiver's race, and relationship to patient) and the given outcome at pretest.ResultsCaregivers randomized to CHESS reported lower burden, t(84) = 2.36, p = .021, d = .39, and negative mood, t(86) = 2.82, p = .006, d = .44, than those in the Internet group. The effect on disruptiveness was not significant.ConclusionsAlthough caring for someone with a terminal illness will always exact a toll on caregivers, eHealth interventions like CHESS may improve caregivers' understanding and coping skills and, as a result, ease their burden and mood.
| S-EPMC4121384 | biostudies-literature
Project description:ObjectivesWe seek to develop a prototype software analytical tool to augment FDA regulatory reviewers' capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool.MethodsA prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use.ResultsAll usability test participants cited the tool's ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool's automated literature search relative to a manual 'all fields' PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools.ConclusionsUsability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction.
| S-EPMC5373771 | biostudies-literature