A Mobile App-Based Intervention for Depression: End-User and Expert Usability Testing Study.
Ontology highlight
ABSTRACT:
SUBMITTER: Fuller-Tyszkiewicz M
PROVIDER: S-EPMC6127496 | biostudies-literature | 2018 Aug
REPOSITORIES: biostudies-literature
Publications
A Mobile App-Based Intervention for Depression: End-User and Expert Usability Testing Study.
Fuller-Tyszkiewicz Matthew M Richardson Ben B Klein Britt B Skouteris Helen H Christensen Helen H Austin David D Castle David D Mihalopoulos Cathrine C O'Donnell Renee R Arulkadacham Lilani L Shatte Adrian A Ware Anna A
JMIR mental health 20180823 3
<h4>Background</h4>Despite the growing number of mental health apps available for smartphones, the perceived usability of these apps from the perspectives of end users or health care experts has rarely been reported. This information is vital, particularly for self-guided mHealth interventions, as perceptions of navigability and quality of content are likely to impact participant engagement and treatment compliance.<h4>Objective</h4>The aim of this study was to conduct a usability evaluation of ...[more]
Similar Datasets
Project description:BackgroundBreastfeeding is proven to have lasting health benefits for both mothers and infants; however, 6-month exclusive breastfeeding rate remains below 20% in Thailand. Although the number of research literature and commercial apps for breastfeeding women is significantly growing, they are country-specific and restricted to English-speaking users. There exists a major knowledge gap on how mobile health apps could support breastfeeding in Thailand. To address these gaps, MoomMae has been developed with the intention to support Thai women in breastfeeding outside of their homes and in keeping their feeding records.ObjectiveThe aim of this study was to evaluate the usability and usefulness of MoomMae, a mobile phone app designed to support breastfeeding women.MethodsOur study was reviewed and approved by Thailand's National Science and Technology Development Agency (NSTDA) ethics committee. A total of 21 breastfeeding women with at least one Android phone or tablet were recruited via convenience and snowball sampling. The study process for each participant was as follows: the participant was requested to attend a preuse interview and given the app to use for 4 weeks. Following this period, a postuse interview was conducted to examine the usability and usefulness of the app. Both sessions were held individually and audiorecorded for qualitative analysis.ResultsThe mean scores of usability and usefulness from the postuse survey were 4.33 (SD 0.87; range 1-5) and 4.60 (SD 0.74; range 2-5). Our qualitative analysis revealed a total of 137 feedbacks: 71 related to usability and 66 associated with usefulness. A further sentimental analysis showed that comments on usability were generally negative (59 negative, 11 positive, and 1 neutral), and comments on usefulness were relatively positive (56 positive, 9 negative, and 1 neutral). We discovered 26 unique design issues and proposed recommendations for future improvement.ConclusionsOur usability and usefulness assessment of MoomMae demonstrated that MoomMae has a great potential to be a useful self-management tool for breastfeeding mothers in Thailand. The qualitative analysis suggested that the app is supportive of breastfeeding on demand, but the flow and inputs of the app should be redesigned to be more intuitive. For future implementations, the most desirable feature is a pump-reminding notification system.
| S-EPMC5807626 | biostudies-literature
Project description:BackgroundThe treatment for cancer can have a negative impact not only on physical well-being but also on mental health and the quality of life (QoL). Health apps enable the monitoring of different parameters, but to date, there are only few that support patients with cancer and none that focuses on the assessment of QoL. Furthermore, patients as stakeholders are often only integrated at the late stage of the development process, if at all.ObjectiveThe aim of this research was to develop and evaluate a smartphone app (Lion-App) to enable patients with cancer to autonomously measure the QoL with an iterative, user-centered approach.MethodsPatients with cancer were involved in a 3-stage process from conceptualization to the point when the app was available on the tester's private device. First, focus groups with members (N=21) of cancer support groups were conducted to understand their expectations and needs. Thereafter, individual tests were performed. After developing a prototype that incorporated findings from the focus groups, a second test cycle was conducted, followed by a beta test lasting 2 months. In our app, the QoL can be assessed via a patient diary and an integrated questionnaire. Through all stages, usability was evaluated using the modular extended version of the User Experience Questionnaire (UEQ+), including the calculation of a key performance indicator (KPI). If possible, the impact of sex on the results was evaluated. As part of the beta test, usage rates as well as age-dependent differences were also assessed.ResultsA total of 21 participants took part in the initial 3 focus groups. In the subsequent usability testing (N=18), 17 (94%) participants rated their impression through the UEQ+, with a mean KPI of 2.12 (SD 0.64, range: -3 to 3). In the second usability test (N=14), the mean KPI increased to 2.28 (SD=0.49). In the beta test, the usage rate of 19 participants was evaluated, of whom 14 (74%) also answered the UEQ+ (mean KPI 1.78, SD 0.84). An influence of age on the number of questionnaire responses in Lion-App was observed, with a decrease in responses with increasing age (P=.02). Sex-dependent analyses were only possible for the first usability test and the beta test. The main adjustments based on user feedback were a restructuring of the diary as well as integration of a shorter questionnaire to assess the QoL.ConclusionsThe iterative, user-centered approach for development and usability testing resulted in positive evaluations of Lion-App. Our app was rated as suitable for everyday use to monitor the QoL of patients with cancer. Initial results indicated that the sex and age of participants seem to play only a minor role.
| S-EPMC10565618 | biostudies-literature
Project description:BackgroundYoung transgender women (YTW) are a key population for HIV-related risk reduction, yet very few interventions have been developed to meet their needs. Mobile health interventions with the potential for both efficacy and wide reach are a promising strategy to reduce HIV risk among YTW.ObjectiveThis study aims to adapt an efficacious group-based intervention to a mobile app, Project LifeSkills, to reduce HIV risk among YTW, and to test its acceptability and usability.MethodsThe group-based intervention was adapted to a mobile app, LifeSkills Mobile, with input from an expert advisory group and feedback from YTW collected during user-centered design sessions. A beta version of the app was then tested in a usability evaluation using a think-aloud protocol with debriefing interviews, recordings of screen activity, and assessments of usability via the Post-Study System Usability Questionnaire (PSSUQ) and the Health Information Technology Usability Evaluation Scale (Health-ITUES).ResultsYTW (n=8; age: mean 24 years, SD 3 years; racial or ethnic minority: 7/8, 88%) provided feedback on the app prototype in design sessions and then tested a beta version of the app in a usability trial (n=10; age: mean 24 years, SD 3 years; racial or ethnic minority: 8/10, 80%). Both usability ratings (Health-ITUES: mean 4.59, SD 0.86; scale range: 1-5) and ratings for satisfaction and accessibility (PSSUQ: mean 4.64, SD 0.90; scale range 1-5) were in the good to excellent range. No functional bugs were identified, and all mobile activities were deployed as expected. Participant feedback from the usability interviews indicated very good salience of the intervention content among the focal population. Participants' suggestions to further increase app engagement included adding animation, adding audio, and reducing the amount text.ConclusionsWe conclude that the LifeSkills Mobile app is a highly usable and engaging mobile app for HIV prevention among YTW.
| S-EPMC8047777 | biostudies-literature
Project description:BackgroundReporting of medication errors is one of the essential mechanisms to identify risky health care systems and practices that lead to medication errors. Unreported medication errors are a real issue; one of the identified causes is a burdensome medication error reporting system. An anonymous and user-friendly mobile app for reporting medication errors could be an alternative method of reporting medication error in busy health care settings.ObjectiveThe objective of this paper is to report usability testing of the Medication Error Reporting App (MERA), a mobile app for reporting medication errors anonymously.MethodsQuantitative and qualitative methods were employed involving 45 different testers (pharmacists, doctors, and nurses) from a large tertiary hospital in Malaysia. Quantitative data was retrieved using task performance and rating of MERA and qualitative data were retrieved through focus group discussions. Three sessions, with 15 testers each session, were conducted from January to March 2018.ResultsThe majority of testers were pharmacists (23/45, 51%), female (35/45, 78%), and the mean age was 36 (SD 9) years. A total of 135 complete reports were successfully submitted by the testers (three reports per tester) and 79.2% (107/135) of the reports were correct. There was significant improvement in mean System Usability Scale scores in each session of the development process (P<.001) and mean time to report medication errors using the app was not significantly different between each session (P=.70) with an overall mean time of 6.7 (SD 2.4) minutes. Testers found the app easy to use, but doctors and nurses were unfamiliar with terms used especially medication process at which error occurred and type of error. Although, testers agreed the app can be used in the future for reporting, they were apprehensive about security, validation, and abuse of feedback featured in the app.ConclusionsMERA can be used to report medication errors easily by various health care personnel and it has the capacity to provide feedback on reporting. However, education on medication error reporting should be provided to doctors and nurses in Malaysia and the security of the app needs to be established to boost reporting by this method.
| S-EPMC6320434 | biostudies-literature
Project description:BackgroundCare for children with special health care needs relies on a network of providers who work to address the medical, behavioral, developmental, educational, social, and economic needs of the child and their family. Family-directed, manually created visual depictions of care team composition (ie, care mapping) and detailed note-taking curated by caregivers (eg, care binders) have been shown to enhance care coordination for families of these children, but they are difficult to implement in clinical settings owing to a lack of integration with electronic health records and limited visibility of family-generated insights for care providers. Caremap is an electronic health record-integrated digital personal health record mobile app designed to integrate the benefits of care mapping and care binders. Currently, there is sparse literature describing end-user participation in the co-design of digital health tools. In this paper, we describe a project that evaluated the usability and proof of concept of the Caremap app through end-user simulation.ObjectiveThis study aimed to conduct proof-of-concept testing of the Caremap app to coordinate care for children with special health care needs and explore early end-user engagement in simulation testing. The specific aims included engaging end users in app co-design via app simulation, evaluating the usability of the app using validated measures, and exploring user perspectives on how to make further improvements to the app.MethodsCaregivers of children with special health care needs were recruited to participate in a simulation exercise using Caremap to coordinate care for a simulated case of a child with complex medical and behavioral needs. Participants completed a postsimulation questionnaire adapted from 2 validated surveys: the Pediatric Integrated Care Survey (PICS) and the user version of the Mobile Application Rating Scale (uMARS). A key informant interview was also conducted with a liaison to Spanish-speaking families regarding app accessibility for non-English-speaking users.ResultsA Caremap simulation was successfully developed in partnership with families of children with special health care needs. Overall, 38 families recruited from 19 different US states participated in the simulation exercise and completed the survey. The average rating for the survey adapted from the PICS was 4.1 (SD 0.82) out of 5, and the average rating for the adapted uMARS survey was 4 (SD 0.83) out of 5. The highest-rated app feature was the ability to track progress toward short-term, patient- and family-defined care goals.ConclusionsInternet-based simulation successfully facilitated end-user engagement and feedback for a digital health care coordination app for families of children with special health care needs. The families who completed simulation with Caremap rated it highly across several domains related to care coordination. The simulation study results elucidated key areas for improvement that translated into actionable next steps in app development.
| S-EPMC10495855 | biostudies-literature
Project description:BackgroundMobile device-based tools to help adolescents practice skills outside of cognitive behavioral therapy (CBT) sessions for treating an anxiety disorder may lead to greater treatment gains.ObjectiveThis study aimed to develop, design, and test the acceptability, learnability, heuristics, and usability of MindClimb, a smartphone-based app for adolescents with anxiety to use between CBT sessions to plan and complete exposure activities using skills (cognitive, relaxation, exposure practice, and reward) learned in treatment.MethodsThis 3-phase study took place from August 2015 to December 2018. In phase 1, the app was designed and developed in consultation with young people and CBT therapists to identify desired functions and content. Feedback was subjected to thematic analysis using a general inductive approach. In phase 2, we conducted 2 high-fidelity testing sessions using the think-aloud approach (acceptability, learnability, usability) and 10-item System Usability Scale with 10 adolescents receiving CBT. The high-fidelity MindClimb app was evaluated by 5 app developers based on Nielsen's usability heuristics and 5-point severity ranking scale. In phase 3, a total of 8 adolescents and 3 therapists assessed the usability of MindClimb during CBT sessions by recording the frequency of skills practice, use of MindClimb features, satisfaction with the app, and barriers and facilitators to app use during treatment.ResultsFeedback from phase 1 consultations indicated that the app should (1) be responsive to user needs and preferences, (2) be easy to use and navigate, (3) have relevant content to the practice of CBT for anxiety, and (4) be aesthetically appealing. Using this feedback as a guide, a fully functional app prototype for usability testing and heuristic evaluation was developed. In phase 2, think-aloud and usability data resulted in minor revisions to the app, including refinement of exposure activities. The average system usability score was 77 in both testing cycles, indicating acceptable usability. The heuristic evaluation by app developers identified only minor errors (eg, loading speed of app content, with a score of 1 on the severity ranking scale). In phase 3, adolescents considered app features for completing exposure (6.2/10) and relaxation (6.4/10) modestly helpful. Both adolescents (average score 11.3/15, SD 1.6) and therapists (average score 10.0/12, 2.6 SD) reported being satisfied with the app.ConclusionsThe user-centered approach to developing and testing MindClimb resulted in a mobile health app that can be used by adolescents during CBT for anxiety. Evaluation of the use of this app in a clinical practice setting demonstrated that adolescents and therapists generally felt it was helpful for CBT practice outside of therapy sessions. Implementation studies with larger youth samples are necessary to evaluate how to optimize the use of technology in clinical care and examine the impact of the app plus CBT on clinical care processes and patient outcomes.
| S-EPMC7755529 | biostudies-literature
Project description:BACKGROUND:Distress is prevalent in cancer survivors. Stress management interventions can reduce distress and improve quality of life for cancer patients, but many people with cancer are unfortunately not offered or able to attend such in-person stress management interventions. OBJECTIVE:The objective of this study was to develop an evidence-based stress management intervention for patients living with cancer that can be delivered electronically with wide reach and dissemination. This paper describes the design and development process of a technology-based stress management intervention for cancer survivors, including the exploration phase, intervention content development, iterative software development (including design, development, and formative evaluation of low- and high-level prototypes), and security and privacy considerations. METHODS:Design and development processes were iterative and performed in close collaboration with key stakeholders (N=48). In the exploration phase, identifying needs and requirements for the intervention, 28 participants gave input, including male and female cancer survivors (n=11) representing a wide age range (31-81 years) and cancer diagnoses, healthcare providers (n=8) including psychosocial oncology experts, and eHealth experts (n=9) including information technology design and developers. To ensure user involvement in each phase various user-centered design and service design methods were included, such as interviews, usability testing, and think aloud processes. Overall, participants were involved usability testing in the software development and formative evaluation phase, including cancer survivors (n=6), healthy volunteers (n=7), health care providers (n=2), and eHealth experts (n=5). Intervention content was developed by stress management experts based on well-known cognitive behavioral stress management strategies and adjusted to electronic format through multiple iterations with stakeholders. Privacy and security issues were considered throughout. RESULTS:The design and development process identified a variety of stakeholder requirements. Cancer survivors preferred stress management through a mobile app rather than through a personal computer (PC) and identified usefulness, easy access, user friendliness, use of easily understandable language, and many brief sections rather than longer ones as important components of the intervention. These requirements were also supported by recommendations from health care providers and eHealth experts. The final intervention was named StressProffen and the hospital Privacy and Security Protection Committee was part of the final intervention approval to also ensure anchoring in the hospital organization. CONCLUSIONS:Interventions, even evidence-based, have little impact if not actively used. This study illustrates how user-centered design and service design can be applied to identify and incorporate essential stakeholder aspects in the entire design and development process. In combination with evidence-based concepts, this process facilitated development of a stress management intervention truly designed for the end users, in this case, cancer survivors. TRIAL REGISTRATION:ClinicalTrials.gov NCT02939612; https://clinicaltrials.gov/ct2/show/NCT02939612 (Archived at WebCite at http://www.webcitation.org/71l9HcfcB).
| S-EPMC6334690 | biostudies-literature
Project description:BackgroundConcussion is a common injury among Canadian children and adolescents that leads to a range of neurobehavioral deficits. However, noticeable gaps continue to exist in the management of pediatric concussion, with poor health outcomes associated with the inadequate application of best practice guidelines.ObjectiveThe aim of this study was to describe the development and assess the usability of a mobile phone app to aid youth in the self-management of concussion. A secondary objective was to assess the usefulness of the app.MethodsAn agile user-centered design approach was used to develop the technology, followed by a formative lab-based usability study for assessment and improvement proposals. Youths aged 10 to 18 years with a history of concussion and health care professionals involved in concussion management were recruited. This study included participants performing 12 tasks with the mobile phone app while using the think aloud protocol and the administration of the System Usability Scale (SUS), posttest questionnaire, and a semistructured interview.ResultsA mobile phone app prototype called NeuroCare, an easily accessible pediatric concussion management intervention that provides easy access to expert-informed concussion management strategies and helps guide youth in self-managing and tracking their concussion recovery, was developed. A total of 7 youths aged between 10 and 18 years with a history of concussion and 7 health care professionals were recruited. The mean SUS score was 81.9, mean task success rates were greater than 90% for 92% (11/12) of the tasks, 92% (11/12) of tasks had a total error frequency of less than 11 errors, and mean task completion times were less than 2 min for 100% of the tasks.ConclusionsResults suggest that participants rated this app as highly usable, acceptable to users, and that it may be useful in helping youth self-manage concussion.
| S-EPMC6658289 | biostudies-literature
Project description:BackgroundThe mobile health (mHealth) app trustworthiness (mHAT) checklist was created to identify end users' opinions on the characteristics of trustworthy mHealth apps and to communicate this information to app developers. To ensure that the checklist is suited for all relevant stakeholders, it is necessary to validate its contents.ObjectiveThe purpose of this study was to assess the feasibility of the mHAT checklist by modifying its contents according to ratings and suggestions from stakeholders familiar with the process of developing, managing, or curating mHealth apps.MethodsA 44-item online survey was administered to relevant stakeholders. The survey was largely comprised of the mHAT checklist items, which respondents rated on a 5-point Likert scale, ranging from completely disagree (1) to completely agree (5).ResultsIn total, seven professional backgrounds were represented in the survey: administrators (n=6), health professionals (n=7), information technology personnel (n=6), managers (n=2), marketing personnel (n=3), researchers (n=5), and user experience researchers (n=8). Aside from one checklist item-"the app can inform end users about errors in measurements"-the combined positive ratings (ie, completely agree and agree) of the checklist items overwhelmingly exceeded the combined negative ratings (ie, completely disagree and disagree). Meanwhile, two additional items were included in the checklist: (1) business or funding model of the app and (2) details on app uninstallation statistics.ConclusionsOur results indicate that the mHAT checklist is a valuable resource for a broad range of stakeholders to develop trustworthy mHealth apps. Future studies should examine if the checklist works best for certain mHealth apps or in specific settings.
| S-EPMC7404005 | biostudies-literature
Project description:BACKGROUND:Supporting patient engagement and empowerment is increasingly seen as essential in providing person-centered health care to people with chronic illness. Mobile apps helping patients reflect on their concerns as preparation for consultations with their health care providers can have beneficial effects on the consultation quality. However, apps focusing on empowerment and personal strengths are still scarce. OBJECTIVE:This study aimed to (1) develop a mobile app to support patients with rheumatic diseases in reflecting on their strengths in preparation for consultations with health care providers and (2) explore patients' perceived usability of the app in a nonclinical test setting. METHODS:A prototype app was developed based on input from patients and health care providers, as reported in previous studies. The app was designed for use in self-management support settings aiming to promote awareness of strengths and to focus attention on strengths in the patient-health care provider dialogue. The features included in the prototype were as follows: (1) introduction to the topic of strengths, (2) list of examples of strengths to promote reflection and registration of own strengths, (3) summary of registered strengths, (4) value-based goal setting, (5) linking of strengths to goals, (6) summary of all registrations, and (7) options to share summary digitally or as a print version. In this study, the app was refined through a formative evaluation with patients and health care providers recruited from a specialized rheumatology hospital unit. Patients' perceptions of the app's usability were explored in a test setting with self-report measurements and semistructured interviews. The interviews were audiotaped, transcribed, and analyzed with directed content analysis. Data from questionnaires were analyzed with descriptive statistics. RESULTS:Developmental and formative evaluation included 18 patients and 7 health care providers. The evaluation resulted in minor adjustments to the prototype but no major changes in features. The usability testing included 12 patients. All participants found the usability acceptable; the median score on the System Usability Scale was 86.3 (range 70-100). All reported that it was meaningful and relevant to use the app. Out of 12 participants, 9 (75%) reported becoming more aware of their own strengths by using the app; 1 (8%) disagreed and 2 (17%) provided a neutral response. The results on the goal-related feature were mixed, with half of the patients finding it useful to link strengths to concrete goals. A statistically significant positive change from pre- to postintervention was identified on measures of self-efficacy and negative emotions. CONCLUSIONS:In this formative evaluation of a mobile app to promote patients' reflections on their strengths, patients perceived the app as meaningful and supporting awareness. The results suggest the usefulness of building in functionality to support use of strengths and goal attainment. Further studies on efficacy and usability in a clinical setting, including health care providers, are needed.
| S-EPMC7081135 | biostudies-literature