Dataset Information

Development of an Intervention Targeting Multiple Health Behaviors Among High School Students: Participatory Design Study Using Heuristic Evaluation and Usability Testing.

ABSTRACT:

Background

Mobile electronic platforms provide exciting possibilities for health behavior promotion. For instance, they can promote smoking cessation, moderate alcohol consumption, healthy eating, and physical activity. Young adults in Sweden are proficient in the use of technology, having been exposed to computers, smartphones, and the internet from an early age. However, with the high availability of mobile health (mHealth) interventions of varying quality, it is critical to optimize the usability of mHealth interventions to ensure long-term use of these health promotion interventions.

Objective

This study aims to investigate the usability of an mHealth intervention (LIFE4YOUth) targeting health behaviors among high school students through heuristic evaluation and usability testing.

Methods

A preliminary version of the LIFE4YOUth mHealth intervention, which was aimed at promoting healthy eating, physical activity, smoking cessation, and nonrisky drinking among high school students, was developed in early 2019. We completed a total of 15 heuristic evaluations and 5 usability tests to evaluate the usability of the mHealth intervention prototype to improve its functioning, content, and design.

Results

Heuristic evaluation from a total of 15 experts (10 employees and 5 university students, both women and men, aged 18-25 years) revealed that the major usability problems and the worst ratings, a total of 17 problems termed usability catastrophes, concerned shortcomings in displaying easy-to-understand information to the users or technical errors. The results of the usability testing including 5 high school students (both girls and boys, aged 15-18 years) showed that the design, quality, and quantity of content in the intervention may impact the users' level of engagement. Poor functionality was considered a major barrier to usability. Of the 5 participants, one rated the LIFE4YOUth intervention as poor, 2 rated as average, and 2 assessed it as good, according to the System Usability Scale.

Conclusions

High school students have high expectations of digital products. If an mHealth intervention does not offer optimal functions, they may cease to use it. Optimizing the usability of mHealth interventions is a critical step in the development process. Heuristic evaluation and usability testing in this study provided valuable knowledge about the prototype from a user's perspective. The findings may lead to the development of similar interventions targeting the high school population.

SUBMITTER: Mussener U

PROVIDER: S-EPMC7661261 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of an Intervention Targeting Multiple Health Behaviors Among High School Students: Participatory Design Study Using Heuristic Evaluation and Usability Testing.

Müssener Ulrika U Thomas Kristin K Linderoth Catharina C Löf Marie M Åsberg Katarina K Henriksson Pontus P Bendtsen Marcus M

JMIR mHealth and uHealth 20201029 10

<h4>Background</h4>Mobile electronic platforms provide exciting possibilities for health behavior promotion. For instance, they can promote smoking cessation, moderate alcohol consumption, healthy eating, and physical activity. Young adults in Sweden are proficient in the use of technology, having been exposed to computers, smartphones, and the internet from an early age. However, with the high availability of mobile health (mHealth) interventions of varying quality, it is critical to optimize t ...[more]

PMID: 33118942

Similar Datasets

Project description:BACKGROUND:Unhealthy lifestyle behaviors such as insufficient physical activity, unhealthy diet, smoking, and harmful use of alcohol tend to cluster (ie, individuals may be at risk from more than one lifestyle behavior that can be established in early childhood and adolescence and track into adulthood). Previous research has underlined the potential of lifestyle interventions delivered via mobile phones. However, there is a need for deepened knowledge on how to design mobile health (mHealth) interventions taking end user views into consideration in order to optimize the overall usability of such interventions. Adolescents are early adopters of technology and frequent users of mobile phones, yet research on interventions that use mobile devices to deliver multiple lifestyle behavior changes targeting at-risk high school students is lacking. OBJECTIVE:This protocol describes a participatory design study with the aim of developing an mHealth lifestyle behavior intervention to promote healthy lifestyles among high school students. METHODS:Through an iterative process using participatory design, user requirements are investigated in terms of technical features and content. The procedures around the design and development of the intervention, including heuristic evaluations, focus group interviews, and usability tests, are described. RESULTS:Recruitment started in May 2019. Data collection, analysis, and scientific reporting from heuristic evaluations and usability tests are expected to be completed in November 2019. Focus group interviews were being undertaken with high school students from October through December, and full results are expected to be published in Spring 2020. A planned clinical trial will commence in Summer 2020. The study was funded by a grant from the Swedish Research Council for Health, Working Life, and Welfare. CONCLUSIONS:The study is expected to add knowledge on how to design an mHealth intervention taking end users' views into consideration in order to develop a novel, evidence-based, low-cost, and scalable intervention that high school students want to use in order to achieve a healthier lifestyle. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID):DERR1-10.2196/14588.

Project description:BACKGROUND:Distress is prevalent in cancer survivors. Stress management interventions can reduce distress and improve quality of life for cancer patients, but many people with cancer are unfortunately not offered or able to attend such in-person stress management interventions. OBJECTIVE:The objective of this study was to develop an evidence-based stress management intervention for patients living with cancer that can be delivered electronically with wide reach and dissemination. This paper describes the design and development process of a technology-based stress management intervention for cancer survivors, including the exploration phase, intervention content development, iterative software development (including design, development, and formative evaluation of low- and high-level prototypes), and security and privacy considerations. METHODS:Design and development processes were iterative and performed in close collaboration with key stakeholders (N=48). In the exploration phase, identifying needs and requirements for the intervention, 28 participants gave input, including male and female cancer survivors (n=11) representing a wide age range (31-81 years) and cancer diagnoses, healthcare providers (n=8) including psychosocial oncology experts, and eHealth experts (n=9) including information technology design and developers. To ensure user involvement in each phase various user-centered design and service design methods were included, such as interviews, usability testing, and think aloud processes. Overall, participants were involved usability testing in the software development and formative evaluation phase, including cancer survivors (n=6), healthy volunteers (n=7), health care providers (n=2), and eHealth experts (n=5). Intervention content was developed by stress management experts based on well-known cognitive behavioral stress management strategies and adjusted to electronic format through multiple iterations with stakeholders. Privacy and security issues were considered throughout. RESULTS:The design and development process identified a variety of stakeholder requirements. Cancer survivors preferred stress management through a mobile app rather than through a personal computer (PC) and identified usefulness, easy access, user friendliness, use of easily understandable language, and many brief sections rather than longer ones as important components of the intervention. These requirements were also supported by recommendations from health care providers and eHealth experts. The final intervention was named StressProffen and the hospital Privacy and Security Protection Committee was part of the final intervention approval to also ensure anchoring in the hospital organization. CONCLUSIONS:Interventions, even evidence-based, have little impact if not actively used. This study illustrates how user-centered design and service design can be applied to identify and incorporate essential stakeholder aspects in the entire design and development process. In combination with evidence-based concepts, this process facilitated development of a stress management intervention truly designed for the end users, in this case, cancer survivors. TRIAL REGISTRATION:ClinicalTrials.gov NCT02939612; https://clinicaltrials.gov/ct2/show/NCT02939612 (Archived at WebCite at http://www.webcitation.org/71l9HcfcB).

Project description:BackgroundThe Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH) program is a tailored, progressive 12-week exercise program for people with hand problems due to rheumatoid arthritis. The program was shown to be clinically and cost-effective in a large clinical trial and is recommended by the UK National Institute for Health and Care Excellence (NICE) guidelines for rheumatoid arthritis in adults.ObjectiveWe have developed an online version of the SARAH program (mySARAH) to make the SARAH program widely accessible to people with rheumatoid arthritis. The purposes of this study were to develop mySARAH and to evaluate and address its usability issues.MethodsWe developed mySARAH using a three-step process and gaining feedback from patient contributors. After initial development, mySARAH was tested in two iterative usability cycles in nine participants using a simplified think-aloud protocol and self-reported questionnaires. We also evaluated if participants executed the SARAH exercises correctly after watching the exercise videos included on the website.ResultsA preliminary version of mySARAH consisting of six sessions over a 12-week period and delivered via text, exercise videos, images, exercise plan form, exercise calendar, and links to additional information on rheumatoid arthritis was developed. Five participants (1 male; 4 females; median age 64 years) and four participants (four females; median age 64.5 years) took part in the first and second usability testing cycles respectively. Usability issues identified from Cycle 1 such as having a navigation tutorial video and individualised feedback on pain levels were addressed prior to Cycle 2. The need for more instructions to complete the mySARAH patient forms was identified in Cycle 2 and was rectified. Self-reports from both cycles indicated that participants found the program useful and easy to use and were confident in performing the SARAH exercises themselves. Eight of the nine participants correctly demonstrated all the exercises.ConclusionsmySARAH is the first online hand exercise intervention for people with rheumatoid arthritis. We actively involved target users in the development and usability evaluation and ensured mySARAH met their needs and preferences.

Project description:BackgroundPatients with cancer require adequate preparation in self-management of treatment toxicities to reduce morbidity that can be achieved through well-designed digital technologies that are developed in co-design with patients and end users.ObjectiveWe undertook a user-centered co-design process in partnership with patients and other knowledge end users to develop and iteratively test an evidence-based and theoretically informed web-based cancer self-management program (I-Can Manage). The specific study aims addressed in 2 phases were to (1) identify from the perspective of patients with cancer and clinicians the desired content, features, and functionalities for an online self-management education and support (SMES) program to enable patient self-management of treatment toxicities (phase 1); (2) develop the SMES prototype based on human-centered, health literate design principles and co-design processes; and (3) evaluate usability of the I-Can Manage prototype through user-centered testing (phase 2).MethodsWe developed the I-Can Manage program using multiperspective data sources and based on humanistic and co-design principles with end users engaged through 5 phases of development. We recruited adult patients with lung, colorectal, and lymphoma cancer receiving systemic treatments from ambulatory clinics in 2 regional cancer programs for the qualitative inquiry phase. The design of the program was informed by data from qualitative interviews and focus groups, persona and journey mapping, theoretical underpinnings of social cognitive learning theory, and formalized usability testing using a cognitive think-aloud process and user satisfaction survey. A co-design team comprising key stakeholders (human design experts, patients/caregiver, clinicians, knowledge end users, and e-learning and digital design experts) was involved in the developmental process. We used a cognitive think-aloud process to test usability and participants completed the Post-Study System Usability Questionnaire (PSSUQ).ResultsIn the initial qualitative inquiry phase, 16 patients participated in interviews and 19 clinicians participated in interviews or focus groups and 12 key stakeholders participated in a persona journey mapping workshop to inform development of the program prototype. The I-Can Manage program integrates evidence-based information and strategies for the self-management of treatment toxicities and health-promoting behaviors in 6 e-learning modules (lay termed "chapters"), starting with an orientation to self-management. Behavioral exercises, patient written and video stories, downloadable learning resources, and online completion of goals and action plans were integrated across chapters. Patient participants (n=5) with different cancers, gender, and age worked through the program in the human factors laboratory using a cognitive think-aloud process and all key stakeholders reviewed each chapter of the program and approved revisions. Results of the PSSUQ (mean total score: 3.75) completed following the cognitive think-aloud process (n=5) suggest patient satisfaction with the usability of I-Can Manage.ConclusionsThe I-Can Manage program has the potential for activating patients in self-management of cancer and treatment toxicities but requires testing in a larger randomized controlled trial.

Project description:BackgroundStudents who are targets of bullying and who witness bullying are at high risk for negative mental health outcomes. Bystander training is essential to reduce bullying and the negative associated consequences for targets and bystanders. Resources necessary for program delivery, however, pose significant barriers for schools, particularly those in rural, low-income communities. Technology-based programs can reduce health disparities for students in these communities through cost-effective, easy-to-disseminate programming.ObjectiveThe aim of this study is to conduct usability testing of a bystander bullying web app prototype, STAC-T (technology-based STAC, which stands for the 4 bystander strategies Stealing the Show, Turning it Over, Accompanying Others, and Coaching Compassion) as an initial step in the development of a full-scale STAC-T intervention. Objectives include assessing usability and acceptability of the STAC-T prototype, understanding school needs and barriers to program implementation, and assessing differences in usability between school personnel and students.MethodsA sample of 16 participants, including school personnel and students recruited from 3 middle schools in rural, low-income communities, completed usability testing followed by a qualitative interview. Descriptive statistics, 2-tailed independent sample t tests, and consensual qualitative research were used to assess usability and program satisfaction and to extract themes related to acceptability, feasibility, needs, barriers, and feedback for intervention development.ResultsUsability testing indicated that the app was easy to use, acceptable, and feasible. Both school personnel (mean rating 89.6, SD 5.1) and students (mean rating 91.8, SD 7.0) rated the app well above the standard cutoff score for above-average usability (ie, 68), and both school personnel (mean rating 5.83, SD 0.41) and students (mean rating 6.10, SD 0.57) gave the app high user-friendliness ratings (0-7 scale, with 7 as high user-friendliness). The overall ratings also suggested that school personnel and students were satisfied with the program. Of the 6 school personnel who said they would recommend the program, 1 (17%), 4 (66%), and 1 (17%) rated the program as 3, 4, and 5 stars, respectively; 80% (8/10) of students said they would recommend the program; and 60% (6/10) and 40% (4/10) rated the program as 4 stars and 5 stars, respectively. Qualitative data revealed that school personnel and students found the STAC-T app to be useful, user-friendly, and relevant, while providing feedback related to the importance of digital learning activities that engage the user. Data from school personnel also indicated positive perceptions regarding program feasibility and probability of program adoption, with the most significant barrier being cost, suggesting the importance of considering the financial resources available to schools in rural, low-income communities when setting the price point for the full-scale STAC-T intervention.ConclusionsThis study provides support for the full-scale development of the STAC-T app and provides key information for revision to enhance used engagement.Trial registrationClinicalTrials.gov NCT04681495; https://clinicaltrials.gov/ct2/show/NCT04681495.

Project description:BackgroundIn Hong Kong, with an increasing number of children experiencing mental health issues, there is a need to not only develop innovative interventions but also develop comprehensive prevention interventions so as to reduce their anxiety symptoms and enhance their emotional management and interpersonal relationships.ObjectiveThe aim of this study was to determine the effectiveness of The Adventures of DoReMiFa, an integration model of the cognitive-behavioral approach and positive psychology by using digital game-based and school-based mental health enhancement intervention to magnify the social and emotional health and well-being of the school children in Hong Kong aged 9 to 11 years.MethodsA quasi-experimental design method was used to evaluate this digital game and school-based intervention. The Adventures of DoReMiFa was piloted in 4 primary schools where students were allocated to either an intervention or a control group. The participants were assessed at pre- and postintervention with a 6-month follow-up measuring their mental health knowledge, levels of anxiety symptoms, positive and negative thinking, perspective-taking, and self-esteem.ResultsA total of 459 primary school students from 4 primary schools participated in the study. The response rate on the questionnaires answered on the Web was up to 85.1% (391/459). Compared with the control group, the intervention group was found to have significant association with improved mental health knowledge at the time immediately after the intervention (beta=.46; P=.01) and in the 6-month postintervention period (beta=.66; P<.001); for perspective-taking, the intervention group had exhibited a significant improvement 6 months after the completion of the universal program (beta=1.50; P=.03). The intervention, however, was found not to be effective in reducing the rates of anxiety symptoms and negative thinking among the participating students.ConclusionsThe Adventures of DoReMiFa, an integration of a digital game-based and school-based mental health enhancement intervention, was shown to be effective in elevating the knowledge of mental health and promoting perspective-taking in the primary school students of Hong Kong. Although there was insufficient evidence to support a reduction in symptoms of anxiety and negative automatic thoughts, the overall results were still encouraging in that a preventive effect was found, indicating that the program has the potential to enhance the mental well-being of schoolchildren. It also suggests that knowledge enhancement may not necessarily lead to behavior change, and more focused effort may be needed to achieve the translation. The implications and limitations of this study and suggestions for future research were also discussed.

Dataset Information

Development of an Intervention Targeting Multiple Health Behaviors Among High School Students: Participatory Design Study Using Heuristic Evaluation and Usability Testing.

Background

Objective

Methods

Results

Conclusions

Publications

Development of an Intervention Targeting Multiple Health Behaviors Among High School Students: Participatory Design Study Using Heuristic Evaluation and Usability Testing.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets