Dataset Information

Development of a Just-in-Time Adaptive mHealth Intervention for Insomnia: Usability Study.

ABSTRACT: BACKGROUND:Healthy sleep is a fundamental component of physical and brain health. Insomnia, however, is a prevalent sleep disorder that compromises functioning, productivity, and health. Therefore, developing efficient treatment delivery methods for insomnia can have significant societal and personal health impacts. Cognitive behavioral therapy for insomnia (CBTI) is the recommended first-line treatment of insomnia but access is currently limited for patients, since treatment must occur in specialty sleep clinics, which suffer from an insufficient number of trained clinicians. Smartphone-based interventions offer a promising means for improving the delivery of CBTI. Furthermore, novel features such as real-time monitoring and assessment, personalization, dynamic adaptations of the intervention, and context awareness can enhance treatment personalization and effectiveness, and reduce associated costs. Ultimately, this "Just in Time Adaptive Intervention" for insomnia-an intervention approach that is acceptable to patients and clinicians, and is based on mobile health (mHealth) platform and tools-can significantly improve patient access and clinician delivery of evidence-based insomnia treatments. OBJECTIVE:This study aims to develop and assess the usability of a Just in Time Adaptive Intervention application platform called iREST ("interactive Resilience Enhancing Sleep Tactics") for use in behavioral insomnia interventions. iREST can be used by both patients and clinicians. METHODS:The development of iREST was based on the Iterative and Incremental Development software development model. Requirement analysis was based on the case study's description, workflow and needs, clinician inputs, and a previously conducted BBTI military study/implementation of the Just in Time Adaptive Intervention architecture. To evaluate the usability of the iREST mHealth tool, a pilot usability study was conducted. Additionally, this study explores the feasibility of using an off-the-shelf wearable device to supplement the subjective assessment of patient sleep patterns. RESULTS:The iREST app was developed from the mobile logical architecture of Just in Time Adaptive Intervention. It consists of a cross-platform smartphone app, a clinician portal, and secure 2-way communications platform between the app and the portal. The usability study comprised 19 Active Duty Service Members and Veterans between the ages of 18 and 60. Descriptive statistics based on in-app questionnaires indicate that on average, 12 (mean 12.23, SD 8.96) unique devices accessed the clinician portal per day for more than two years, while the app was rated as "highly usable", achieving a mean System Usability Score score of 85.74 (SD 12.37), which translates to an adjective rating of "Excellent". The participants also gave high scores on "ease of use and learnability" with an average score of 4.33 (SD 0.65) on a scale of 1 to 5. CONCLUSIONS:iREST provides a feasible platform for the implementation of Just in Time Adaptive Intervention in mHealth-based and remote intervention settings. The system was rated highly usable and its cross-platformness made it readily implemented within the heavily segregated smartphone market. The use of wearables to track sleep is promising; yet the accuracy of this technology needs further improvement. Ultimately, iREST demonstrates that mHealth-based Just in Time Adaptive Intervention is not only feasible, but also works effectively.

SUBMITTER: Pulantara IW

PROVIDER: S-EPMC5981058 | biostudies-literature | 2018 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of a Just-in-Time Adaptive mHealth Intervention for Insomnia: Usability Study.

Pulantara I Wayan IW Parmanto Bambang B Germain Anne A

JMIR human factors 20180517 2

<h4>Background</h4>Healthy sleep is a fundamental component of physical and brain health. Insomnia, however, is a prevalent sleep disorder that compromises functioning, productivity, and health. Therefore, developing efficient treatment delivery methods for insomnia can have significant societal and personal health impacts. Cognitive behavioral therapy for insomnia (CBTI) is the recommended first-line treatment of insomnia but access is currently limited for patients, since treatment must occur ...[more]

PMID: 29773529

Similar Datasets

Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.

Project description:BackgroundFalls are the leading cause of injury-related death in older adults. Due to various constraints, objective fall risk screening is seldom performed in clinical settings. Smartphones offer a high potential to provide fall risk screening for older adults in home settings. However, there is limited understanding of whether smartphone technology for falls screening is usable by older adults who present age-related changes in perceptual, cognitive, and motor capabilities.ObjectiveThe aims of this study were to develop a fall risk mobile health (mHealth) app and to determine the usability of the fall risk app in healthy, older adults.MethodsA fall risk app was developed that consists of a health history questionnaire and 5 progressively challenging mobility tasks to measure individual fall risk. An iterative design-evaluation process of semistructured interviews was performed to determine the usability of the app on a smartphone and tablet. Participants also completed a Systematic Usability Scale (SUS). In the first round of interviews, 6 older adults participated, and in the second round, 5 older adults participated. Interviews were videotaped and transcribed, and the data were coded to create themes. Average SUS scores were calculated for the smartphone and tablet.ResultsThere were 2 themes identified from the first round of interviews, related to perceived ease of use and perceived usefulness. While instructions for the balance tasks were difficult to understand, participants found it beneficial to learn about their risk for falls, found the app easy to follow, and reported confidence in using the app on their own. Modifications were made to the app, and following the second round of interviews, participants reported high ease of use and usefulness in learning about their risk of falling. Few differences were reported between using a smartphone or tablet. Average SUS scores ranged from 79 to 84.ConclusionsOur fall risk app was found to be highly usable by older adults as reported from interviews and high scores on the SUS. When designing a mHealth app for older adults, developers should include clear and simple instructions and preventative strategies to improve health. Furthermore, if the design accommodates for age-related sensory changes, smartphones can be as effective as tablets. A mobile app to assess fall risk has the potential to be used in home settings by older adults.

Project description:BackgroundThe experience of infertility and its treatment engenders considerable stress and is often described as an emotional rollercoaster. A mobile health (mHealth) app may be a novel solution to address the psychoeducational and psychosocial support needs of fertility patients because of its potential to reduce stress and increase patient empowerment. There are a few fertility-related apps that provide information and support to both men and women undergoing fertility treatment; however, none have documented their development and evaluation process.ObjectiveThis study aims to describe the development and evaluation process of a bilingual mHealth app, Infotility, designed to meet the psychoeducational and psychosocial support needs of men and women undergoing fertility treatment.MethodsTo develop the Infotility app, we adhered to the Medical Research Council guidelines for the development and evaluation of complex interventions. First, we conducted literature reviews and needs assessment surveys of fertility patients and health care providers who informed the content and design of the app. Second, we tested the intervention with a small group of end users who provided feedback on the design and appropriateness of the app's content. Third, we evaluated the uptake and usability of the app using a pre-post study design. Finally, we updated the app's content based on participants' feedback and searched for partners to disseminate the app to the broader public.ResultsThis study is the first to describe the development and evaluation process of an mHealth app for men and women undergoing fertility treatment. The app met its goal in providing fertility patients with a clinician-approved, portable resource for reliable information about medical and psychosocial aspects of infertility and its treatments and a confidential peer support forum monitored by trained peer supporters. Participants rated the engagement, functionality, information, and esthetics of the app positively, with an overall app quality mean score of 3.75 (SD 0.53) and a star rating of 3.43 (SD 0.75), with a total possible score and star rating of 5.00.ConclusionsBy documenting the systematic development and evaluation of the mHealth app for men and women undergoing fertility treatment, this paper can facilitate the replication of the study intervention and the development of similar mHealth apps.

Project description:BackgroundPeople with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations).ObjectiveThis usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation.MethodsTwenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach.ResultsDuring testing of the app's effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready to be delivered to the public after minor revisions. After including these revisions, the project team released the final app that is being used in the randomized controlled trial.ConclusionsA multi-level user-centered development process resulted in the development of an inclusive exercise program for people with multiple sclerosis operated through an easy-to-use app. The promotion of exercise through self-regulated mHealth programs requires a stakeholder-driven approach to app development. This ensures that app and content match the preferences and functional abilities of the end user (ie, people with varying levels of multiple sclerosis).

Project description:BackgroundTo date, we are aware of no interventions for anxiety and depression developed as mobile phone apps and tailored to young sexual minority men, a group especially at risk of anxiety and depression. We developed TODAY!, a culturally informed mobile phone intervention for young men who are attracted to men and who have clinically significant symptoms of anxiety or depression. The core of the intervention consists of daily psychoeducation informed by transdiagnostic cognitive behavioral therapy (CBT) and a set of tools to facilitate putting these concepts into action, with regular mood ratings that result in tailored feedback (eg, tips for current distress and visualizations of mood by context).ObjectiveThe aim of this study was to conduct usability testing to understand how young sexual minority men interact with the app, to inform later stages of intervention development.MethodsParticipants (n=9) were young sexual minority men aged 18-20 years (Mean=19.00, standard deviation [SD]=0.71; 44% black, 44% white, and 11.1% Latino), who endorsed at least mild depression and anxiety symptoms. Participants were recruited via flyers, emails to college lesbian, gay, bisexual, and transgender (LGBT) organizations, Web-based advertisements, another researcher's database of sexual minority youth interested in research participation, and word of mouth. During recorded interviews, participants were asked to think out loud while interacting with the TODAY! app on a mobile phone or with paper prototypes. Feedback identified from these recordings and from associated field notes were subjected to thematic analysis using a general inductive approach. To aid interpretation of results, methods and results are reported according to the consolidated criteria for reporting qualitative research (COREQ).ResultsThematic analysis of usability feedback revealed a theme of general positive feedback, as well as six recurring themes that informed continued development: (1) functionality (eg, highlight new material when available), (2) personalization (eg, more tailored feedback), (3) presentation (eg, keep content brief), (4) aesthetics (eg, use brighter colors), (5) LGBT or youth content (eg, add content about coming out), and (6) barriers to use (eg, perceiving psychoeducation as homework).ConclusionsFeedback from usability testing was vital to understanding what young sexual minority men desire from a mobile phone intervention for symptoms of anxiety and depression and was used to inform the ongoing development of such an intervention.

Project description:BackgroundInvolving stakeholders and consumers throughout the content and study design ensures interventions are engaging and relevant for end-users. The aim of this paper is to present the content development process for a mHealth (mobile phone and internet-based) cardiac rehabilitation (CR) exercise intervention.MethodsAn innovative mHealth intervention was developed with patient input using the following steps: conceptualization, formative research, pre-testing, and pilot testing. Conceptualization, including theoretical and technical aspects, was undertaken by experts. For the formative component, focus groups and interviews with cardiac patients were conducted to discuss their perceptions of a mHealth CR program. A general inductive thematic approach identified common themes. A preliminary library of text and video messages were then developed. Participants were recruited from CR education sessions to pre-test and provide feedback on the content using an online survey. Common responses were extracted and compiled. An iterative process was used to refine content prior to pilot testing and conduct of a randomized controlled trial.Results38 CR patients and 3 CR nurses participated in the formative research and 20 CR patients participated in the content pre-testing. Participants perceived the mHealth program as an effective approach to inform and motivate patients to exercise. For the qualitative study, 100% (n = 41) of participants thought it to be a good idea, and 11% of participants felt it might not be useful for them, but would be for others. Of the 20 participants who completed the online survey, 17 out of 20 (85%) stated they would sign up to a program where they could receive information by video messages on a website, and 12 out of 20 (60%) showed interest in a texting program. Some older CR patients viewed technology as a potential barrier as they were unfamiliar with text messaging or did not have mobile phones. Steps to instruct participants to receive texts and view the website were written into the study protocol. Suggestions to improve videos and wording of texts were fed back to the content development team and refined.ConclusionsMost participants thought a mHealth exercise program was an effective way to deliver exercise-based CR. The results were used to develop an innovative multimedia exercise intervention. A randomized controlled trial is currently underway.Trial registrationACTRN12611000117910.

Dataset Information

Development of a Just-in-Time Adaptive mHealth Intervention for Insomnia: Usability Study.

Publications

Development of a Just-in-Time Adaptive mHealth Intervention for Insomnia: Usability Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets