Dataset Information

Context-Sensitive Ecological Momentary Assessment: Application of User-Centered Design for Improving User Satisfaction and Engagement During Self-Report.

ABSTRACT: BACKGROUND:Ecological momentary assessment (EMA) can be a useful tool for collecting real-time behavioral data in studies of health and health behavior. However, EMA administered through mobile technology can be burdensome, and it tends to suffer from suboptimal user engagement, particularly in low health-literacy populations. OBJECTIVE:This study aimed to report a case study involving the design and evaluation of a mobile EMA tool that supports context-sensitive EMA-reporting of location and social situations accompanying eating and sedentary behavior. METHODS:An iterative, user-centered design process with obese, middle-aged women seeking care in a safety-net health system was used to identify the preferred format of self-report measures and the look, feel, and interaction of the mobile EMA tool. A single-arm feasibility field trial with 21 participants receiving 12 prompts each day for momentary self-reports over a 4-week period (336 total prompts per participant) was used to determine user satisfaction with interface quality and user engagement, operationalized as response rate. A second trial among 38 different participants randomized to receive or not to receive a feature designed to improve engagement was conducted. RESULTS:The feasibility trial results showed high interface satisfaction and engagement, with an average response rate of 50% over 4 weeks. Qualitative feedback pointed to the need for auditory alerts. We settled on 3 alerts at 10-min intervals to accompany each EMA-reporting prompt. The second trial testing this feature showed a statistically significant increase in the response rate between participants randomized to receive repeat auditory alerts versus those who were not (60% vs 40%). CONCLUSIONS:This paper reviews the design research and a set of design constraints that may be considered in the creation of mobile EMA interfaces personalized to users' preferences. Novel aspects of the study include the involvement of low health-literacy adults in design research, the capture of data on time, place, and social context of eating and sedentary behavior, and reporting prompts tailored to an individual's location and schedule. TRIAL REGISTRATION:ClinicalTrials.gov NCT03083964; https://clinicaltrials.gov/ct2/show/NCT03083964.

SUBMITTER: Srinivas P

PROVIDER: S-EPMC6468333 | biostudies-literature | 2019 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Context-Sensitive Ecological Momentary Assessment: Application of User-Centered Design for Improving User Satisfaction and Engagement During Self-Report.

Srinivas Preethi P Bodke Kunal K Ofner Susan S Keith NiCole R NR Tu Wanzhu W Clark Daniel O DO

JMIR mHealth and uHealth 20190403 4

<h4>Background</h4>Ecological momentary assessment (EMA) can be a useful tool for collecting real-time behavioral data in studies of health and health behavior. However, EMA administered through mobile technology can be burdensome, and it tends to suffer from suboptimal user engagement, particularly in low health-literacy populations.<h4>Objective</h4>This study aimed to report a case study involving the design and evaluation of a mobile EMA tool that supports context-sensitive EMA-reporting of ...[more]

PMID: 30942698

Similar Datasets

Project description:Clinical Handover remains one of the most perilous procedures in medicine (1). Weekend handover has emerged as a key area of concern with high variability in handover processes across hospitals (1,2,4, 5-10). Studying weekend handover processes within medicine at an acute teaching hospital revealed huge variability in documented content and structure. A total of 12 different pro formas were in use by the medical day-team to handover to the weekend team on-call. A Likert-survey of doctors revealed 93% felt the current handover system needed improvement with 71% stating that it did not ensure patient safety (Chi-squared, p-value <0.001, n=32). Semi-structured interviews of doctors identified common themes including "a lack of consistency in approach" "poor standardization" and "high variability". Seeking to address concerns of standardization, a standardized handover pro forma was developed using Royal College of Physician (RCP) guidelines (2), with direct end-user input. Results following implementation revealed a considerable improvement in documented ceiling of care, urgency of task and team member assignment with 100% uptake of the new proforma at both 4-week and 6-month post-implementation analyses. 88% of doctors surveyed perceived that the new proforma improved patient safety (p<0.01, n=25), with 62% highlighting that it allowed doctors to work more efficiently. Results also revealed that 44% felt further improvements were needed and highlighted electronic solutions and handover training as main priorities. Handover briefing was subsequently incorporated into junior doctor induction and education modules delivered, with good feedback. Following collaboration with key stakeholders and with end-user input, integrated electronic handover software was designed and funding secured. The software is currently under final development. Introducing a standardized handover proforma can be an effective initial step in improving weekend handover. Handover education and end-user involvement are key in improving the process. Electronic handover solutions have been shown to significantly increase the quality of handover and are worth considering (9, 10).

Project description:Digital interventions often suffer from low usage, which may reflect insufficient attention to user experience. Moreover, the existing evaluation methods have limited applicability in the remote study of user experience of complex interventions that have expansive content and that are used over an extensive period of time. To alleviate these challenges, we describe here a novel qualitative Ecological Momentary Assessment (EMA) method: the CORTO method (Contextual, One-item, Repeated, Timely, Open-ended). We used it to gather digital intervention user experience data from Finnish adults (n = 184) who lived with interview-confirmed major depressive disorder (MDD) and took part in a randomized controlled trial (RCT) that studied the efficacy of a novel 12-week game-based digital intervention for depression. A second dataset on user experience was gathered with retrospective interviews (n = 22). We inductively coded the CORTO method and retrospective interview data, which led to four user experience categories: (1) contextual use, (2) interaction-elicited emotional experience, (3) usability, and (4) technical issues. Then, we used the created user experience categories and Template Analysis to analyze both datasets together, and reported the results qualitatively. Finally, we compared the two datasets with each other. We found that the data generated with the CORTO method offered more insights into usability and technical categories than the interview data that particularly illustrated the contextual use. The emotional valence of the interview data was more positive compared with the CORTO data. Both the CORTO and interview data detected 55 % of the micro-level categories; 20 % of micro-level categories were only detected by the CORTO data and 25 % only by the interview data. We found that the during-intervention user experience measurement with the CORTO method can provide intervention-specific insights, and thereby further the iterative user-centered intervention development. Overall, these findings highlight the impact of evaluation methods on the categories and qualities of insights acquired in intervention research.

Project description:BackgroundAlthough eHealth technology makes it possible to improve the management of complex health care systems and follow up on chronic patients, it is not without challenges, thus requiring the development of efficient programs and graphic user interface (GUI) features. Similar information technology tools are crucial, as health care populations are going to have to endure social distancing measures in the forthcoming months and years.ObjectiveThis study aims to provide adequate and personalized support to complex health care populations by developing a specific web-based mobile app. The app is designed around the patient and adapted to specific groups, for example, people with complex or rare diseases, autism, or disabilities (especially among children) as well as Alzheimer or senile dementia. The app's core features include the collection, labeling, analysis, and sorting of clinical data. Furthermore, it authorizes a network of people around the patient to securely access the data contained in his or her electronic health record.MethodsThe application was designed according to the paradigms of patient-centered care and user-centered design (UCD). It considers the patient as the main empowered and motivating factor in the management of his or her well-being. Implementation was informed through a family needs and technology perception assessment. We used 3 interdisciplinary focus groups and 2 assessment surveys to study the contexts of app use, subpopulation management, and preferred functions. Finally, we developed an observational study involving 116 enrolled patients and 253 system users, followed by 2 feedback surveys to evaluate the performance and impact of the app.ResultsIn the validated general GUI, we developed 10 user profiles with different privacy settings. We tested 81 functions and studied a modular structure based on disease or medical area. This allowed us to identify replicable methods to be applied to module design. The observational study not only showed good family and community engagement but also revealed some limitations that need to be addressed. In total, 42 of 51 (82%) patients described themselves as satisfied or very satisfied. Health care providers reported facilitated communication with colleagues and the need to support data quality.ConclusionsThe experimented solution addressed some of the health system challenges mentioned by the World Health Organization: usability appears to be significantly improved when the GUI is designed according to patients' UCD mental models and when new media and medical literacy are promoted. This makes it possible to maximize the impact of eHealth products, thereby overcoming some crucial gaps reported in the literature. Two main features seemed to have potential benefit compared with other eHealth products: the modeling, within the app, of both the formal and informal health care support networks and the modular structure allowing for comorbidity management, both of which require further implementation.

Project description:BackgroundWell-designed mobile health (mHealth) interventions support a positive user experience; however, a high rate of disengagement has been reported as a common concern regarding mHealth interventions. To address this issue, it is necessary to summarize the design features that improve user engagement based on research over the past 10 years, during which time the popularity of mHealth interventions has rapidly increased due to the use of smartphones.ObjectiveThe aim of this review was to answer the question "Which design features improve user engagement with mHealth interventions?" by summarizing published literature with the purpose of guiding the design of future mHealth interventions.MethodsThis review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. Databases, namely, PubMed, Web of Science, Cochrane Library, Ovid EMBASE, and Ovid PsycINFO, were searched for English and Chinese language papers published from January 2009 to June 2019. Thematic analysis was undertaken to assess the design features in eligible studies. The Mixed Methods Appraisal Tool was used to assess study quality.ResultsA total of 35 articles were included. The investigated mHealth interventions were mainly used in unhealthy lifestyle (n=17) and chronic disease (n=10) prevention programs. Mobile phone apps (n=24) were the most common delivery method. Qualitative (n=22) and mixed methods (n=9) designs were widely represented. We identified the following 7 themes that influenced user engagement: personalization (n=29), reinforcement (n=23), communication (n=20), navigation (n=17), credibility (n=16), message presentation (n=16), and interface aesthetics (n=7). A checklist was developed that contained these 7 design features and 29 corresponding specific implementations derived from the studies.ConclusionsThis systematic review and thematic synthesis identified useful design features that make an mHealth intervention more user friendly. We generated a checklist with evidence-based items to enable developers to use our findings easily. Future evaluations should use more robust quantitative approaches to elucidate the relationships between design features and user engagement.

Project description:BackgroundCannabis misuse in young adults is a major public health concern. An important predictor of continued use is cannabis craving. Due to the time-varying nature of cravings, brief momentary interventions delivered while cravings are elevated may improve the use of strategies to cope with cravings and reduce cannabis use.ObjectiveThe goal of this manuscript is to describe a formative study to develop coping strategy messages for use in a subsequent intervention.MethodsYoung adults (aged 19-25 years; n=20) who reported using cannabis >10 of the past 30 days recruited via social media participated in this formative study. Participants rated an initial set of 15 mindfulness and 15 distraction coping strategies on a scale from 1 to 4 (very low degree to very high degree) for clarity, usefulness, and tone. They also provided comments about the content.ResultsParticipants found the initial distraction messages slightly clearer than mindfulness (mean 3.5, SD 0.4 and mean 3.4, SD 0.4, respectively), both were comparable in tone (mean 3.2, SD 0.5 and mean 3.2, SD 0.4, respectively), and mindfulness messages were more useful than distraction (mean 3.0, SD 0.5 and mean 2.8, SD 0.6, respectively). Of the 30 messages, 29 received a rating of very low or low (<2) on any domain by >3 participants or received a comment suggesting a change. We revised all these messages based on this feedback, and the participants rated the revised messages approximately 2 weeks later. Participants earned US $10 for completing the first and US $20 for the second survey. The ratings improved on usefulness (especially the distraction items) with very little change in clarity and tone. The top 10 messages of each coping type (mindfulness and distraction) were identified by overall average rating (collapsed across all 3 dimensions: all rated >3.0). The final items were comparable in clarity (distraction mean 3.6, SD 0.4; mindfulness mean 3.6, SD 0.4), tone (distraction mean 3.4, SD 0.4; mindfulness mean 3.4, SD 0.4), and usefulness (distraction mean 3.1, SD 0.5; mindfulness mean 3.2, SD 0.5).ConclusionsThe inclusion of end users in the formative process of developing these messages was valuable and resulted in improvements to the content of the messages. The majority of the messages were changed in some way including the removal of potentially triggering language. These messages were subsequently used in an ecological momentary intervention.

Project description:BackgroundHealthy behaviors are crucial for maintaining a person's health and well-being. The effects of health behavior interventions are mediated by individual and contextual factors that vary over time. Recently emerging smartphone-based ecological momentary interventions (EMIs) can use real-time user reports (ecological momentary assessments [EMAs]) to trigger appropriate support when needed in daily life.ObjectiveThis systematic review aims to assess the characteristics of smartphone-delivered EMIs using self-reported EMAs in relation to their effects on health behaviors, user engagement, and user perspectives.MethodsWe searched MEDLINE, Embase, PsycINFO, and CINAHL in June 2019 and updated the search in March 2020. We included experimental studies that incorporated EMIs based on EMAs delivered through smartphone apps to promote health behaviors in any health domain. Studies were independently screened. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. We performed a narrative synthesis of intervention effects, user perspectives and engagement, and intervention design and characteristics. Quality appraisal was conducted for all included studies.ResultsWe included 19 papers describing 17 unique studies and comprising 652 participants. Most studies were quasi-experimental (13/17, 76%), had small sample sizes, and great heterogeneity in intervention designs and measurements. EMIs were most popular in the mental health domain (8/17, 47%), followed by substance abuse (3/17, 18%), diet, weight loss, physical activity (4/17, 24%), and smoking (2/17, 12%). Of the 17 studies, the 4 (24%) included randomized controlled trials reported nonstatistically significant effects on health behaviors, and 4 (24%) quasi-experimental studies reported statistically significant pre-post improvements in self-reported primary outcomes, namely depressive (P<.001) and psychotic symptoms (P=.03), drinking frequency (P<.001), and eating patterns (P=.01). EMA was commonly used to capture subjective experiences as well as behaviors, whereas sensors were rarely used. Generally, users perceived EMIs to be helpful. Common suggestions for improvement included enhancing personalization, multimedia and interactive capabilities (eg, voice recording), and lowering the EMA reporting burden. EMI and EMA components were rarely reported and were not described in a standardized manner across studies, hampering progress in this field. A reporting checklist was developed to facilitate the interpretation and comparison of findings and enhance the transparency and replicability of future studies using EMAs and EMIs.ConclusionsThe use of smartphone-delivered EMIs using self-reported EMAs to promote behavior change is an emerging area of research, with few studies evaluating efficacy. Such interventions could present an opportunity to enhance health but need further assessment in larger participant cohorts and well-designed evaluations following reporting checklists. Future research should explore combining self-reported EMAs of subjective experiences with objective data passively collected via sensors to promote personalization while minimizing user burden, as well as explore different EMA data collection methods (eg, chatbots).Trial registrationPROSPERO CRD42019138739; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=138739.

Dataset Information

Context-Sensitive Ecological Momentary Assessment: Application of User-Centered Design for Improving User Satisfaction and Engagement During Self-Report.

Publications

Context-Sensitive Ecological Momentary Assessment: Application of User-Centered Design for Improving User Satisfaction and Engagement During Self-Report.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets