Dataset Information

Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis.

ABSTRACT:

Background

Mobile device-based ecological momentary assessment (mobile-EMA) is increasingly used to collect participants' data in real-time and in context. Although EMA offers methodological advantages, these advantages can be diminished by participant noncompliance. However, evidence on how well participants comply with mobile-EMA protocols and how study design factors associated with participant compliance is limited, especially in the youth literature.

Objective

To systematically and meta-analytically examine youth's compliance to mobile-EMA protocols and moderators of participant compliance in clinical and nonclinical settings.

Methods

Studies using mobile devices to collect EMA data among youth (age ?18 years old) were identified. A systematic review was conducted to describe the characteristics of mobile-EMA protocols and author-reported factors associated with compliance. Random effects meta-analyses were conducted to estimate the overall compliance across studies and to explore factors associated with differences in youths' compliance.

Results

This review included 42 unique studies that assessed behaviors, subjective experiences, and contextual information. Mobile phones were used as the primary mode of EMA data collection in 48% (20/42) of the reviewed studies. In total, 12% (5/42) of the studies used wearable devices in addition to the EMA data collection platforms. About half of the studies (62%, 24/42) recruited youth from nonclinical settings. Most (98%, 41/42) studies used a time-based sampling protocol. Among these studies, most (95%, 39/41) prompted youth 2-9 times daily, for a study length ranging from 2-42 days. Sampling frequency and study length did not differ between studies with participants from clinical versus nonclinical settings. Most (88%, 36/41) studies with a time-based sampling protocol defined compliance as the proportion of prompts to which participants responded. In these studies, the weighted average compliance rate was 78.3%. The average compliance rates were not different between studies with clinical (76.9%) and nonclinical (79.2%; P=.29) and studies that used only a mobile-EMA platform (77.4%) and mobile platform plus additional wearable devices (73.0%, P=.36). Among clinical studies, the mean compliance rate was significantly lower in studies that prompted participants 2-3 times (73.5%) or 4-5 times (66.9%) compared with studies with a higher sampling frequency (6+ times: 89.3%). Among nonclinical studies, a higher average compliance rate was observed in studies that prompted participants 2-3 times daily (91.7%) compared with those that prompted participants more frequently (4-5 times: 77.4%; 6+ times: 75.0%). The reported compliance rates did not differ by duration of EMA period among studies from either clinical or nonclinical settings.

Conclusions

The compliance rate among mobile-EMA studies in youth is moderate but suboptimal. Study design may affect protocol compliance differently between clinical and nonclinical participants; including additional wearable devices did not affect participant compliance. A more consistent compliance-related result reporting practices can facilitate understanding and improvement of participant compliance with EMA data collection among youth.

SUBMITTER: Wen CKF

PROVIDER: S-EPMC5425774 | biostudies-literature | 2017 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis.

Wen Cheng K Fred CKF Schneider Stefan S Stone Arthur A AA Spruijt-Metz Donna D

Journal of medical Internet research 20170426 4

<h4>Background</h4>Mobile device-based ecological momentary assessment (mobile-EMA) is increasingly used to collect participants' data in real-time and in context. Although EMA offers methodological advantages, these advantages can be diminished by participant noncompliance. However, evidence on how well participants comply with mobile-EMA protocols and how study design factors associated with participant compliance is limited, especially in the youth literature.<h4>Objective</h4>To systematical ...[more]

PMID: 28446418

Similar Datasets

Project description:BackgroundNew methods for assessing diet in research are being developed to address the limitations of traditional dietary assessment methods. Mobile device-assisted ecological momentary diet assessment (mEMDA) is a new dietary assessment method that has not yet been optimized and has the potential to minimize recall biases and participant burden while maximizing ecological validity. There have been limited efforts to characterize the use of mEMDA in behavioral research settings.ObjectiveThe aims of this study were to summarize mEMDA protocols used in research to date, to characterize key aspects of these assessment approaches, and to discuss the advantages and disadvantages of mEMDA compared with the traditional dietary assessment methods as well as implications for future mEMDA research.MethodsStudies that used mobile devices and described mEMDA protocols to assess dietary intake were included. Data were extracted according to Preferred Reporting of Systematic Reviews and Meta-Analyses and Cochrane guidelines and then synthesized narratively.ResultsThe review included 20 studies with unique mEMDA protocols. Of these, 50% (10/20) used participant-initiated reports of intake at eating events (event-contingent mEMDA), and 50% (10/20) used researcher-initiated prompts requesting that participants report recent dietary intake (signal-contingent mEMDA). A majority of the study protocols (60%, 12/20) enabled participants to use mobile phones to report dietary data. Event-contingent mEMDA protocols most commonly assessed diet in real time, used dietary records for data collection (60%, 6/10), and provided estimates of energy and nutrient intake (60%, 6/10). All signal-contingent mEMDA protocols used a near real-time recall approach with unannounced (ie, random) abbreviated diet surveys. Most signal-contingent protocols (70%, 7/10) assessed the frequency with which (targeted) foods or food groups were consumed. Relatively few (30%, 6/20) studies compared mEMDA with the traditional dietary assessment methods.ConclusionsThis review demonstrates that mEMDA has the potential to reduce participant burden and recall bias, thus advancing the field beyond current dietary assessment methods while maximizing ecological validity.

Project description:BackgroundStudies that use ecological momentary assessments (EMAs) or wearable sensors to track numerous attributes, such as physical activity, sleep, and heart rate, can benefit from reductions in missing data. Maximizing compliance is one method of reducing missing data to increase the return on the heavy investment of time and money into large-scale studies.ObjectiveThis paper aims to identify the extent to which compliance can be prospectively predicted from individual attributes and initial compliance.MethodsWe instrumented 757 information workers with fitness trackers for 1 year and conducted EMAs in the first 56 days of study participation as part of an observational study. Their compliance with the EMA and fitness tracker wearing protocols was analyzed. Overall, 31 individual characteristics (eg, demographics and personalities) and behavioral variables (eg, early compliance and study portal use) were considered, and 14 variables were selected to create beta regression models for predicting compliance with EMAs 56 days out and wearable compliance 1 year out. We surveyed study participation and correlated the results with compliance.ResultsOur modeling indicates that 16% and 25% of the variance in EMA compliance and wearable compliance, respectively, could be explained through a survey of demographics and personality in a held-out sample. The likelihood of higher EMA and wearable compliance was associated with being older (EMA: odds ratio [OR] 1.02, 95% CI 1.00-1.03; wearable: OR 1.02, 95% CI 1.01-1.04), speaking English as a first language (EMA: OR 1.38, 95% CI 1.05-1.80; wearable: OR 1.39, 95% CI 1.05-1.85), having had a wearable before joining the study (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.50, 95% CI 1.23-1.83), and exhibiting conscientiousness (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.34, 95% CI 1.14-1.58). Compliance was negatively associated with exhibiting extraversion (EMA: OR 0.74, 95% CI 0.64-0.85; wearable: OR 0.67, 95% CI 0.57-0.78) and having a supervisory role (EMA: OR 0.65, 95% CI 0.54-0.79; wearable: OR 0.66, 95% CI 0.54-0.81). Furthermore, higher wearable compliance was negatively associated with agreeableness (OR 0.68, 95% CI 0.56-0.83) and neuroticism (OR 0.85, 95% CI 0.73-0.98). Compliance in the second week of the study could help explain more variance; 62% and 66% of the variance in EMA compliance and wearable compliance, respectively, was explained. Finally, compliance correlated with participants' self-reflection on the ease of participation, usefulness of our compliance portal, timely resolution of issues, and compensation adequacy, suggesting that these are avenues for improving compliance.ConclusionsWe recommend conducting an initial 2-week pilot to measure trait-like compliance and identify participants at risk of long-term noncompliance, performing oversampling based on participants' individual characteristics to avoid introducing bias in the sample when excluding data based on noncompliance, using an issue tracking portal, and providing special care in troubleshooting to help participants maintain compliance.

Project description:BackgroundFew adolescents achieve sufficient levels of physical activity, and many are spending most of their time in sedentary behavior. Affective response following sedentary time may influence motivation to remain sedentary. Ecological Momentary Assessment (EMA) is a real-time data capture methodology that can be used to identify factors influencing sedentary time, such as the context of the home setting, and resulting affective state within a free-living setting. The purpose of this study was to evaluate the relationship between context at home and adolescent sedentary time, and the relationship of sedentary time and subsequent affect.MethodsAdolescents (n = 284; 10-16 y) participated in an EMA study that used random, interval-based sampling methods. Adolescents each received 22 unannounced surveys over 7-days through a smartphone application. One survey was randomly sent within each 2-h time-period. These time-periods occurred between 4:00 pm-8:00 pm on weekdays and 8:00 am-8:00 pm on the weekend. This 15-question survey included a series of questions on context (indoors/outdoors, alone/not alone) and positive affect. Adolescents concurrently wore an accelerometer at the hip, and the 30-min bout of accelerometry data prior to each survey was used in analyses. Mixed-effect location scale models were used to examine the association between context at home and sedentary time (stage 1) and the adjusted sedentary time and positive affect (stage 2), with each model adjusted for covariates.ResultsAdolescents were 12.6 ± 1.9 y of age on average, about half were White (58%), and engaged in high levels of sedentary behavior during the 30 min prior to the survey (21.4 ± 6.8 min). Most surveys occurred when adolescents were with others (59%) and indoors (88%). In Stage 1, both being alone and being indoors at home were positively associated with sedentary time (p < 0.001 for both). In Stage 2, adjusted sedentary time was not related to positive affect. Age was negatively related to positive affect (p < 0.001).ConclusionsBoth contextual factors, being alone and indoors at home, were related to additional time spent sedentary compared to being with someone or outdoors. After adjustment, sedentary time was not related to subsequent positive affect, indicating other factors may be related to adolescent's positive affect in home settings.

Project description:BACKGROUND:Ecological momentary assessment (EMA) has utility for measuring psychological properties in daily life. EMA has also allowed researchers to collect data on diverse experiences and symptoms from various subjects. OBJECTIVE:The aim of this study was to review methodological strategies and useful related information for EMA using mobile phones to capture changes of mood and stress in adult patients seeking health care. METHODS:We searched PubMed, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Embase, the Cochrane Library, PsycINFO, and Web of Science. This review included studies published in peer-reviewed journals in English between January 2008 and November 2017 that used basic- or advanced-feature mobile phones to measure momentary mood or stress in adult patients seeking health care in outpatient departments. We excluded studies of smoking and substance addictions and studies of mental disorder patients who had been diagnosed by physicians. RESULTS:We reviewed 12 selected articles that used EMA via mobile phones to measure momentary mood and stress and other related variables from various patients with chronic fatigue syndrome, breast cancer, migraine, HIV, tinnitus, temporomandibular disorder, end-stage kidney disease, and traumatic brain injury. Most of the selected studies (11/12, 92%) used signal contingency and in 8 of the 12 studies (67%) alarms were sent at random or semirandom intervals to prompt the momentary measurement. Out of 12 studies, 7 (58%) used specific apps directly installed on mobile phones, 3 (25%) used mobile phones to link to Web-based survey programs, and 2 (17%) used an interactive voice-response system. CONCLUSIONS:This study provides researchers with useful information regarding methodological details for utilizing EMA to measure mood and stress in adult patients. This review shows that EMA methods could be effective and reasonable for measuring momentary mood and stress, given that basic- and advanced-feature mobile phones are ubiquitous, familiar, and easy to approach. Therefore, researchers could adopt and utilize EMA methods using mobile phones to measure psychological health outcomes, such as mood and stress, in adult patients.

Project description:BackgroundHealthy behaviors are crucial for maintaining a person's health and well-being. The effects of health behavior interventions are mediated by individual and contextual factors that vary over time. Recently emerging smartphone-based ecological momentary interventions (EMIs) can use real-time user reports (ecological momentary assessments [EMAs]) to trigger appropriate support when needed in daily life.ObjectiveThis systematic review aims to assess the characteristics of smartphone-delivered EMIs using self-reported EMAs in relation to their effects on health behaviors, user engagement, and user perspectives.MethodsWe searched MEDLINE, Embase, PsycINFO, and CINAHL in June 2019 and updated the search in March 2020. We included experimental studies that incorporated EMIs based on EMAs delivered through smartphone apps to promote health behaviors in any health domain. Studies were independently screened. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. We performed a narrative synthesis of intervention effects, user perspectives and engagement, and intervention design and characteristics. Quality appraisal was conducted for all included studies.ResultsWe included 19 papers describing 17 unique studies and comprising 652 participants. Most studies were quasi-experimental (13/17, 76%), had small sample sizes, and great heterogeneity in intervention designs and measurements. EMIs were most popular in the mental health domain (8/17, 47%), followed by substance abuse (3/17, 18%), diet, weight loss, physical activity (4/17, 24%), and smoking (2/17, 12%). Of the 17 studies, the 4 (24%) included randomized controlled trials reported nonstatistically significant effects on health behaviors, and 4 (24%) quasi-experimental studies reported statistically significant pre-post improvements in self-reported primary outcomes, namely depressive (P<.001) and psychotic symptoms (P=.03), drinking frequency (P<.001), and eating patterns (P=.01). EMA was commonly used to capture subjective experiences as well as behaviors, whereas sensors were rarely used. Generally, users perceived EMIs to be helpful. Common suggestions for improvement included enhancing personalization, multimedia and interactive capabilities (eg, voice recording), and lowering the EMA reporting burden. EMI and EMA components were rarely reported and were not described in a standardized manner across studies, hampering progress in this field. A reporting checklist was developed to facilitate the interpretation and comparison of findings and enhance the transparency and replicability of future studies using EMAs and EMIs.ConclusionsThe use of smartphone-delivered EMIs using self-reported EMAs to promote behavior change is an emerging area of research, with few studies evaluating efficacy. Such interventions could present an opportunity to enhance health but need further assessment in larger participant cohorts and well-designed evaluations following reporting checklists. Future research should explore combining self-reported EMAs of subjective experiences with objective data passively collected via sensors to promote personalization while minimizing user burden, as well as explore different EMA data collection methods (eg, chatbots).Trial registrationPROSPERO CRD42019138739; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=138739.

Project description:BackgroundAsylum-seeking children and adolescents (ASCs) resettled to western countries show elevated levels of psychological distress. While research on the mental health of ASCs is increasing, less is known about their day-to-day living experiences such as their daily mood, sleep patterns, and post-migration factors. Moreover, no examination in situ, using smartphone-assisted ecological momentary assessment (EMA), has been conducted up to now among ASCs. Furthermore, we do not know if screening measures succeed in reflecting the daily mood of ASCs experienced in everyday life.MethodsWe undertook a smartphone-assisted EMA study over a two-week period with 3 measurements a day. Participants were N = 40 ASCs from 10 different countries who had resettled to Germany. They completed standardized questionnaires screening for history of trauma and clinical symptoms (post-traumatic stress symptoms, depression, and anxiety) that were carried out in interview-like settings, and they participated in the subsequent EMA where they rated mood, sleep parameters, and post-migration factors on a daily basis. Multilevel models of clinical symptoms, daily mood, and sleep parameters were computed based on a total of 680 measurements.ResultsThe multiply traumatized and highly distressed participants reported different levels of discrimination, and various social activities and contacts in the EMA. The overall compliance rate was shown to be 40.5%. Higher PTSS and anxiety scores were associated with lower levels of daily mood and poorer outcomes of some sleep parameters. Depression scores were not associated with any of the variables assessed in the EMA.ConclusionsSmartphone-assisted EMA among ASCs resettled to Germany proved to be implementable despite a rather low compliance rate. Not only do ASCs show high symptom levels, they are also affected by these symptoms in their daily lives. The results emphasize the need for concise screenings and psychological treatment for this high-risk population. Limitations include the convenient nature of the sample and the lack of a comparison group.

Dataset Information

Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis.

Background

Objective

Methods

Results

Conclusions

Publications

Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure