Dataset Information

Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis.

ABSTRACT:

Background

Mobile device-based ecological momentary assessment (mobile-EMA) is increasingly used to collect participants' data in real-time and in context. Although EMA offers methodological advantages, these advantages can be diminished by participant noncompliance. However, evidence on how well participants comply with mobile-EMA protocols and how study design factors associated with participant compliance is limited, especially in the youth literature.

Objective

To systematically and meta-analytically examine youth's compliance to mobile-EMA protocols and moderators of participant compliance in clinical and nonclinical settings.

Methods

Studies using mobile devices to collect EMA data among youth (age ?18 years old) were identified. A systematic review was conducted to describe the characteristics of mobile-EMA protocols and author-reported factors associated with compliance. Random effects meta-analyses were conducted to estimate the overall compliance across studies and to explore factors associated with differences in youths' compliance.

Results

This review included 42 unique studies that assessed behaviors, subjective experiences, and contextual information. Mobile phones were used as the primary mode of EMA data collection in 48% (20/42) of the reviewed studies. In total, 12% (5/42) of the studies used wearable devices in addition to the EMA data collection platforms. About half of the studies (62%, 24/42) recruited youth from nonclinical settings. Most (98%, 41/42) studies used a time-based sampling protocol. Among these studies, most (95%, 39/41) prompted youth 2-9 times daily, for a study length ranging from 2-42 days. Sampling frequency and study length did not differ between studies with participants from clinical versus nonclinical settings. Most (88%, 36/41) studies with a time-based sampling protocol defined compliance as the proportion of prompts to which participants responded. In these studies, the weighted average compliance rate was 78.3%. The average compliance rates were not different between studies with clinical (76.9%) and nonclinical (79.2%; P=.29) and studies that used only a mobile-EMA platform (77.4%) and mobile platform plus additional wearable devices (73.0%, P=.36). Among clinical studies, the mean compliance rate was significantly lower in studies that prompted participants 2-3 times (73.5%) or 4-5 times (66.9%) compared with studies with a higher sampling frequency (6+ times: 89.3%). Among nonclinical studies, a higher average compliance rate was observed in studies that prompted participants 2-3 times daily (91.7%) compared with those that prompted participants more frequently (4-5 times: 77.4%; 6+ times: 75.0%). The reported compliance rates did not differ by duration of EMA period among studies from either clinical or nonclinical settings.

Conclusions

The compliance rate among mobile-EMA studies in youth is moderate but suboptimal. Study design may affect protocol compliance differently between clinical and nonclinical participants; including additional wearable devices did not affect participant compliance. A more consistent compliance-related result reporting practices can facilitate understanding and improvement of participant compliance with EMA data collection among youth.

SUBMITTER: Wen CKF

PROVIDER: S-EPMC5425774 | biostudies-literature | 2017 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis.

Wen Cheng K Fred CKF Schneider Stefan S Stone Arthur A AA Spruijt-Metz Donna D

Journal of medical Internet research 20170426 4

<h4>Background</h4>Mobile device-based ecological momentary assessment (mobile-EMA) is increasingly used to collect participants' data in real-time and in context. Although EMA offers methodological advantages, these advantages can be diminished by participant noncompliance. However, evidence on how well participants comply with mobile-EMA protocols and how study design factors associated with participant compliance is limited, especially in the youth literature.<h4>Objective</h4>To systematical ...[more]

PMID: 28446418

Similar Datasets

Project description:BackgroundMobile ecological momentary assessment (mEMA) permits real-time capture of self-reported participant behaviors and perceptual experiences. Reporting of mEMA protocols and compliance has been identified as problematic within systematic reviews of children, youth, and specific clinical populations of adults.ObjectiveThis study aimed to describe the use of mEMA for self-reported behaviors and psychological constructs, mEMA protocol and compliance reporting, and associations between key components of mEMA protocols and compliance in studies of nonclinical and clinical samples of adults.MethodsIn total, 9 electronic databases were searched (2006-2016) for observational studies reporting compliance to mEMA for health-related data from adults (>18 years) in nonclinical and clinical settings. Screening and data extraction were undertaken by independent reviewers, with discrepancies resolved by consensus. Narrative synthesis described participants, mEMA target, protocol, and compliance. Random effects meta-analysis explored factors associated with cohort compliance (monitoring duration, daily prompt frequency or schedule, device type, training, incentives, and burden score). Random effects analysis of variance (P≤.05) assessed differences between nonclinical and clinical data sets.ResultsOf the 168 eligible studies, 97/105 (57.7%) reported compliance in unique data sets (nonclinical=64/105 [61%], clinical=41/105 [39%]). The most common self-reported mEMA target was affect (primary target: 31/105, 29.5% data sets; secondary target: 50/105, 47.6% data sets). The median duration of the mEMA protocol was 7 days (nonclinical=7, clinical=12). Most protocols used a single time-based (random or interval) prompt type (69/105, 65.7%); median prompt frequency was 5 per day. The median number of items per prompt was similar for nonclinical (8) and clinical data sets (10). More than half of the data sets reported mEMA training (84/105, 80%) and provision of participant incentives (66/105, 62.9%). Less than half of the data sets reported number of prompts delivered (22/105, 21%), answered (43/105, 41%), criterion for valid mEMA data (37/105, 35.2%), or response latency (38/105, 36.2%). Meta-analysis (nonclinical=41, clinical=27) estimated an overall compliance of 81.9% (95% CI 79.1-84.4), with no significant difference between nonclinical and clinical data sets or estimates before or after data exclusions. Compliance was associated with prompts per day and items per prompt for nonclinical data sets. Although widespread heterogeneity existed across analysis (I2>90%), no compelling relationship was identified between key features of mEMA protocols representing burden and mEMA compliance.ConclusionsIn this 10-year sample of studies using the mEMA of self-reported health-related behaviors and psychological constructs in adult nonclinical and clinical populations, mEMA was applied across contexts and health conditions and to collect a range of health-related data. There was inconsistent reporting of compliance and key features within protocols, which limited the ability to confidently identify components of mEMA schedules likely to have a specific impact on compliance.

Project description:BackgroundNew methods for assessing diet in research are being developed to address the limitations of traditional dietary assessment methods. Mobile device-assisted ecological momentary diet assessment (mEMDA) is a new dietary assessment method that has not yet been optimized and has the potential to minimize recall biases and participant burden while maximizing ecological validity. There have been limited efforts to characterize the use of mEMDA in behavioral research settings.ObjectiveThe aims of this study were to summarize mEMDA protocols used in research to date, to characterize key aspects of these assessment approaches, and to discuss the advantages and disadvantages of mEMDA compared with the traditional dietary assessment methods as well as implications for future mEMDA research.MethodsStudies that used mobile devices and described mEMDA protocols to assess dietary intake were included. Data were extracted according to Preferred Reporting of Systematic Reviews and Meta-Analyses and Cochrane guidelines and then synthesized narratively.ResultsThe review included 20 studies with unique mEMDA protocols. Of these, 50% (10/20) used participant-initiated reports of intake at eating events (event-contingent mEMDA), and 50% (10/20) used researcher-initiated prompts requesting that participants report recent dietary intake (signal-contingent mEMDA). A majority of the study protocols (60%, 12/20) enabled participants to use mobile phones to report dietary data. Event-contingent mEMDA protocols most commonly assessed diet in real time, used dietary records for data collection (60%, 6/10), and provided estimates of energy and nutrient intake (60%, 6/10). All signal-contingent mEMDA protocols used a near real-time recall approach with unannounced (ie, random) abbreviated diet surveys. Most signal-contingent protocols (70%, 7/10) assessed the frequency with which (targeted) foods or food groups were consumed. Relatively few (30%, 6/20) studies compared mEMDA with the traditional dietary assessment methods.ConclusionsThis review demonstrates that mEMDA has the potential to reduce participant burden and recall bias, thus advancing the field beyond current dietary assessment methods while maximizing ecological validity.

Project description:BackgroundStudies that use ecological momentary assessments (EMAs) or wearable sensors to track numerous attributes, such as physical activity, sleep, and heart rate, can benefit from reductions in missing data. Maximizing compliance is one method of reducing missing data to increase the return on the heavy investment of time and money into large-scale studies.ObjectiveThis paper aims to identify the extent to which compliance can be prospectively predicted from individual attributes and initial compliance.MethodsWe instrumented 757 information workers with fitness trackers for 1 year and conducted EMAs in the first 56 days of study participation as part of an observational study. Their compliance with the EMA and fitness tracker wearing protocols was analyzed. Overall, 31 individual characteristics (eg, demographics and personalities) and behavioral variables (eg, early compliance and study portal use) were considered, and 14 variables were selected to create beta regression models for predicting compliance with EMAs 56 days out and wearable compliance 1 year out. We surveyed study participation and correlated the results with compliance.ResultsOur modeling indicates that 16% and 25% of the variance in EMA compliance and wearable compliance, respectively, could be explained through a survey of demographics and personality in a held-out sample. The likelihood of higher EMA and wearable compliance was associated with being older (EMA: odds ratio [OR] 1.02, 95% CI 1.00-1.03; wearable: OR 1.02, 95% CI 1.01-1.04), speaking English as a first language (EMA: OR 1.38, 95% CI 1.05-1.80; wearable: OR 1.39, 95% CI 1.05-1.85), having had a wearable before joining the study (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.50, 95% CI 1.23-1.83), and exhibiting conscientiousness (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.34, 95% CI 1.14-1.58). Compliance was negatively associated with exhibiting extraversion (EMA: OR 0.74, 95% CI 0.64-0.85; wearable: OR 0.67, 95% CI 0.57-0.78) and having a supervisory role (EMA: OR 0.65, 95% CI 0.54-0.79; wearable: OR 0.66, 95% CI 0.54-0.81). Furthermore, higher wearable compliance was negatively associated with agreeableness (OR 0.68, 95% CI 0.56-0.83) and neuroticism (OR 0.85, 95% CI 0.73-0.98). Compliance in the second week of the study could help explain more variance; 62% and 66% of the variance in EMA compliance and wearable compliance, respectively, was explained. Finally, compliance correlated with participants' self-reflection on the ease of participation, usefulness of our compliance portal, timely resolution of issues, and compensation adequacy, suggesting that these are avenues for improving compliance.ConclusionsWe recommend conducting an initial 2-week pilot to measure trait-like compliance and identify participants at risk of long-term noncompliance, performing oversampling based on participants' individual characteristics to avoid introducing bias in the sample when excluding data based on noncompliance, using an issue tracking portal, and providing special care in troubleshooting to help participants maintain compliance.

Project description:BackgroundBorderline personality disorder (BPD) is characterized by frequent and intense moment-to-moment changes in affect, behavior, identity, and interpersonal relationships, which typically result in significant and negative deterioration of the person's overall functioning and well-being. Measuring and characterizing the rapidly changing patterns of instability in BPD dysfunction as they occur in a person's daily life can be challenging. Ecological momentary assessment (EMA) is a method that can capture highly dynamic processes in psychopathology research and, thus, is well suited to study intense variability patterns across areas of dysfunction in BPD. EMA studies are characterized by frequent repeated assessments that are delivered to participants in real-life, real-time settings using handheld devices capable of registering responses to short self-report questions in daily life. Compliance in EMA research is defined as the proportion of prompts answered by the participant, considering all planned prompts sent. Low compliance with prompt schedules can compromise the relative advantages of using this method. Despite the growing EMA literature on BPD in recent years, findings regarding study design features that affect compliance with EMA protocols have not been compiled, aggregated, and estimated.ObjectiveThis systematic meta-analytic review aimed to investigate the relationship between study design features and participant compliance in EMA research of BPD.MethodsA systematic review was conducted on November 12, 2021, following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) and MOOSE (Meta-analyses of Observational Studies in Epidemiology) guidelines to search for articles featuring EMA studies of BPD that reported compliance rates and included sufficient data to extract relevant design features. For studies with complete data, random-effect models were used to estimate the overall compliance rate and explore its association with design features.ResultsIn total, 28 peer-reviewed EMA studies comprising 2052 participants were included in the study. Design features (sampling strategy, average prompting frequency, number of items, response window, sampling device, financial incentive, and dropout rate) showed a large variability across studies, and many studies did not report design features. The meta-analytic synthesis was restricted to 64% (18/28) of articles and revealed a pooled compliance rate of 79% across studies. We did not find any significant relationship between design features and compliance rates.ConclusionsOur results show wide variability in the design and reporting of EMA studies assessing BPD. Compliance rates appear to be stable across varying setups, and it is likely that standard design features are not directly responsible for improving or diminishing compliance. We discuss possible nonspecific factors of study design that may have an impact on compliance. Given the promise of EMA research in BPD, we also discuss the importance of unifying standards for EMA reporting so that data stemming from this rich literature can be aggregated and interpreted jointly.

Project description:BackgroundFew adolescents achieve sufficient levels of physical activity, and many are spending most of their time in sedentary behavior. Affective response following sedentary time may influence motivation to remain sedentary. Ecological Momentary Assessment (EMA) is a real-time data capture methodology that can be used to identify factors influencing sedentary time, such as the context of the home setting, and resulting affective state within a free-living setting. The purpose of this study was to evaluate the relationship between context at home and adolescent sedentary time, and the relationship of sedentary time and subsequent affect.MethodsAdolescents (n = 284; 10-16 y) participated in an EMA study that used random, interval-based sampling methods. Adolescents each received 22 unannounced surveys over 7-days through a smartphone application. One survey was randomly sent within each 2-h time-period. These time-periods occurred between 4:00 pm-8:00 pm on weekdays and 8:00 am-8:00 pm on the weekend. This 15-question survey included a series of questions on context (indoors/outdoors, alone/not alone) and positive affect. Adolescents concurrently wore an accelerometer at the hip, and the 30-min bout of accelerometry data prior to each survey was used in analyses. Mixed-effect location scale models were used to examine the association between context at home and sedentary time (stage 1) and the adjusted sedentary time and positive affect (stage 2), with each model adjusted for covariates.ResultsAdolescents were 12.6 ± 1.9 y of age on average, about half were White (58%), and engaged in high levels of sedentary behavior during the 30 min prior to the survey (21.4 ± 6.8 min). Most surveys occurred when adolescents were with others (59%) and indoors (88%). In Stage 1, both being alone and being indoors at home were positively associated with sedentary time (p < 0.001 for both). In Stage 2, adjusted sedentary time was not related to positive affect. Age was negatively related to positive affect (p < 0.001).ConclusionsBoth contextual factors, being alone and indoors at home, were related to additional time spent sedentary compared to being with someone or outdoors. After adjustment, sedentary time was not related to subsequent positive affect, indicating other factors may be related to adolescent's positive affect in home settings.

Project description:BACKGROUND:Ecological momentary assessment (EMA) has utility for measuring psychological properties in daily life. EMA has also allowed researchers to collect data on diverse experiences and symptoms from various subjects. OBJECTIVE:The aim of this study was to review methodological strategies and useful related information for EMA using mobile phones to capture changes of mood and stress in adult patients seeking health care. METHODS:We searched PubMed, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Embase, the Cochrane Library, PsycINFO, and Web of Science. This review included studies published in peer-reviewed journals in English between January 2008 and November 2017 that used basic- or advanced-feature mobile phones to measure momentary mood or stress in adult patients seeking health care in outpatient departments. We excluded studies of smoking and substance addictions and studies of mental disorder patients who had been diagnosed by physicians. RESULTS:We reviewed 12 selected articles that used EMA via mobile phones to measure momentary mood and stress and other related variables from various patients with chronic fatigue syndrome, breast cancer, migraine, HIV, tinnitus, temporomandibular disorder, end-stage kidney disease, and traumatic brain injury. Most of the selected studies (11/12, 92%) used signal contingency and in 8 of the 12 studies (67%) alarms were sent at random or semirandom intervals to prompt the momentary measurement. Out of 12 studies, 7 (58%) used specific apps directly installed on mobile phones, 3 (25%) used mobile phones to link to Web-based survey programs, and 2 (17%) used an interactive voice-response system. CONCLUSIONS:This study provides researchers with useful information regarding methodological details for utilizing EMA to measure mood and stress in adult patients. This review shows that EMA methods could be effective and reasonable for measuring momentary mood and stress, given that basic- and advanced-feature mobile phones are ubiquitous, familiar, and easy to approach. Therefore, researchers could adopt and utilize EMA methods using mobile phones to measure psychological health outcomes, such as mood and stress, in adult patients.

Dataset Information

Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis.

Background

Objective

Methods

Results

Conclusions

Publications

Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets