Dataset Information

The Effect of Training on Participant Adherence With a Reporting Time Frame for Momentary Subjective Experiences in Ecological Momentary Assessment: Cognitive Interview Study.

ABSTRACT:

Background

Ecological momentary assessment (EMA) has the potential to minimize recall bias by having people report on their experiences in the moment (momentary model) or over short periods (coverage model). This potential hinges on the assumption that participants provide their ratings based on the reporting time frame instructions prescribed in the EMA items. However, it is unclear what time frames participants actually use when answering the EMA questions and whether participant training improves participants' adherence to the reporting instructions.

Objective

This study aims to investigate the reporting time frames participants used when answering EMA questions and whether participant training improves participants' adherence to the EMA reporting timeframe instructions.

Methods

Telephone-based cognitive interviews were used to investigate the research questions. In a 2×2 factorial design, participants (n=100) were assigned to receive either basic or enhanced EMA training and randomized to rate their experiences using a momentary (at the moment you were called) or a coverage (since the last phone call) model. Participants received five calls over the course of a day to provide ratings; after each rating, participants were immediately interviewed about the time frame they used to answer the EMA questions. A total of 2 raters independently coded the momentary interview responses into time frame categories (Cohen κ=0.64, 95% CI 0.55-0.73).

Results

The results from the momentary conditions showed that most of the calls referred to the period during the call (57/199, 28.6%) or just before the call (98/199, 49.2%) to provide ratings; the remainder were from longer reporting periods. Multinomial logistic regression results indicated a significant training effect (χ²₁=16.6; P<.001) in which the enhanced training condition yielded more reports within the intended reporting time frames for momentary EMA reports. Cognitive interview data from the coverage model did not lend themselves to reliable coding and were not analyzed.

Conclusions

The results of this study provide the first evidence about adherence to EMA instructions to reporting periods and that enhanced participant training improves adherence to the time frame specified in momentary EMA studies.

SUBMITTER: Wen CKF

PROVIDER: S-EPMC8190649 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundHealthy behaviors are crucial for maintaining a person's health and well-being. The effects of health behavior interventions are mediated by individual and contextual factors that vary over time. Recently emerging smartphone-based ecological momentary interventions (EMIs) can use real-time user reports (ecological momentary assessments [EMAs]) to trigger appropriate support when needed in daily life.ObjectiveThis systematic review aims to assess the characteristics of smartphone-delivered EMIs using self-reported EMAs in relation to their effects on health behaviors, user engagement, and user perspectives.MethodsWe searched MEDLINE, Embase, PsycINFO, and CINAHL in June 2019 and updated the search in March 2020. We included experimental studies that incorporated EMIs based on EMAs delivered through smartphone apps to promote health behaviors in any health domain. Studies were independently screened. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. We performed a narrative synthesis of intervention effects, user perspectives and engagement, and intervention design and characteristics. Quality appraisal was conducted for all included studies.ResultsWe included 19 papers describing 17 unique studies and comprising 652 participants. Most studies were quasi-experimental (13/17, 76%), had small sample sizes, and great heterogeneity in intervention designs and measurements. EMIs were most popular in the mental health domain (8/17, 47%), followed by substance abuse (3/17, 18%), diet, weight loss, physical activity (4/17, 24%), and smoking (2/17, 12%). Of the 17 studies, the 4 (24%) included randomized controlled trials reported nonstatistically significant effects on health behaviors, and 4 (24%) quasi-experimental studies reported statistically significant pre-post improvements in self-reported primary outcomes, namely depressive (P<.001) and psychotic symptoms (P=.03), drinking frequency (P<.001), and eating patterns (P=.01). EMA was commonly used to capture subjective experiences as well as behaviors, whereas sensors were rarely used. Generally, users perceived EMIs to be helpful. Common suggestions for improvement included enhancing personalization, multimedia and interactive capabilities (eg, voice recording), and lowering the EMA reporting burden. EMI and EMA components were rarely reported and were not described in a standardized manner across studies, hampering progress in this field. A reporting checklist was developed to facilitate the interpretation and comparison of findings and enhance the transparency and replicability of future studies using EMAs and EMIs.ConclusionsThe use of smartphone-delivered EMIs using self-reported EMAs to promote behavior change is an emerging area of research, with few studies evaluating efficacy. Such interventions could present an opportunity to enhance health but need further assessment in larger participant cohorts and well-designed evaluations following reporting checklists. Future research should explore combining self-reported EMAs of subjective experiences with objective data passively collected via sensors to promote personalization while minimizing user burden, as well as explore different EMA data collection methods (eg, chatbots).Trial registrationPROSPERO CRD42019138739; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=138739.

Project description:BackgroundStudies that use ecological momentary assessments (EMAs) or wearable sensors to track numerous attributes, such as physical activity, sleep, and heart rate, can benefit from reductions in missing data. Maximizing compliance is one method of reducing missing data to increase the return on the heavy investment of time and money into large-scale studies.ObjectiveThis paper aims to identify the extent to which compliance can be prospectively predicted from individual attributes and initial compliance.MethodsWe instrumented 757 information workers with fitness trackers for 1 year and conducted EMAs in the first 56 days of study participation as part of an observational study. Their compliance with the EMA and fitness tracker wearing protocols was analyzed. Overall, 31 individual characteristics (eg, demographics and personalities) and behavioral variables (eg, early compliance and study portal use) were considered, and 14 variables were selected to create beta regression models for predicting compliance with EMAs 56 days out and wearable compliance 1 year out. We surveyed study participation and correlated the results with compliance.ResultsOur modeling indicates that 16% and 25% of the variance in EMA compliance and wearable compliance, respectively, could be explained through a survey of demographics and personality in a held-out sample. The likelihood of higher EMA and wearable compliance was associated with being older (EMA: odds ratio [OR] 1.02, 95% CI 1.00-1.03; wearable: OR 1.02, 95% CI 1.01-1.04), speaking English as a first language (EMA: OR 1.38, 95% CI 1.05-1.80; wearable: OR 1.39, 95% CI 1.05-1.85), having had a wearable before joining the study (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.50, 95% CI 1.23-1.83), and exhibiting conscientiousness (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.34, 95% CI 1.14-1.58). Compliance was negatively associated with exhibiting extraversion (EMA: OR 0.74, 95% CI 0.64-0.85; wearable: OR 0.67, 95% CI 0.57-0.78) and having a supervisory role (EMA: OR 0.65, 95% CI 0.54-0.79; wearable: OR 0.66, 95% CI 0.54-0.81). Furthermore, higher wearable compliance was negatively associated with agreeableness (OR 0.68, 95% CI 0.56-0.83) and neuroticism (OR 0.85, 95% CI 0.73-0.98). Compliance in the second week of the study could help explain more variance; 62% and 66% of the variance in EMA compliance and wearable compliance, respectively, was explained. Finally, compliance correlated with participants' self-reflection on the ease of participation, usefulness of our compliance portal, timely resolution of issues, and compensation adequacy, suggesting that these are avenues for improving compliance.ConclusionsWe recommend conducting an initial 2-week pilot to measure trait-like compliance and identify participants at risk of long-term noncompliance, performing oversampling based on participants' individual characteristics to avoid introducing bias in the sample when excluding data based on noncompliance, using an issue tracking portal, and providing special care in troubleshooting to help participants maintain compliance.

Project description:The recording of Ecological Momentary Assessments (EMA) can assist people with chronic diseases in monitoring their health state. However, many users quickly lose interest in their respective EMA platforms. Therefore, we studied the adherence of users of the mHealth app TRACKYOURTINNITUS (TYT). The app is used to record EMA in people with tinnitus. 1292 users, who interacted with the app between April 2014 and February 2017, were analyzed in this work. We defined "adherence" based on the dimensions of interaction duration and interaction continuity. We propose methods that are able to predict the (dis)continuation of interaction with the app and identify user segments that are characterized by similar patterns of adherence. For the prediction task we used the data of the questionnaires MiniTF and TSCHQ, which are filled in when the users enter TYT for the first time. Additionally, time series of the eight items of the daily EMA questionnaire were used. The distribution of user activity pertaining to the adherence dimension of interaction duration revealed a very skewed distribution, with most users giving up after only 1 day of interaction. However, many users returned after interrupting for some time. Some of the MiniTF items indicated that the worries of users might have lead to an increased likelihood of returning back to the app. The MiniTF score itself was not predictive, though. The answers to the TSCHQ items, in turn, pointed to user strata (more than 65 years of age at registration), which tended towards higher interaction continuity. As the registration questionnaires predicted adherence only to a limited extent, it is promising to study the activities of the users in the very first days of interaction more deeply. It turned out in this context that the effects of interaction stimulants like personalized and non-personalized tips, pointers to information sources, and mechanisms used in online treatments for tinnitus (e.g., in iCBT) should be further investigated.

Project description:Objective: Parental influence during children's "everyday" pain events is under-explored, compared to clinical or experimental pains. We trialed two digital reporting methods for parents to record the real-world context surrounding their child's everyday pain events within the family home. Methods: Parents (N = 21) completed a structured e-diary for 14 days, reporting on one pain event experienced by their child (aged 2.5-6 years) each day, and describing child pain responses, parental supervision, parental estimates of pain severity and intensity, and parental catastrophizing, distress, and behavioral responses. During the same 2-week period, a subsample of parent-child pairs (N = 9) completed digital ecological momentary assessments (EMA), immediately after any chosen pain event. Children reported their current pain while parents estimated the child's pain and indicated their own distress. Results: "Everyday" pain events frequently featured minor injuries to the child's head, hands or knees, and child responses included crying and non-verbal comments (e.g., "Ouch!"). Pain events occurred less frequently when parents had been supervising their child, and supervising parents reported lower levels of worry and anxiety than non-supervising parents. Child sex was significantly associated with parental estimates of pain intensity, with parents of girls giving higher estimates than parents of boys. Child age was significantly associated with both the number of pain events and with parental estimates of pain intensity and child distress: the youngest children (2-3 years) experienced the fewest pain events but received higher pain and distress estimates from parents than older children. Hierarchal Linear Modeling revealed that parental estimates of pain severity were significant positive predictors of parental distress and catastrophizing in response to a specific pain event. Furthermore, higher levels of parental catastrophic thinking in response to a specific pain event resulted in increased distress, solicitousness, and coping-promoting behaviors in parents. The EMA data revealed that children reported significantly higher pain intensity than their parents. Conclusion: The electronic pain diary provided a key insight into the nature of "everyday" pain experiences around the family home. Digital daily reporting of how the family copes with "everyday" events represents a viable means to explore a child's everyday pains without disrupting their home environment.