Statistical Considerations for Analyzing Ecological Momentary Assessment Data.
Ontology highlight
ABSTRACT: Purpose
The analysis of Ecological Momentary Assessment (EMA) data can be difficult to conceptualize due to the complexity of how the data are collected. The goal of this tutorial is to provide an overview of statistical considerations for analyzing observational data arising from EMA studies.Method
EMA data are collected in a variety of ways, complicating the statistical analysis. We focus on fundamental statistical characteristics of the data and general purpose statistical approaches to analyzing EMA data. We implement those statistical approaches using a recent study involving EMA.Results
The linear or generalized linear mixed-model statistical approach can adequately capture the challenges resulting from EMA collected data if properly set up. Additionally, while sample size depends on both the number of participants and the number of survey responses per participant, having more participants is more important than the number of responses per participant.Conclusion
Using modern statistical methods when analyzing EMA data and adequately considering all of the statistical assumptions being used can lead to interesting and important findings when using EMA.Supplemental material
https://doi.org/10.23641/asha.17155961.
SUBMITTER: Oleson JJ
PROVIDER: S-EPMC9150728 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Affect regulation models state that affect both motivates and reinforces alcohol use. We aimed to examine whether affect levels and rates of change differed across drinking versus nondrinking days in a manner consistent with affect regulation models. Four hundred four regularly drinking adults, aged 18-70 years, completed ecological momentary assessments over 3 weeks. Participants provided positive affect (PA; enthusiastic, excited, happy) and negative affect (NA; distressed, sad) reports during all prompts; alcohol consumption reports were also provided. Multilevel spline models revealed that on drinking days, PA was higher and NA was lower both before and after drinking compared to matched times on nondrinking days. PA and NA were also higher and lower, respectively, both before and after drinking, when heavy drinking days were compared to moderate drinking days. Examination of affect rates of change revealed that (a) accelerating increases in PA and accelerating decreases in NA preceded drinking initiation, (b) PA increases and NA decreases were seen up to 2 hr after drinking initiation, and (c) pre- and postdrinking PA increases were larger on heavy versus moderate drinking days, whereas only postdrinking NA decreases were larger on heavy drinking days. Results supported affect regulation models while adding nuance, showing accelerating changes in predrinking affect on drinking days and pre- and postdrinking differences in affect levels and rates of change across days of varying drinking intensity. Beyond theory, our results suggest that accelerating changes in affect may provide a clue to future commencement of heavy drinking, which may aid momentary intervention development. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
| S-EPMC7148183 | biostudies-literature
Project description:Electronic cigarettes (ECs) may hold great potential for helping smokers transition off combustible cigarettes (CCs); however, little is known about the patterns that smokers follow when using an EC as a CC-substitute in order to ultimately reduce and quit smoking. Our primary aim in this study was to evaluate whether common patterns of CC use exist amongst individuals asked to substitute an EC for at least half of the CCs they would normally smoke. These patterns may elucidate the immediate switching and reduction behaviors of individuals using ECs as a reduction/cessation tool. This analysis uses data from a randomized controlled trial of 84 adult smokers assigned to receive either 4.5% nicotine or placebo (0% nicotine) EC. Participants were advised to use the EC to help them reach a 50% reduction in cigarettes-per-day (CPD) within 3 weeks. Longitudinal trajectory analysis was used to identify CPD reduction classes amongst the sample; participants clustered into four distinct, linear trajectories based on daily CC use during the 3-week intervention. Higher readiness to quit smoking, prior successful quit attempts, and lower baseline CC consumption were associated with assignment into “more successful” CC reduction classes. ECs may be a useful mechanism to promote CC reduction. This study demonstrates that a fine-grained trajectory approach can be applied to examine switching patterns in the critical first weeks of an attempt.
| S-EPMC9223631 | biostudies-literature
Project description:Head stabilization is fundamental for balance during locomotion but can be impaired in elderly or diseased populations. Previous studies have identified several parameters of head stability with possible diagnostic value in a laboratory setting. Recently, the ecological validity of measures obtained in such controlled contexts has been called into question. The aim of this study was to investigate the ecological validity of previously described parameters of head stabilization in a real-world setting. Ten healthy subjects participated in the study. Head and trunk movements of each subject were recorded with inertial measurement units (IMUs) for a period of at least 10 h. Periods of locomotion were extracted from the measurements and predominant frequencies, root mean squares (RMSs) and bout lengths were estimated. As parameters of head stabilization, attenuation coefficients (ACs), harmonic ratios (HRs), coherences, and phase differences were computed. Predominant frequencies were distributed tightly around 2 Hz and ACs, HRs, and coherences exhibited the highest values in this frequency range. All head stability parameters exhibited characteristics consistent with previous reports, although higher variances were observed. These results suggest that head stabilization is tuned to the 2 Hz fundamental frequency of locomotion and that previously described measures of head stability could generalize to a real-world setting. This is the first study to address the ecological validity of these measures, highlighting the potential use of head stability parameters as diagnostic tools or outcome measures for clinical trials. The low cost and ease of use of the IMU technology used in this study could additionally be of benefit for a clinical application.
| S-EPMC6558158 | biostudies-literature
Project description:Ecological momentary assessment data consist of in-the-moment sampling several times per day aimed at capturing phenomena that are highly variable. When research questions are focused on the association between a construct measured repeatedly and an event that occurs sporadically over time interspersed between repeated measures, the data consist of correlated observed or censored times to an event. In such a case, specialized time-to-event models that account for correlated observations are required to properly assess the relationships under study. In the current study, we apply two time-to-event analysis techniques, proportional hazards, and accelerated failure time modeling, to data from a study of affective states and sexual behavior in depressed adolescents and illustrate differing interpretations from the models.
| S-EPMC5050055 | biostudies-literature
Project description:BackgroundEcological momentary assessment (EMA) uses mobile technology to enable in situ self-report data collection on behaviors and states. In a typical EMA study, participants are prompted several times a day to answer sets of multiple-choice questions. Although the repeated nature of EMA reduces recall bias, it may induce participation burden. There is a need to explore complementary approaches to collecting in situ self-report data that are less burdensome yet provide comprehensive information on an individual's behaviors and states. A new approach, microinteraction EMA (μEMA), restricts EMA items to single, cognitively simple questions answered on a smartwatch with single-tap assessments using a quick, glanceable microinteraction. However, the viability of using μEMA to capture behaviors and states in a large-scale longitudinal study has not yet been demonstrated.ObjectiveThis paper describes the μEMA protocol currently used in the Temporal Influences on Movement & Exercise (TIME) Study conducted with young adults, the interface of the μEMA app used to gather self-report responses on a smartwatch, qualitative feedback from participants after a pilot study of the μEMA app, changes made to the main TIME Study μEMA protocol and app based on the pilot feedback, and preliminary μEMA results from a subset of active participants in the TIME Study.MethodsThe TIME Study involves data collection on behaviors and states from 246 individuals; measurements include passive sensing from a smartwatch and smartphone and intensive smartphone-based hourly EMA, with 4-day EMA bursts every 2 weeks. Every day, participants also answer a nightly EMA survey. On non-EMA burst days, participants answer μEMA questions on the smartwatch, assessing momentary states such as physical activity, sedentary behavior, and affect. At the end of the study, participants describe their experience with EMA and μEMA in a semistructured interview. A pilot study was used to test and refine the μEMA protocol before the main study.ResultsChanges made to the μEMA study protocol based on pilot feedback included adjusting the single-question selection method and smartwatch vibrotactile prompting. We also added sensor-triggered questions for physical activity and sedentary behavior. As of June 2021, a total of 81 participants had completed at least 6 months of data collection in the main study. For 662,397 μEMA questions delivered, the compliance rate was 67.6% (SD 24.4%) and the completion rate was 79% (SD 22.2%).ConclusionsThe TIME Study provides opportunities to explore a novel approach for collecting temporally dense intensive longitudinal self-report data in a sustainable manner. Data suggest that μEMA may be valuable for understanding behaviors and states at the individual level, thus possibly supporting future longitudinal interventions that require within-day, temporally dense self-report data as people go about their lives.
| S-EPMC8867293 | biostudies-literature
Project description:The FeverApp registry is an ambulant ecological momentary assessment (EMA) model registry focusing on research of fever in children. Verification of EMA reliability is a challenge, due to absence of other source data. To ensure the reliability of EMA data, 973 families were invited to reassess their documentation in a survey. The survey contained questions (a) regarding the number of children, (b) genuineness of entries, (c) completeness of submitted fever episodes, (d) medication, (e) usefulness and further usage of the app. Of those invited, 438 families (45% response rate) participated in the survey. Of these, 363 (83%) families have registered all their children, 208 families have one child. The majority (n = 325, 74.2%) of families stated that they only made genuine entries in the app. Agreement between survey and app for fever episodes is 90% (Cohen's κ = 0.75 [0.66, 0.82]). Medication shows 73.7% agreement, κ = 0.49 [0.42; 0.54]. The majority (n = 245, 55.9%) consider the app as an additional benefit and 87.3% would like to use it further. Email surveys are a possible approach to evaluate EMA based registry data. The possible observation units (children and fever episodes) show an adequate reliability. With this approach, surveys of further samples and variables could help to improve the quality of EMA based registries.
| S-EPMC9954832 | biostudies-literature
Project description:BACKGROUND:Ecological momentary assessment (EMA) is a method of collecting real-time data based on repeated measures and observations that take place in participant's daily environment. EMA has many advantages over more traditional, retrospective questionnaires. However, EMA faces some challenges to reach its full potential. The aims of this systematic review are to (1) investigate whether and how content validity of the items (i.e. the specific questions that are part of a larger EMA questionnaire) used in EMA studies on physical activity and sedentary behaviour was assessed, and (2) provide an overview of important methodological considerations of EMA in measuring physical activity and sedentary behaviour. METHODS:Thirty papers (twenty unique studies) were systematically reviewed and variables were coded and analysed within the following 4 domains: (1) Content validity, (2) Sampling approach, (3) Data input modalities and (4) Degree of EMA completion. RESULTS:Only about half of the studies reported the specific items (n = 12) and the source of the items (n = 11). None of the studies specifically assessed the content validity of the items used. Only a minority (n = 5) of the studies reported any training, and one tested the comprehensibility of the EMA items. A wide variability was found in the design and methodology of the EMA. A minority of the studies (n = 7) reported a rationale for the used prompt frequency, time selection, and monitoring period. Retrospective assessment periods varied from 'now' to 'in the last 3.5 hours'. In some studies there was a possibility to delay (n = 6) or deactivate (n = 10) the prompt, and some provided reminders after the first prompt (n = 9). CONCLUSIONS:Almost no EMA studies reported the content validation of the items used. We recommend using the COSMIN checklist (COnsensus-based Standards for the selection of health Measurement INstruments) to report on the content validity of EMA items. Furthermore, as often no rationale was provided for several methodological decisions, the following three recommendations are made. First, provide a rationale for choosing the sampling modalities. Second, to ensure assessment 'in the moment', think carefully about the retrospective assessment period, reminders, and deactivation of the prompt. Third, as high completion rates are important for representativeness of the data and generalizability of the findings, report completion rates. TRIAL REGISTRATION:This review is registered in PROSPERO, the International prospective register of systematic reviews (registration number: CRD42017077996).
| S-EPMC7063739 | biostudies-literature
Project description:Rapid advances in mobile data-transfer technologies offer new possibilities in the use of cell phones to conduct assessments of a person's natural environment in real time. This paper describes features of a new Internet-based, cell phone-optimized assessment technique (ICAT), which consists of a retrospective baseline assessment combined with text messages sent to the participants' personal cell phones providing a hyperlink to an Internet-stored cell phone-optimized questionnaire. Two participation conditions were used to test variations in response burden. Retention rates, completion rates, and response times in different subgroups were tested by means of χ² tests, Cox regression, and logistic regression. Among the 237 initial participants, we observed a retention rate of 90.3% from the baseline assessment to the cell-phone part, and 80.4% repeated participation in the 30 daily assessments. Each day, 40-70% of the questionnaires were returned, a fourth in less than 3 minutes. Qualitative interviews underscored the ease of use of ICAT. This technique appears to be an innovative, convenient, and cost-effective way of collecting data on situational characteristics while minimizing recall bias. Because of its flexibility, ICAT can be applied in various disciplines, whether as part of small pilot studies or large-scale, crosscultural, and multisite research projects.
| S-EPMC3839619 | biostudies-other
Project description:BACKGROUND:Ecological momentary assessment (EMA) may elicit physical activity (PA) estimates that are less prone to bias than traditional self-report measures while providing context. OBJECTIVES:The objective of this study was to examine the convergent validity of EMA-assessed PA compared with accelerometry. METHODS:The participants self-reported their PA using International Physical Activity Questionnaire (IPAQ) and Behavioral Risk Factor Surveillance System (BRFSS) and wore an accelerometer while completing daily EMAs (delivered through the mobile phone) for 7 days. Weekly summary estimates included sedentary time and moderate-, vigorous-, and moderate-to vigorous-intensity physical activity (MVPA). Spearman coefficients and Lin's concordance correlation coefficients (LCC) examined the linear association and agreement for EMA and the questionnaires as compared with accelerometry. RESULTS:Participants were aged 43.3 (SD 13.1) years, 51.7% (123/238) were African American, 74.8% (178/238) were overweight or obese, and 63.0% (150/238) were low income. The linear associations of EMA and traditional self-reports with accelerometer estimates were statistically significant (P<.05) for sedentary time (EMA: ?=.16), moderate-intensity PA (EMA: ?=.29; BRFSS: ?=.17; IPAQ: ?=.24), and MVPA (EMA: ?=.31; BRFSS: ?=.17; IPAQ: ?=.20). Only EMA estimates of PA were statistically significant compared with accelerometer for agreement. CONCLUSIONS:The mobile EMA showed better correlation and agreement to accelerometer estimates than traditional self-report methods. These findings suggest that mobile EMA may be a practical alternative to accelerometers to assess PA in free-living settings.
| S-EPMC5539388 | biostudies-literature
Project description:ImportanceExisting patient-reported outcome measures of tinnitus assess the severity and disability retrospectively, which may result in adequate reliability, but cannot capture the fluctuating and individualized nature of tinnitus. Experience sampling may provide an alternative.ObjectiveTo use an ecological momentary assessment (EMA) to measure tinnitus disability and associated constructs.Design, setting, and participantsForty adults with tinnitus provided self-report of their tinnitus bother using 5 questions measured by EMA, as well as standard retrospective outcome measures. In this 6-week longitudinal observational study conducted from July 15 to December 22, 2014, participants provided EMA data for 2 weeks (part 1); then after a 2-week break, they provided EMA data for an additional 2 weeks (part 2). A text message with a link to the EMA survey was sent for a total of 56 assessments during each 2-week assessment period. Ecological momentary assessment responses were evaluated using multilevel confirmatory factor analysis to assess the fluctuating nature of bothersome tinnitus across the group and within the pool of individuals over time.Main outcomes and measuresEcological momentary assessment questions measured tinnitus disability and associated constructs. Compliance in each study part was assessed based on response rates. The Tinnitus Functional Index and the Overall Global Rating of Bother Scale were assessed at the beginning and end of each 2-week assessment period to explore the effect of the frequent EMAs on the perceived level of bother from tinnitus.ResultsOf the 40 participants in the study (10 women and 30 men; mean [SD] age, 60.0 [10.5] years), the median survey response rate was high (49 responses to 56 surveys sent [88%] for part 1 and 47 responses of 56 surveys sent [84%] for part 2). The latent factor identified by the 2-level confirmatory factor analysis models demonstrates that within-individual tinnitus bother, loudness, and stress vary together over time. In addition, tinnitus bother, feeling, and stress symptoms all vary together across individuals, which means that bother and stress covary strongly both across time and across individuals.Conclusions and relevanceEcological momentary assessment evaluates the moment-to-moment perception of tinnitus and the effect of emotional and environmental factors, which suggests that it is a superior tool to measure tinnitus outcomes compared with standard retrospective self-reports. Taken together, information from emotional and environmental factors can be summarized in an underlying (latent) factor that represents a vulnerability to bothersome tinnitus and that can be used to comprehensively describe the tinnitus experience. Momentary variability in tinnitus bother is strongly associated with levels of perceived stress.
| S-EPMC5824204 | biostudies-literature