Patterns of Missing Data With Ecological Momentary Assessment Among People Who Use Drugs: Feasibility Study Using Pilot Study Data.
Ontology highlight
ABSTRACT: Background
Ecological momentary assessment (EMA) is a set of research methods that capture events, feelings, and behaviors as they unfold in their real-world setting. Capturing data in the moment reduces important sources of measurement error but also generates challenges for noncompliance (ie, missing data). To date, EMA research has only examined the overall rates of noncompliance.Objective
In this study, we identify four types of noncompliance among people who use drugs and aim to examine the factors associated with the most common types.Methods
Data were obtained from a recent pilot study of 28 Nebraskan people who use drugs who answered EMA questions for 2 weeks. We examined questions that were not answered because they were skipped, they expired, the phone was switched off, or the phone died after receiving them.Results
We found that the phone being switched off and questions expiring comprised 93.34% (1739/1863 missing question-instances) of our missing data. Generalized structural equation model results show that participant-level factors, including age (relative risk ratio [RRR]=0.93; P=.005), gender (RRR=0.08; P=.006), homelessness (RRR=3.80; P=.04), personal device ownership (RRR=0.14; P=.008), and network size (RRR=0.57; P=.001), are important for predicting off missingness, whereas only question-level factors, including time of day (ie, morning compared with afternoon, RRR=0.55; P<.001) and day of week (ie, Tuesday-Saturday compared with Sunday, RRR=0.70, P=.02; RRR=0.64, P=.005; RRR=0.58, P=.001; RRR=0.55, P<.001; and RRR=0.66, P=.008, respectively) are important for predicting expired missingness. The week of study is important for both (ie, week 2 compared with week 1, RRR=1.21, P=.03, for off missingness and RRR=1.98, P<.001, for expired missingness).Conclusions
We suggest a three-pronged strategy to preempt missing EMA data with high-risk populations: first, provide additional resources for participants likely to experience phone charging problems (eg, people experiencing homelessness); second, ask questions when participants are not likely to experience competing demands (eg, morning); and third, incentivize continued compliance as the study progresses. Attending to these issues can help researchers ensure maximal data quality.
SUBMITTER: Markowski KL
PROVIDER: S-EPMC8501406 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundBarriers to assessing depression in advanced dementia include the presence of informant and patient recall biases. Ecological momentary assessment provides an improved approach for mood assessment by collecting observations in intervals throughout the day, decreasing recall bias, and increasing ecological validity.ObjectiveThis study aims to evaluate the feasibility, reliability, and validity of the modified 4-item Cornell Scale for Depression in Dementia for Momentary Assessment (mCSDD4-MA) tool to assess depression in patients with advanced dementia.MethodsA intensive longitudinal pilot study design was used. A total of 12 participants with advanced dementia were enrolled from an inpatient psychogeriatric unit. Participants were assessed using clinical depression assessments at admission and discharge. Research staff recorded observations four times a day for 6 weeks on phones with access to the mCSDD4-MA tool. Descriptive data related to feasibility were reported (ie, completion rates). Statistical models were used to examine the interrater reliability and construct and predictive validity of the data.ResultsOverall, 1923 observations were completed, representing 55.06% (1923/3496) of all rating opportunities with 2 raters and 66.01% (1923/2913) with at least one rater. Moderate interrater reliability was demonstrated for all items, except for lack of interest. Moderate correlations were observed between observers and patient-reported outcomes, where observers reported fewer symptoms relative to participants' self-reports. Several items were associated with and able to predict depression.ConclusionsThe mCSDD4-MA tool was feasible to use, and most items in the tool showed moderate reliability and validity for assessing depression in dementia. Repeated and real-time depression assessment in advanced dementia holds promise for the identification of clinical depression and depressive symptoms.
| S-EPMC8374663 | biostudies-literature
Project description:Advances in digital technology have greatly increased the ease of collecting intensive longitudinal data (ILD) such as ecological momentary assessments (EMAs) in studies of behavior changes. Such data are typically multilevel (e.g., with repeated measures nested within individuals), and are inevitably characterized by some degrees of missingness. Previous studies have validated the utility of multiple imputation as a way to handle missing observations in ILD when the imputation model is properly specified to reflect time dependencies. In this study, we illustrate the importance of proper accommodation of multilevel ILD structures in performing multiple imputations, and compare the performance of a multilevel multiple imputation (multilevel MI) approach relative to other approaches that do not account for such structures in a Monte Carlo simulation study. Empirical EMA data from a tobacco cessation study are used to demonstrate the utility of the multilevel MI approach, and the implications of separating participant- and study-initiated EMAs in evaluating individuals' affective dynamics and urge.
| S-EPMC10676222 | biostudies-literature
Project description:ObjectivesBecause audiometric evaluation, symptom histories, questionnaires, and similar standard assessment tools may not adequately sample the effects of chronic tinnitus on day-to-day activities, there is a need for alternative methodological approaches to study the impact of tinnitus on day-to-day life. An innovative methodological approach that has shown great promise in the study of chronic health problems characterized by reported temporal and/or situational variability in symptoms and distress is known as ecological momentary assessment (EMA). EMA involves the real-time measurement of states, situational factors, and symptoms by individuals as they go about their day-to-day activities. The objective of this pilot investigation was to explore the feasibility of using EMA methods to examine within- and between-day effects of tinnitus.DesignThis study was conducted in three phases: (1) design and development of an EMA methodology that could be used to assess effects of tinnitus; (2) refinement of the methodology through the use of two focus groups; and (3) field-test the methodology with individuals who experienced bothersome tinnitus. For Phase 3, each of the 24 participants wore, throughout their waking hours for 2 weeks, a personal digital assistant that produced alerts four times a day. The alerts prompted participants to respond to 19 questions, including 9 relating to situational and mood factors and 10 comprising the Tinnitus Handicap Inventory-Screening version (THI-S). To evaluate for potential reactive effects of performing the EMA protocol, each participant completed the paper-and-pencil version of the full 25-item THI before and after the 2-week EMA period.ResultsParticipants responded to the alerts with a 90% compliance rate, providing a total of 1210 completed surveys. At the time of their response, participants indicated that they were in their house or apartment (67.7%), alone (50.2%), happy (50%), and calm (54.5%). Across most responses, participants could hear their tinnitus (97%), and the loudness of their tinnitus averaged 4.7 on a 7-point increasing-loudness scale. The mean THI-S index score (out of a possible maximum 40 points for greatest tinnitus severity) was 17.0 (moderate self-perceived tinnitus handicap). Repeated THI-S index scores varied considerably both within and between participants. Mean 25-item THI scores were not significantly different before and after the EMA period, suggesting little reactivity of the EMA.ConclusionsThe high compliance rate, positive feedback from participants, lack of reactivity as a result of performing the EMA protocol, and data collected indicate that EMA methodology is feasible with patients who have tinnitus. Outcome data obtained with this methodology cannot be obtained any other way because retrospective questionnaires cannot capture the day-to-day reactions. This methodology has the potential to provide more in-depth and accurate assessments of patients receiving therapy for tinnitus.
| S-EPMC3251738 | biostudies-literature
Project description:BackgroundEcological momentary assessment (EMA) uses mobile technology to enable in situ self-report data collection on behaviors and states. In a typical EMA study, participants are prompted several times a day to answer sets of multiple-choice questions. Although the repeated nature of EMA reduces recall bias, it may induce participation burden. There is a need to explore complementary approaches to collecting in situ self-report data that are less burdensome yet provide comprehensive information on an individual's behaviors and states. A new approach, microinteraction EMA (μEMA), restricts EMA items to single, cognitively simple questions answered on a smartwatch with single-tap assessments using a quick, glanceable microinteraction. However, the viability of using μEMA to capture behaviors and states in a large-scale longitudinal study has not yet been demonstrated.ObjectiveThis paper describes the μEMA protocol currently used in the Temporal Influences on Movement & Exercise (TIME) Study conducted with young adults, the interface of the μEMA app used to gather self-report responses on a smartwatch, qualitative feedback from participants after a pilot study of the μEMA app, changes made to the main TIME Study μEMA protocol and app based on the pilot feedback, and preliminary μEMA results from a subset of active participants in the TIME Study.MethodsThe TIME Study involves data collection on behaviors and states from 246 individuals; measurements include passive sensing from a smartwatch and smartphone and intensive smartphone-based hourly EMA, with 4-day EMA bursts every 2 weeks. Every day, participants also answer a nightly EMA survey. On non-EMA burst days, participants answer μEMA questions on the smartwatch, assessing momentary states such as physical activity, sedentary behavior, and affect. At the end of the study, participants describe their experience with EMA and μEMA in a semistructured interview. A pilot study was used to test and refine the μEMA protocol before the main study.ResultsChanges made to the μEMA study protocol based on pilot feedback included adjusting the single-question selection method and smartwatch vibrotactile prompting. We also added sensor-triggered questions for physical activity and sedentary behavior. As of June 2021, a total of 81 participants had completed at least 6 months of data collection in the main study. For 662,397 μEMA questions delivered, the compliance rate was 67.6% (SD 24.4%) and the completion rate was 79% (SD 22.2%).ConclusionsThe TIME Study provides opportunities to explore a novel approach for collecting temporally dense intensive longitudinal self-report data in a sustainable manner. Data suggest that μEMA may be valuable for understanding behaviors and states at the individual level, thus possibly supporting future longitudinal interventions that require within-day, temporally dense self-report data as people go about their lives.
| S-EPMC8867293 | biostudies-literature
Project description:BackgroundIndividuals can experience difficulties pursuing their goals amid multiple competing priorities in their environment. Effective goal dynamics require flexible and generalizable pursuit skills. Supporting successful goal pursuit requires a perpetually adapting intervention responsive to internal states.ObjectiveThe purpose of this study was to (1) develop a flexible intervention that can adapt to an individual's changing short to medium-term goals and be applied to their daily life and (2) examine the feasibility and acceptability of the just-in-time adaptive intervention for goal pursuit.MethodsThis study involved 3 iterations to test and systematically enhance all aspects of the intervention. During the pilot phase, 73 participants engaged in an ecological momentary assessment (EMA) over 1 month. After week 1, they attended an intervention training session and received just-in-time intervention prompts during the following 3 weeks. The training employed the Capability, Opportunity, Motivation, and Behavior (COM-B) framework for goal setting, along with mental contrasting with implementation intentions (MCII). Subsequent prompts, triggered by variability in goal pursuit, guided the participants to engage in MCII in relation to their current goal. We evaluated feasibility and acceptability, efficacy, and individual change processes by combining intensive (single-case experimental design) and extensive methods.ResultsThe results suggest that the digital intervention was feasible and acceptable to participants. Compliance with the intervention was high (n=63, 86%). The participants endorsed high acceptability ratings relating to both the study procedures and the intervention. All participants (N=73, 100%) demonstrated significant improvements in goal pursuit with an average difference of 0.495 units in the outcome (P<.001). The results of the dynamic network modeling suggest that self-monitoring behavior (EMA) and implementing the MCII strategy may aid in goal reprioritization, where goal pursuit itself is a driver of further goal pursuit.ConclusionsThis pilot study demonstrated the feasibility and acceptability of a just-in-time adaptive intervention among a nonclinical adult sample. This intervention used self-monitoring of behavior, the COM-B framework, and MCII strategies to improve dynamic goal pursuit. It was delivered via an Ecological Momentary Intervention (EMI) procedure. Future research should consider the utility of this approach as an additional intervention element within psychological interventions to improve goal pursuit. Sustaining goal pursuit throughout interventions is central to their effectiveness and warrants further evaluation.
| S-EPMC10993123 | biostudies-literature
Project description:Valid, reliable behavioral data and contextually meaningful interventions are necessary for improved health outcomes. Ecological Momentary Assessment and Intervention (EMAI), which collects data as behaviors occur to deliver real-time interventions, may be more accurate and reliable than retrospective methods. The rapid expansion of mobile technologies in low-and-middle-income countries allows for unprecedented remote data collection and intervention opportunities. However, no previous studies have trialed EMAI in sub-Saharan Africa. We assessed EMAI acceptability and feasibility, including participant retention and response rate, in a prospective, parallel group, randomized pilot trial in Rakai, Uganda comparing behavioral outcomes among adults submitting ecological momentary assessments (EMA) versus EMAI. After training, participants submitted EMA data on five nutrition and health risk behaviors over a 90-day period using a smartphone-based application utilizing prompt-based, participant-initiated, and geospatial coordinate data collection, with study coordinator support and incentives for >50% completion. Included behaviors and associated EMAI-arm intervention messages were selected to pilot a range of EMAI applications. Acceptability was measured on questionnaires. We estimated the association between high response rate and participant characteristics and conducted thematic analysis characterizing participant experiences. Study completion was 48/50 participants. Median prompt response rate was 66.5% (IQR: 60.0%-78.6%). Prior smartphone app use at baseline (aPR 3.76, 95%CI: 1.16-12.17, p = 0.03) and being in the intervention arm (aPR 2.55, 95% CI: 1.01-6.44, p = 0.05) were significantly associated with the top response rate quartile (response to >78.6% of prompts). All participants submitted self-initiated reports, covering all behaviors of interest, including potentially sensitive behaviors. Inconsistent phone charging was the most reported feasibility challenge. In this pilot, EMAI was acceptable and feasible. Response rates were good; additional strategies to improve compliance should be investigated. EMAI using mobile technologies may support improved behavioral data collection and intervention approaches in low and middle-income settings. This approach should be tested in larger studies.
| S-EPMC9416993 | biostudies-literature
Project description:PurposeThe analysis of Ecological Momentary Assessment (EMA) data can be difficult to conceptualize due to the complexity of how the data are collected. The goal of this tutorial is to provide an overview of statistical considerations for analyzing observational data arising from EMA studies.MethodEMA data are collected in a variety of ways, complicating the statistical analysis. We focus on fundamental statistical characteristics of the data and general purpose statistical approaches to analyzing EMA data. We implement those statistical approaches using a recent study involving EMA.ResultsThe linear or generalized linear mixed-model statistical approach can adequately capture the challenges resulting from EMA collected data if properly set up. Additionally, while sample size depends on both the number of participants and the number of survey responses per participant, having more participants is more important than the number of responses per participant.ConclusionUsing modern statistical methods when analyzing EMA data and adequately considering all of the statistical assumptions being used can lead to interesting and important findings when using EMA.Supplemental materialhttps://doi.org/10.23641/asha.17155961.
| S-EPMC9150728 | biostudies-literature
Project description:BackgroundWearable tracking devices and mobile health technology are increasingly used in an effort to enhance clinical care and the delivery of personalized medical treatment. Postpartum depression is the most frequently diagnosed complication of childbirth; however, significant gaps in screening and treatment remain.ObjectiveThis study aims to investigate the clinical utility, predictive ability, and acceptability of using ecological momentary assessment to collect daily mood, sleep, and activity data through the use of an Apple Watch and mobile app among women with postpartum depression.MethodsThis was a pilot study consisting of 3 in-person research visits over the course of a 6-week enrollment period. Questionnaires to assess depression, anxiety, and maternal functioning were periodically collected, along with daily self-reported symptoms and passively collected physiological data via an Apple Watch. Feedback was collected from study participants and the study clinician to determine the utility and acceptability of daily tracking. Logistic regression was used to determine whether mood scores in the 2 weeks before a visit predicted scores at follow-up. Compliance with daily assessments was also measured.ResultsOf the 26 women enrolled, 23 (88%) completed the 6-week study period. On average, the participants completed 67% (34.4/51.5 days) of all active daily assessments and 74% (38/51.5 days) of all passive measures. Furthermore, all 23 participants completed the 3 required visits with the research team. Predictive correlations were found between self-reported mood and Edinburgh Postnatal Depression Scale score at follow-up, self-reported anxiety and EDPS, and sleep quality and Edinburgh Postnatal Depression Scale.ConclusionsUsing ecological momentary assessment to track daily symptoms of postpartum depression using a wearable device was largely endorsed as acceptable and clinically useful by participants and the study clinician and could be an innovative solution to increase care access during the COVID-19 pandemic.
| S-EPMC8987954 | biostudies-literature
Project description:BACKGROUND:Sedentary behavior has received much attention in the scientific community over the past decade. There is growing evidence that sedentary behavior is negatively associated with physical and mental health. However, an in-depth understanding of the social and environmental context of sedentary behavior is missing. Information about sedentary behavior, such as how everyday sedentary behavior occurs throughout the day (eg, number and length of sedentary bouts), where, when, and with whom it takes place, and what people are doing while being sedentary, is useful to inform the development of interventions aimed at reducing sedentary time. However, examining everyday sedentary behavior requires specific methods. OBJECTIVE:The purpose of this paper is (1) to introduce sedentary behavior-triggered Ecological Momentary Assessment (EMA) as a methodological advancement in the field of sedentary behavior research and (2) to examine the accuracy of sedentary behavior-triggered EMA in 3 different studies in healthy adults. Moreover, we compare the accuracy of sedentary behavior-triggered EMA to simulations of random-trigger designs. METHODS:Sedentary behavior-triggered EMA comprises a continuous assessment of sedentary behavior via accelerometers and repeated contextual assessments via electronic diaries (ie, an application on a smartphone). More specifically, the accelerometer analyzes and transfers data regarding body position (a sitting or lying position, or an upright position) via Bluetooth Low Energy (BLE) to a smartphone in real time and triggers the deployment of questionnaires. Each time a participant spends a specified time (eg, 20 minutes) in a sedentary position, the e-diary triggers contextual assessments. To test the accuracy of this method, we calculated a percentage score for all triggered prompts in relation to the total number of bouts that could trigger a prompt. RESULTS:Based on the accelerometer recordings, 29.3% (5062/17278) of all sedentary bouts were classified as moderate-to-long (20-40 minutes) and long bouts (? 41 minutes). On average, the accuracy by participant was 82.77% (3339/4034; SD 21.01%, range 71.00-88.22%) on the study level. Compared to simulations of random prompts (every 120 minutes), the number of triggered prompts was up to 47.9% (n=704) higher through the sedentary behavior-triggered EMA approach. Nearly 40% (799/2001) of all prolonged sedentary bouts (? 20 minutes) occurred during work, and in 57% (1140/2001) of all bouts, the participants were not alone. CONCLUSIONS:Sedentary behavior-triggered EMA is an accurate method for collecting contextual information on sedentary behavior in daily life. Given the growing interest in sedentary behavior research, this sophisticated approach offers a real advancement as it can be used to collect social and environmental contextual information or to unravel dynamic associations. Furthermore, it can be modified to develop sedentary behavior-triggered mHealth interventions.
| S-EPMC7525404 | biostudies-literature
Project description:Background: Interoception is a multi-facetted phenomenon including interoceptive accuracy, awareness and sensibility. Deficits in interoception have been associated with psychological distress. However, little is known about the course of interoception over time. The present study aimed at examining interoception in an ecological momentary assessment (EMA)-setting. Methods: A seven-day smartphone-based EMA was conducted in a community sample of sixty-one participants (age: M = 24.1, SD = 7.00, n = 54 female (88.5%)). To control for potential practice effects of repeated assessments during the EMA phase, participants were randomly assigned to a control (n = 30) and an interoception (n = 31) group. The latter was assessed for interoceptive accuracy, awareness and sensibility. Before and after the EMA phase, all participants were assessed for interoception in the laboratory. Results: Multilevel analyses revealed significant fluctuations for all three interoceptive facets, around 50% of variance was due to within-person variability. There were only practice effects for the subscale "Attention Regulation", measuring interoceptive sensibility. Conclusion: The facets of interoception can be assessed in an EMA-setting. Repeated interoceptive assessments do not necessarily lead to an improvement of participants' interoceptive abilities. It could be shown that all interoceptive facets fluctuate, which should be considered in future research.
| S-EPMC8124337 | biostudies-literature