Dataset Information

Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review.

ABSTRACT: BACKGROUND:Ecological momentary assessment (EMA) is a method of collecting real-time data based on repeated measures and observations that take place in participant's daily environment. EMA has many advantages over more traditional, retrospective questionnaires. However, EMA faces some challenges to reach its full potential. The aims of this systematic review are to (1) investigate whether and how content validity of the items (i.e. the specific questions that are part of a larger EMA questionnaire) used in EMA studies on physical activity and sedentary behaviour was assessed, and (2) provide an overview of important methodological considerations of EMA in measuring physical activity and sedentary behaviour. METHODS:Thirty papers (twenty unique studies) were systematically reviewed and variables were coded and analysed within the following 4 domains: (1) Content validity, (2) Sampling approach, (3) Data input modalities and (4) Degree of EMA completion. RESULTS:Only about half of the studies reported the specific items (n?=?12) and the source of the items (n?=?11). None of the studies specifically assessed the content validity of the items used. Only a minority (n?=?5) of the studies reported any training, and one tested the comprehensibility of the EMA items. A wide variability was found in the design and methodology of the EMA. A minority of the studies (n?=?7) reported a rationale for the used prompt frequency, time selection, and monitoring period. Retrospective assessment periods varied from 'now' to 'in the last 3.5 hours'. In some studies there was a possibility to delay (n?=?6) or deactivate (n?=?10) the prompt, and some provided reminders after the first prompt (n?=?9). CONCLUSIONS:Almost no EMA studies reported the content validation of the items used. We recommend using the COSMIN checklist (COnsensus-based Standards for the selection of health Measurement INstruments) to report on the content validity of EMA items. Furthermore, as often no rationale was provided for several methodological decisions, the following three recommendations are made. First, provide a rationale for choosing the sampling modalities. Second, to ensure assessment 'in the moment', think carefully about the retrospective assessment period, reminders, and deactivation of the prompt. Third, as high completion rates are important for representativeness of the data and generalizability of the findings, report completion rates. TRIAL REGISTRATION:This review is registered in PROSPERO, the International prospective register of systematic reviews (registration number: CRD42017077996).

SUBMITTER: Degroote L

PROVIDER: S-EPMC7063739 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review.

Degroote L L DeSmet A A De Bourdeaudhuij I I Van Dyck D D Crombez G G

The international journal of behavioral nutrition and physical activity 20200310 1

<h4>Background</h4>Ecological momentary assessment (EMA) is a method of collecting real-time data based on repeated measures and observations that take place in participant's daily environment. EMA has many advantages over more traditional, retrospective questionnaires. However, EMA faces some challenges to reach its full potential. The aims of this systematic review are to (1) investigate whether and how content validity of the items (i.e. the specific questions that are part of a larger EMA qu ...[more]

PMID: 32151251

Similar Datasets

Project description:BackgroundEcological momentary assessment (EMA) is an in situ method of gathering self-report on behaviors using mobile devices. In typical phone-based EMAs, participants are prompted repeatedly with multiple-choice questions, often causing participation burden. Alternatively, microinteraction EMA (micro-EMA or μEMA) is a type of EMA where all the self-report prompts are single-question surveys that can be answered using a 1-tap glanceable microinteraction conveniently on a smartwatch. Prior work suggests that μEMA may permit a substantially higher prompting rate than EMA, yielding higher response rates and lower participation burden. This is achieved by ensuring μEMA prompt questions are quick and cognitively simple to answer. However, the validity of participant responses from μEMA self-report has not yet been formally assessed.ObjectiveIn this pilot study, we explored the criterion validity of μEMA self-report on a smartwatch, using physical activity (PA) assessment as an example behavior of interest.MethodsA total of 17 participants answered 72 μEMA prompts each day for 1 week using a custom-built μEMA smartwatch app. At each prompt, they self-reported whether they were doing sedentary, light/standing, moderate/walking, or vigorous activities by tapping on the smartwatch screen. Responses were compared with a research-grade activity monitor worn on the dominant ankle simultaneously (and continuously) measuring PA.ResultsParticipants had an 87.01% (5226/6006) μEMA completion rate and a 74.00% (5226/7062) compliance rate taking an average of only 5.4 (SD 1.5) seconds to answer a prompt. When comparing μEMA responses with the activity monitor, we observed significantly higher (P<.001) momentary PA levels on the activity monitor when participants self-reported engaging in moderate+vigorous activities compared with sedentary or light/standing activities. The same comparison did not yield any significant differences in momentary PA levels as recorded by the activity monitor when the μEMA responses were randomly generated (ie, simulating careless taps on the smartwatch).ConclusionsFor PA measurement, high-frequency μEMA self-report could be used to capture information that appears consistent with that of a research-grade continuous sensor for sedentary, light, and moderate+vigorous activity, suggesting criterion validity. The preliminary results show that participants were not carelessly answering μEMA prompts by randomly tapping on the smartwatch but were reporting their true behavior at that moment. However, more research is needed to examine the criterion validity of μEMA when measuring vigorous activities.

Project description:BackgroundNational policy approaches to physical activity (PA) promotion and sedentary behaviour (SB) reduction are needed to address rising rates of non-communicable diseases. Understanding the policy process and impact through robust research and evaluation is crucial for facilitating successful reforms in national health policy. This scoping review, therefore, aimed to map the evidence on indicators, development, and content of national PA and/or SB policies globally.MethodsA systematic search of academic and grey literature was conducted through six bibliographic databases, Google, and websites of three large organisations for PA promotion.ResultsOut of 24,872 screened documents, 203 publications from 163 studies were selected. The selected studies investigated PA/SB policies in 168 countries worldwide, and we provided summary results for each of the countries. Overall, 69, 29, and 2% of the analyses of national PA/SB policies were conducted for high-, middle-, and low-income countries, respectively. Twenty-two percent of the studies mentioned SB policies as part of their analysis, with only one study focusing solely on assessing SB policies. Operational definitions of policy were found in only 13% of publications. Only 15% of the studies used a conceptual or theoretical framework. A large variety of methods were used for data collection and analysis of PA/SB policy.ConclusionsWe found that PA policy research is much more developed than it was considered several years ago. Research around SB policies is still in its infancy, but it seems to have experienced some positive progress in the last few years. Three key issues were identified that should be addressed in further research: [i] there is a lack of PA/SB policy research in low- and middle-income countries, which is an important limitation of the current body of evidence; [ii] the definition of policy varied significantly across studies, and most studies did not rely on any theoretical framework, which may impede cross-study comparisons; and [iii] studies have used a variety of methods to analyse policy, which may also cause problems with comparability. Future PA/SB policy research should aim towards a clearer conceptualisation of policy, greater reliance on existing theoretical frameworks, and the use and further development of standardised methods for PA/SB policy analysis.

Project description:BackgroundRetrospective self-report questionnaires are the most common method for assessing physical activity (PA) and sedentary behavior (SB) in children when the use of objective assessment methods (eg, accelerometry) is cost prohibitive. However, self-report measures have limitations (eg, recall bias). The use of real-time, mobile ecological momentary assessment (EMA) has been proposed to address these shortcomings. The study findings will provide useful information for researchers interested in using EMA surveys for measuring PA and SB in children, particularly when reported by a parent or caregiver.ObjectiveThis study aimed to examine the associations between the parent's EMA report of their child's PA and SB and accelerometer-measured sedentary time (ST), light-intensity PA (LPA), and moderate-to-vigorous-intensity PA (MVPA) and to examine if these associations differed by day of week, sex, and season.MethodsA total of 140 parent-child dyads (mean child age 6.4 years, SD 0.8; n=66 girls; n=21 African American; n=24 American Indian; n=25 Hispanic/Latino; n=24 Hmong; n=22 Somali; and n=24 white) participated in this study. During an 8-day period, parents reported child PA and SB via multiple daily signal contingent EMA surveys, and children wore a hip-mounted accelerometer to objectively measure ST, LPA, and MVPA. Accelerometer data was matched to the time period occurring before parent EMA-report of child PA and SB. Generalized estimating equations with interaction-term analyses were performed to determine whether the relationship between parent-EMA report of child PA and SB and accelerometer-measured ST and LPA and MVPA outcomes differed by day of the week, sex and season.ResultsThe parent's EMA report of their child's PA and SB was strongly associated with accelerometer-measured ST, LPA, and MVPA. The parent's EMA report of their child's PA was stronger during the weekend than on weekdays for accelerometer-measured ST (P≤.001) and LPA (P<.001). For the parent's EMA report of their child's SB, strong associations were observed with accelerometer-measured ST (P<.001), LPA (P=.005), and MVPA (P=.008). The findings related to sex-interaction terms indicated that the association between the parent-reported child's PA via EMA and the accelerometer-measured MVPA was stronger for boys than girls (P=.02). The association between the parent's EMA report of their child's PA and SB and accelerometer-measured ST and PA was similar across seasons in this sample (all P values >.31).ConclusionsWhen the use of accelerometry-based methods is not feasible and in contexts where the parent is able to spend more proximate time observing the child's PA and SB, the parent's EMA report might be a superior method for measuring PA and SB in young children relative to self-report, given the EMA's strong associations with accelerometer-measured PA and ST.

Project description:BackgroundFew adolescents achieve sufficient levels of physical activity, and many are spending most of their time in sedentary behavior. Affective response following sedentary time may influence motivation to remain sedentary. Ecological Momentary Assessment (EMA) is a real-time data capture methodology that can be used to identify factors influencing sedentary time, such as the context of the home setting, and resulting affective state within a free-living setting. The purpose of this study was to evaluate the relationship between context at home and adolescent sedentary time, and the relationship of sedentary time and subsequent affect.MethodsAdolescents (n = 284; 10-16 y) participated in an EMA study that used random, interval-based sampling methods. Adolescents each received 22 unannounced surveys over 7-days through a smartphone application. One survey was randomly sent within each 2-h time-period. These time-periods occurred between 4:00 pm-8:00 pm on weekdays and 8:00 am-8:00 pm on the weekend. This 15-question survey included a series of questions on context (indoors/outdoors, alone/not alone) and positive affect. Adolescents concurrently wore an accelerometer at the hip, and the 30-min bout of accelerometry data prior to each survey was used in analyses. Mixed-effect location scale models were used to examine the association between context at home and sedentary time (stage 1) and the adjusted sedentary time and positive affect (stage 2), with each model adjusted for covariates.ResultsAdolescents were 12.6 ± 1.9 y of age on average, about half were White (58%), and engaged in high levels of sedentary behavior during the 30 min prior to the survey (21.4 ± 6.8 min). Most surveys occurred when adolescents were with others (59%) and indoors (88%). In Stage 1, both being alone and being indoors at home were positively associated with sedentary time (p < 0.001 for both). In Stage 2, adjusted sedentary time was not related to positive affect. Age was negatively related to positive affect (p < 0.001).ConclusionsBoth contextual factors, being alone and indoors at home, were related to additional time spent sedentary compared to being with someone or outdoors. After adjustment, sedentary time was not related to subsequent positive affect, indicating other factors may be related to adolescent's positive affect in home settings.

Project description:BackgroundHealthy behaviors are crucial for maintaining a person's health and well-being. The effects of health behavior interventions are mediated by individual and contextual factors that vary over time. Recently emerging smartphone-based ecological momentary interventions (EMIs) can use real-time user reports (ecological momentary assessments [EMAs]) to trigger appropriate support when needed in daily life.ObjectiveThis systematic review aims to assess the characteristics of smartphone-delivered EMIs using self-reported EMAs in relation to their effects on health behaviors, user engagement, and user perspectives.MethodsWe searched MEDLINE, Embase, PsycINFO, and CINAHL in June 2019 and updated the search in March 2020. We included experimental studies that incorporated EMIs based on EMAs delivered through smartphone apps to promote health behaviors in any health domain. Studies were independently screened. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. We performed a narrative synthesis of intervention effects, user perspectives and engagement, and intervention design and characteristics. Quality appraisal was conducted for all included studies.ResultsWe included 19 papers describing 17 unique studies and comprising 652 participants. Most studies were quasi-experimental (13/17, 76%), had small sample sizes, and great heterogeneity in intervention designs and measurements. EMIs were most popular in the mental health domain (8/17, 47%), followed by substance abuse (3/17, 18%), diet, weight loss, physical activity (4/17, 24%), and smoking (2/17, 12%). Of the 17 studies, the 4 (24%) included randomized controlled trials reported nonstatistically significant effects on health behaviors, and 4 (24%) quasi-experimental studies reported statistically significant pre-post improvements in self-reported primary outcomes, namely depressive (P<.001) and psychotic symptoms (P=.03), drinking frequency (P<.001), and eating patterns (P=.01). EMA was commonly used to capture subjective experiences as well as behaviors, whereas sensors were rarely used. Generally, users perceived EMIs to be helpful. Common suggestions for improvement included enhancing personalization, multimedia and interactive capabilities (eg, voice recording), and lowering the EMA reporting burden. EMI and EMA components were rarely reported and were not described in a standardized manner across studies, hampering progress in this field. A reporting checklist was developed to facilitate the interpretation and comparison of findings and enhance the transparency and replicability of future studies using EMAs and EMIs.ConclusionsThe use of smartphone-delivered EMIs using self-reported EMAs to promote behavior change is an emerging area of research, with few studies evaluating efficacy. Such interventions could present an opportunity to enhance health but need further assessment in larger participant cohorts and well-designed evaluations following reporting checklists. Future research should explore combining self-reported EMAs of subjective experiences with objective data passively collected via sensors to promote personalization while minimizing user burden, as well as explore different EMA data collection methods (eg, chatbots).Trial registrationPROSPERO CRD42019138739; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=138739.

Dataset Information

Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review.

Publications

Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets