Project description:Digital interventions often suffer from low usage, which may reflect insufficient attention to user experience. Moreover, the existing evaluation methods have limited applicability in the remote study of user experience of complex interventions that have expansive content and that are used over an extensive period of time. To alleviate these challenges, we describe here a novel qualitative Ecological Momentary Assessment (EMA) method: the CORTO method (Contextual, One-item, Repeated, Timely, Open-ended). We used it to gather digital intervention user experience data from Finnish adults (n = 184) who lived with interview-confirmed major depressive disorder (MDD) and took part in a randomized controlled trial (RCT) that studied the efficacy of a novel 12-week game-based digital intervention for depression. A second dataset on user experience was gathered with retrospective interviews (n = 22). We inductively coded the CORTO method and retrospective interview data, which led to four user experience categories: (1) contextual use, (2) interaction-elicited emotional experience, (3) usability, and (4) technical issues. Then, we used the created user experience categories and Template Analysis to analyze both datasets together, and reported the results qualitatively. Finally, we compared the two datasets with each other. We found that the data generated with the CORTO method offered more insights into usability and technical categories than the interview data that particularly illustrated the contextual use. The emotional valence of the interview data was more positive compared with the CORTO data. Both the CORTO and interview data detected 55 % of the micro-level categories; 20 % of micro-level categories were only detected by the CORTO data and 25 % only by the interview data. We found that the during-intervention user experience measurement with the CORTO method can provide intervention-specific insights, and thereby further the iterative user-centered intervention development. Overall, these findings highlight the impact of evaluation methods on the categories and qualities of insights acquired in intervention research.

Project description:Introduction:The dual use of cigarettes and cigars among African American young adults is a significant public health issue. Patterns of and reasons for dual use are difficult to capture using traditional self-report methods. This study used ecological momentary assessment (EMA) to characterize patterns of dual smoking and examine the personal and environmental predictors of cigarette and cigar smoking among African American young adult dual users (ages 18-29) in real-time. Methods:For 14 days, 64 participants smoked ad libitum and were prompted four times daily to record their smoking, craving, emotions, social smoking, and environment via text message on their mobile phones. The odds of single product and dual use were examined using adjusted generalized estimating equations. Results:Participants smoked an average of 7.9 cigarettes and 4.2 cigars per day. Cigarettes and cigars were smoked as frequently during periods of dual use as they were during periods of single product use. Cigarette craving was positively associated with cigarette-only smoking (OR: 1.07), whereas cigar craving was positively associated with cigar-only smoking (OR: 1.43) and dual use (OR: 1.08). Cigars had the greatest odds of dual use when with others (OR: 4.69) and in others' homes (OR: 4.33). Cigarettes had the greatest odds of being smoked while alone (OR: 1.57). Conclusions:EMA was useful for capturing variable smoking patterns and predictors. In this study population, cigarettes and cigars appeared to be smoked additively, and cigars smoked socially. These findings can inform future interventions addressing dual use in this high priority population. Implications:This is the first study to use EMA to examine naturalistic patterns and predictors of multiple tobacco use in real-time. African American young adults smoked cigarettes and cigars during periods of dual use as frequently as during periods of single product use. This suggests that most use was additive (one product smoked in addition to another) and less often as substitution (one product smoked instead of another). Social smoking and craving were strongly associated with cigar smoking in single and dual use periods. This study suggests the need for cessation messaging specifically targeted to reduce dual use in this population.

Project description:BackgroundEcological momentary assessment (EMA) is an in situ method of gathering self-report on behaviors using mobile devices. In typical phone-based EMAs, participants are prompted repeatedly with multiple-choice questions, often causing participation burden. Alternatively, microinteraction EMA (micro-EMA or μEMA) is a type of EMA where all the self-report prompts are single-question surveys that can be answered using a 1-tap glanceable microinteraction conveniently on a smartwatch. Prior work suggests that μEMA may permit a substantially higher prompting rate than EMA, yielding higher response rates and lower participation burden. This is achieved by ensuring μEMA prompt questions are quick and cognitively simple to answer. However, the validity of participant responses from μEMA self-report has not yet been formally assessed.ObjectiveIn this pilot study, we explored the criterion validity of μEMA self-report on a smartwatch, using physical activity (PA) assessment as an example behavior of interest.MethodsA total of 17 participants answered 72 μEMA prompts each day for 1 week using a custom-built μEMA smartwatch app. At each prompt, they self-reported whether they were doing sedentary, light/standing, moderate/walking, or vigorous activities by tapping on the smartwatch screen. Responses were compared with a research-grade activity monitor worn on the dominant ankle simultaneously (and continuously) measuring PA.ResultsParticipants had an 87.01% (5226/6006) μEMA completion rate and a 74.00% (5226/7062) compliance rate taking an average of only 5.4 (SD 1.5) seconds to answer a prompt. When comparing μEMA responses with the activity monitor, we observed significantly higher (P<.001) momentary PA levels on the activity monitor when participants self-reported engaging in moderate+vigorous activities compared with sedentary or light/standing activities. The same comparison did not yield any significant differences in momentary PA levels as recorded by the activity monitor when the μEMA responses were randomly generated (ie, simulating careless taps on the smartwatch).ConclusionsFor PA measurement, high-frequency μEMA self-report could be used to capture information that appears consistent with that of a research-grade continuous sensor for sedentary, light, and moderate+vigorous activity, suggesting criterion validity. The preliminary results show that participants were not carelessly answering μEMA prompts by randomly tapping on the smartwatch but were reporting their true behavior at that moment. However, more research is needed to examine the criterion validity of μEMA when measuring vigorous activities.

Dataset Information

Measuring the temporal association between cannabis and tobacco use among Co-using young adults using ecological momentary assessment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets