Dataset Information

Engagement and retention: measuring breadth and depth of participant use of an online intervention.

ABSTRACT: The Internet provides us with tools (user metrics or paradata) to evaluate how users interact with online interventions. Analysis of these paradata can lead to design improvements.The objective was to explore the qualities of online participant engagement in an online intervention. We analyzed the paradata in a randomized controlled trial of alternative versions of an online intervention designed to promote consumption of fruit and vegetables.Volunteers were randomized to 1 of 3 study arms involving several online sessions. We created 2 indirect measures of breadth and depth to measure different dimensions and dynamics of program engagement based on factor analysis of paradata measures of Web pages visited and time spent online with the intervention materials. Multiple regression was used to assess influence of engagement on retention and change in dietary intake.Baseline surveys were completed by 2513 enrolled participants. Of these, 86.3% (n = 2168) completed the follow-up surveys at 3 months, 79.6% (n = 2027) at 6 months, and 79.4% (n = 1995) at 12 months. The 2 tailored intervention arms exhibited significantly more engagement than the untailored arm (P < .01). Breadth and depth measures of engagement were significantly associated with completion of follow-up surveys (odds ratios [OR] = 4.11 and 2.12, respectively, both P values < .001). The breadth measure of engagement was also significantly positively associated with a key study outcome, the mean increase in fruit and vegetable consumption (P < .001).By exploring participants' exposures to online interventions, paradata are valuable in explaining the effects of tailoring in increasing participant engagement in the intervention. Controlling for intervention arm, greater engagement is also associated with retention of participants and positive change in a key outcome of the intervention, dietary change. This paper demonstrates the utility of paradata capture and analysis for evaluating online health interventions.NCT00169312; http://clinicaltrials.gov/ct2/show/NCT00169312 (Archived by WebCite at http://www.webcitation.org/5u8sSr0Ty).

SUBMITTER: Couper MP

PROVIDER: S-EPMC3056524 | biostudies-literature | 2010 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Engagement and retention: measuring breadth and depth of participant use of an online intervention.

Couper Mick P MP Alexander Gwen L GL Zhang Nanhua N Little Roderick J A RJ Maddy Noel N Nowak Michael A MA McClure Jennifer B JB Calvi Josephine J JJ Rolnick Sharon J SJ Stopponi Melanie A MA Cole Johnson Christine C

Journal of medical Internet research 20101118 4

<h4>Background</h4>The Internet provides us with tools (user metrics or paradata) to evaluate how users interact with online interventions. Analysis of these paradata can lead to design improvements.<h4>Objective</h4>The objective was to explore the qualities of online participant engagement in an online intervention. We analyzed the paradata in a randomized controlled trial of alternative versions of an online intervention designed to promote consumption of fruit and vegetables.<h4>Methods</h4> ...[more]

PMID: 21087922

Similar Datasets

Project description:BackgroundMobile health (mHealth) apps are revolutionizing the way clinicians and researchers monitor and manage the health of their participants. However, many studies using mHealth apps are hampered by substantial participant dropout or attrition, which may impact the representativeness of the sample and the effectiveness of the study. Therefore, it is imperative for researchers to understand what makes participants stay with mHealth apps or studies using mHealth apps.ObjectiveThis study aimed to review the current peer-reviewed research literature to identify the notable factors and strategies used in adult participant engagement and retention.MethodsWe conducted a systematic search of PubMed, MEDLINE, and PsycINFO databases for mHealth studies that evaluated and assessed issues or strategies to improve the engagement and retention of adults from 2015 to 2020. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Notable themes were identified and narratively compared among different studies. A binomial regression model was generated to examine the factors affecting retention.ResultsOf the 389 identified studies, 62 (15.9%) were included in this review. Overall, most studies were partially successful in maintaining participant engagement. Factors related to particular elements of the app (eg, feedback, appropriate reminders, and in-app support from peers or coaches) and research strategies (eg, compensation and niche samples) that promote retention were identified. Factors that obstructed retention were also identified (eg, lack of support features, technical difficulties, and usefulness of the app). The regression model results showed that a participant is more likely to drop out than to be retained.ConclusionsRetaining participants is an omnipresent challenge in mHealth studies. The insights from this review can help inform future studies about the factors and strategies to improve participant retention.

Project description:Introduction: Research in recent years has explored the vocabulary size (lexical breadth) of bilingual children, but less is known about the richness of bilingual word knowledge (lexical depth), and about how knowledge of words in the two languages interact. This study explores how bilingual narrative intervention with vocabulary instruction in each language may modulate crosslinguistic influence (CLI) between the languages of bilingual kindergarten children, focusing on CLI of lexical knowledge, and which factors modulate performance. Methods: Forty-one typically developing English-Hebrew bilingual children (M = 64.63 months) participated. A bilingual adaptation of Story Champs narrative intervention program (Spencer and Petersen, 2012) was used to deliver vocabulary instruction in separate blocks of home language (HL) and school language (SL) sessions. Different intervention words were targeted in each language, but the children were tested on all target words in both languages. Lexical knowledge was assessed with a definition task four times throughout the study: prior to intervention, after each intervention block, and 4-6 weeks later. Learner characteristics (chronological age, age of onset of bilingualism and length of exposure) and proficiency in each language (standardized tests, familiarity with the vocabulary introduced in the intervention at baseline) were examined as possible modulators of performance. Results: Children showed growth in lexical breadth and depth in their HL/English after HL intervention and in lexical breadth in the SL/Hebrew following SL intervention, with CLI for semantic depth observed via a qualitative analysis, but not quantitatively. Better HL/English performance was correlated with later AoB (and shorter SL exposure) and higher HL language proficiency scores. Children with higher HL/English proficiency responded better to the SL/Hebrew intervention, gaining more than those with lower English proficiency. Children with SL/Hebrew vocabulary dominance at the outset of the study also gained more from the HL/English intervention. No correlations were found between learner characteristics and SL performance. Discussion: The current study indicates that bilingual narrative intervention with vocabulary instruction may be efficacious for improving the lexical breadth and depth of bilingual kindergarten children. It suggests that CLI may enhance bilingual children's language learning success, and points to the importance of strengthening both languages of bilingual children.

Dataset Information

Engagement and retention: measuring breadth and depth of participant use of an online intervention.

Publications

Engagement and retention: measuring breadth and depth of participant use of an online intervention.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets