Dataset Information

The effect of program design on engagement with an internet-based smoking intervention: randomized factorial trial.

ABSTRACT: Participant engagement influences treatment effectiveness, but it is unknown which intervention design features increase treatment engagement for online smoking cessation programs.We explored the effects of 4 design features (ie, factors) on early engagement with an Internet-based, motivational smoking cessation program.Smokers (N=1865) were recruited from a large health care organization to participate in an online intervention study, regardless of their interest in quitting smoking. The program was intended to answer smokers' questions about quitting in an effort to motivate and support cessation. Consistent with the screening phase in the multiphase optimization strategy (MOST), we used a 2-level, full-factorial design. Each person was randomized to 1 of 2 levels of each factor, including message tone (prescriptive vs motivational), navigation autonomy (dictated vs not), proactive email reminders (yes vs no), and inclusion of personally tailored testimonials (yes vs no). The effects of each factor level on program engagement during the first 2 months of enrollment were compared, including number of visits to the website resulting in intervention content views (as opposed to supplemental content views), number of intervention content areas viewed, number of intervention content pages viewed, and duration of time spent viewing this content, as applicable to each factor.Adjusting for baseline readiness to quit, persons who received content written in a prescriptive tone made the same number of visits to the website as persons receiving content in a motivational tone, but viewed 1.17 times as many content areas (95% CI 1.08-1.28; P<.001) and 1.15 times as many pages (95% CI 1.04-1.28; P=.009). Time spent viewing materials did not differ among groups (P=.06). Persons required to view content in a dictated order based on their initial readiness to quit made the same number of visits as people able to freely navigate the site, but viewed fewer content areas (ratio of means 0.80, 95% CI 0.74-0.87; P<.001), 1.17 times as many pages (95% CI 1.06-1.31; P=.003), and spent 1.37 times more minutes online (95% CI 1.17-1.59; P<.001). Persons receiving proactive email reminders made 1.20 times as many visits (95% CI 1.09-1.33; P<.001), viewed a similar number of content areas as persons receiving no reminders, viewed 1.58 times as many pages (95% CI 1.48-1.68; P<.001), and spent 1.51 times as many minutes online (95% CI 1.29-1.77; P<.001) as those who did not receive proactive emails. Tailored testimonials did not significantly affect engagement.Using a prescriptive message tone, dictating content viewing order, and sending reminder emails each resulted in greater program engagement relative to the contrasting level of each experimental factor. The results require replication, but suggest that a more directive interaction style may be preferable for online cessation programs.clinicaltrials.gov NCT00992264; http://clinicaltrials.gov/ct2/show/NCT00992264 (Archived by WebCite at http://www.webcitation.org/6F7H7lr3P).

SUBMITTER: McClure JB

PROVIDER: S-EPMC3636802 | biostudies-literature | 2013 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The effect of program design on engagement with an internet-based smoking intervention: randomized factorial trial.

McClure Jennifer B JB Shortreed Susan M SM Bogart Andy A Derry Holly H Riggs Karin K St John Jackie J Nair Vijay V An Larry L

Journal of medical Internet research 20130325 3

<h4>Background</h4>Participant engagement influences treatment effectiveness, but it is unknown which intervention design features increase treatment engagement for online smoking cessation programs.<h4>Objective</h4>We explored the effects of 4 design features (ie, factors) on early engagement with an Internet-based, motivational smoking cessation program.<h4>Methods</h4>Smokers (N=1865) were recruited from a large health care organization to participate in an online intervention study, regardl ...[more]

PMID: 23529377

Similar Datasets

Project description:BACKGROUND:Smoking remains a leading cause of preventable death and illness. Internet interventions for smoking cessation have the potential to significantly impact public health, given their broad reach and proven effectiveness. Given the dose-response association between engagement and behavior change, identifying strategies to promote engagement is a priority across digital health interventions. Text messaging is a proven smoking cessation treatment modality and a powerful strategy to increase intervention engagement in other areas of health, but it has not been tested as an engagement strategy for a digital cessation intervention. OBJECTIVE:This study examined the impact of 4 experimental text message design factors on adult smokers' engagement with an internet smoking cessation program. METHODS:We conducted a 2×2×2×2 full factorial screening experiment wherein 864 participants were randomized to 1 of 16 experimental conditions after registering with a free internet smoking cessation program and enrolling in its automated text message program. Experimental factors were personalization (on/off), integration between the web and text message platforms (on/off), dynamic tailoring of intervention content based on user engagement (on/off), and message intensity (tapered vs abrupt drop-off). Primary outcomes were 3-month measures of engagement (ie, page views, time on site, and return visits to the website) as well as use of 6 interactive features of the internet program. All metrics were automatically tracked; there were no missing data. RESULTS:Main effects were detected for integration and dynamic tailoring. Integration significantly increased interactive feature use by participants, whereas dynamic tailoring increased the number of features used and page views. No main effects were found for message intensity or personalization alone, although several synergistic interactions with other experimental features were observed. Synergistic effects, when all experimental factors were active, resulted in the highest rates of interactive feature use and the greatest proportion of participants at high levels of engagement. Measured in terms of standardized mean differences (SMDs), effects on interactive feature use were highest for Build Support System (SMD 0.56; 95% CI 0.27 to 0.81), Choose Quit Smoking Aid (SMD 0.38; 95% CI 0.10 to 0.66), and Track Smoking Triggers (SMD 0.33; 95% CI 0.05 to 0.61). Among the engagement metrics, the largest effects were on overall feature utilization (SMD 0.33; 95% CI 0.06 to 0.59) and time on site (SMD 0.29; 95% CI 0.01 to 0.57). As no SMD >0.30 was observed for main effects on any outcome, results suggest that for some outcomes, the combined intervention was stronger than individual factors alone. CONCLUSIONS:This factorial experiment demonstrates the effectiveness of text messaging as a strategy to increase engagement with an internet smoking cessation intervention, resulting in greater overall intervention dose and greater exposure to the core components of tobacco dependence treatment that can promote abstinence. TRIAL REGISTRATION:ClinicalTrials.gov NCT02585206; https://clinicaltrials.gov/ct2/show/NCT02585206. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID):RR2-10.1136/bmjopen-2015-010687.

Project description:BackgroundPsychosocial, self-guided, internet-based programs are effective in treating depression and anxiety. However, the community uptake of these programs is poor. Recent approaches to increasing engagement (defined as both uptake and adherence) in internet-based programs include brief engagement facilitation interventions (EFIs). However, these programs require evaluation to assess their efficacy.ObjectiveThe aims of this hybrid implementation effectiveness trial are to examine the effects of a brief internet-based EFI presented before an internet-based cognitive behavioral therapy self-help program (myCompass 2) in improving engagement (uptake and adherence) with that program (primary aim), assess the relative efficacy of the myCompass 2 program, and determine whether greater engagement was associated with improved efficacy (greater reduction in depression or anxiety symptoms) relative to the control (secondary aim).MethodsA 3-arm randomized controlled trial (N=849; recruited via social media) assessed the independent efficacy of the EFI and myCompass 2. The myCompass 2 program was delivered with or without the EFI; both conditions were compared with an attention control condition. The EFI comprised brief (5 minutes), tailored audio-visual content on a series of click-through linear webpages.ResultsUptake was high in all groups; 82.8% (703/849) of participants clicked through the intervention following the pretest survey. However, the difference in uptake between the EFI + myCompass 2 condition (234/280, 83.6%) and the myCompass 2 alone condition (222/285, 77.9%) was not significant (n=565; χ21=29.2; P=.09). In addition, there was no significant difference in the proportion of participants who started any number of modules (1-14 modules) versus those who started none between the EFI + myCompass 2 (214/565, 37.9%) and the myCompass 2 alone (210/565, 37.2%) conditions (n=565; χ21<0.1; P=.87). Finally, there was no significant difference between the EFI + myCompass 2 and the myCompass 2 alone conditions in the number of modules started (U=39366.50; z=-0.32; P=.75) or completed (U=39494.0; z=-0.29; P=.77). The myCompass 2 program was not found to be efficacious over time for symptoms of depression (F4,349.97=1.16; P=.33) or anxiety (F4,445.99=0.12; P=.98). However, planned contrasts suggested that myCompass 2 may have been effective for participants with elevated generalized anxiety disorder symptoms (F4,332.80=3.50; P=.01).ConclusionsThis brief internet-based EFI did not increase the uptake of or adherence to an existing internet-based program for depression and anxiety. Individuals' motivation to initiate and complete internet-based self-guided interventions is complex and remains a significant challenge for self-guided interventions.Trial registrationAustralian New Zealand Clinical Trials Registry ACTRN12618001565235; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=375839.

Project description:AimsTo evaluate the effectiveness of a combined internet and text message intervention for smoking cessation compared with an internet intervention alone. The text message intervention was optimized for engagement in an earlier multiphase optimization (MOST) screening phase.DesignA parallel, two-group, individually randomized clinical trial (RCT) was conducted in a MOST confirming phase. Recruitment spanned December 2018 to March 2019. Follow-up was conducted at 3 and 9 months, beginning March 2019 and ending January 2020.SettingUnited States: a digital study conducted among new registrants on a free tobacco cessation website.ParticipantsEligible individuals were 618 adult current smokers in the United States, age 18 years or older who signed up for text messages during website registration (67.2% female, 70.4% white).InterventionsThe treatment arm (WEB+TXT; n = 311) received access to the website and text messaging. The control arm (WEB; n = 307) received access to the website alone.MeasurementsThe primary outcome was self-reported 30-day point prevalence abstinence (ppa) at 9 months post-randomization analyzed under intent to treat (ITT), counting non-responders as smoking. Secondary outcomes included 3-month measures of 30-day ppa, intervention engagement and intervention satisfaction.FindingsAbstinence rates at 9 months were 23.1% among WEB+TXT and 23.2% among WEB (OR = 1.00, 95% CI = 0.69-1.45; P = 0.99). WEB+TXT increased engagement with 5 of 6 interactive features (standardized mean difference (SMD) = 0.26-0.47, all P < 0.001) and repeat website visits (48.7% vs 38.9%, SMD = 0.14, P = 0.02). Satisfaction metrics favored WEB+TXT (satisfied: 96.3% vs 90.5%, SMD = 0.17, P = 0.008; recommend to friend: 95.9% vs 90.1%, SMD = 0.16, P = 0.028).ConclusionsA randomized controlled trial found no evidence that a combined internet and text message intervention for smoking cessation compared with an internet intervention alone increased 9-month abstinence rates among adult current smokers in the United States, despite evidence of higher levels of intervention engagement and satisfaction at 3 months.

Project description:BackgroundAdult smoking rates in the USA are highest in economically depressed rural Appalachia. Pharmacist-delivered tobacco cessation support that incorporates medication therapy management (such as the QuitAid intervention) is a promising approach to address this need.MethodsTwenty-four adult smokers recruited between September and November 2021 through an independent pharmacy in rural Appalachia were randomized in a non-blinded 2 × 2 × 2 factorial design to (1) pharmacist delivered QuitAid intervention (yes vs. no); (2) combination nicotine replacement therapy (NRT) gum + NRT patch (vs. NRT patch); and/or (3) 8 weeks of NRT (vs. standard 4 weeks). Participants received 4 weeks of NRT patch in addition to the components to which they were assigned. Participants completed baseline and 3-month follow-up assessments. Primary outcomes were feasibility of recruitment and randomization, retention, treatment adherence, and fidelity.ResultsParticipants were recruited in 7 weeks primarily through a referral process, commonly referred to as ask-advise-connect (61%). Participants were on average 52.4 years old, 29.2% were male and the majority were white (91.6%) and Non-Hispanic (91.7%). There was a high level of adherence to the interventions, with 85% of QuitAid sessions completed, 83.3% of the patch used, and 54.5% of gum used. Participants reported a high level of satisfaction with the program, and there was a high level of retention (92%).ConclusionsThis demonstration pilot randomized controlled study indicates that an ask-advise-connect model for connecting rural smokers to smoking cessation support and providing QuitAid for smoking cessation is feasible and acceptable among rural Appalachian smokers and independent pharmacists. Further investigation into the efficacy of a pharmacist-delivered approach for smoking cessation is needed.Trial registrationThe trial was retrospectively registered at ClinicalTrials.gov. Trial #: NCT05649241.

Project description:While internet-delivered cognitive behavioural therapy (ICBT) is effective, some patients suggest extended support post-treatment could improve care. In this randomized factorial trial, we examined the benefits of an 8-week therapist-assisted ICBT program offered with or without an optional 4-week extension of support (Factor 1) and with or without an optional booster lesson (Factor 2). Patients screened for ICBT for depression and/or anxiety were randomly assigned to the conditions (N = 434) and we examined the use of the extension and booster, differences between those who did or did not use extension or booster, and the impact of the extension or booster on outcomes, engagement, and satisfaction at 26-weeks post-enrollment. Therapists recorded time and observations with offering support during the extension and booster. In the extension group, 54.4% (n = 56) requested the extension, while in the booster group 50.9% (n = 56) accessed the booster, and in the combined group, 41.6% (n = 47) requested the extension and 51.3% (n = 58) accessed the booster. Those who requested the extension were older, and more likely to report medication and mental health service use and severe mental health-related disability at pre-treatment; they also reported putting less effort into ICBT and finding skills more difficult. The booster was more often used among those with lower symptom severity, and those who put more effort into and had more positive experiences with ICBT. As expected, those assigned to extension sent more messages to their therapist, and those assigned to booster logged in more often. Therapists also took more time to deliver ICBT with an extension (>18 min) or booster (>13 min) compared to the 8-week program, and perceived extension and booster as beneficial for some, but not all patients. Treatment satisfaction was high across conditions, and effect sizes were large from pre-treatment to 26-week follow-up on most measures. No significant group differences were found in this study. Lack of group differences, however, could reflect low use of the extension and booster. Results provide helpful information about the demand for extensions and boosters, and provide directions for future research.

Dataset Information

The effect of program design on engagement with an internet-based smoking intervention: randomized factorial trial.

Publications

The effect of program design on engagement with an internet-based smoking intervention: randomized factorial trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets