Dataset Information

Assessing fidelity of delivery of smoking cessation behavioural support in practice.

ABSTRACT:

Background

Effectiveness of evidence-based behaviour change interventions is likely to be undermined by failure to deliver interventions as planned. Behavioural support for smoking cessation can be a highly cost-effective, life-saving intervention. However, in practice, outcomes are highly variable. Part of this may be due to variability in fidelity of intervention implementation. To date, there have been no published studies on this. The present study aimed to: evaluate a method for assessing fidelity of behavioural support; assess fidelity of delivery in two English Stop-Smoking Services; and compare the extent of fidelity according to session types, duration, individual practitioners, and component behaviour change techniques (BCTs).

Methods

Treatment manuals and transcripts of 34 audio-recorded behavioural support sessions were obtained from two Stop-Smoking Services and coded into component BCTs using a taxonomy of 43 BCTs. Inter-rater reliability was assessed using percentage agreement. Fidelity was assessed by examining the proportion of BCTs specified in the manuals that were delivered in individual sessions. This was assessed by session type (i.e., pre-quit, quit, post-quit), duration, individual practitioner, and BCT.

Results

Inter-coder reliability was high (87.1%). On average, 66% of manual-specified BCTs were delivered per session (SD 15.3, range: 35% to 90%). In Service 1, average fidelity was highest for post-quit sessions (69%) and lowest for pre-quit (58%). In Service 2, fidelity was highest for quit-day (81%) and lowest for post-quit sessions (56%). Session duration was not significantly correlated with fidelity. Individual practitioner fidelity ranged from 55% to 78%. Individual manual-specified BCTs were delivered on average 63% of the time (SD 28.5, range: 0 to 100%).

Conclusions

The extent to which smoking cessation behavioural support is delivered as specified in treatment manuals can be reliably assessed using transcripts of audiotaped sessions. This allows the investigation of the implementation of evidence-based practice in relation to smoking cessation, a first step in designing interventions to improve it. There are grounds for believing that fidelity in the English Stop-Smoking Services may be low and that routine monitoring is warranted.

SUBMITTER: Lorencatto F

PROVIDER: S-EPMC3622616 | biostudies-literature | 2013 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessing fidelity of delivery of smoking cessation behavioural support in practice.

Lorencatto Fabiana F West Robert R Christopherson Charlotte C Michie Susan S

Implementation science : IS 20130404

<h4>Background</h4>Effectiveness of evidence-based behaviour change interventions is likely to be undermined by failure to deliver interventions as planned. Behavioural support for smoking cessation can be a highly cost-effective, life-saving intervention. However, in practice, outcomes are highly variable. Part of this may be due to variability in fidelity of intervention implementation. To date, there have been no published studies on this. The present study aimed to: evaluate a method for ass ...[more]

PMID: 23557119

Similar Datasets

Project description:BACKGROUND AND AIMS:Behavioural support increases smoking cessation in clinical settings, but effect sizes differ among providers, due possibly to variations in delivery. This study evaluates a measure ('fidelity index') intended to capture fidelity to delivery of content- and interaction-based items of a behavioural support (BS) for smoking cessation and the association of fidelity with quit rates. METHODS:A fidelity index for scoring the adherence and quality domains of a specific BS intervention, '5As for quit', was developed by classifying the intervention components using the taxonomy of behaviour change techniques. The index was applied to code 154 BS sessions audiotaped among 18 chest clinics in Pakistan to assess their fidelity and explore reliability of coding. The association between intervention fidelity and successful quit achieved by the same providers in a previous study was explored using regression analysis. RESULTS:The index represented two domains: adherence to delivery of content-based activities of 5As (37 items) and quality of interaction-based activities (eight items). The intercoder reliability was good for content-based (average Krippendorff's ? = 0.80) and moderate for interaction-based (average Krippendorff's ? = 0.66) items. Approximately 70% (intraclass correlation coefficient: adherence scores = 0.72, quality scores = 0.71) of variation in BS delivery was contributed by providers, which increased to 97% (g-coefficient: adherence scores = 0.973, quality scores = 0.974) after accounting for other sources of variation. Higher quit rates were positively associated with average quality scores [risk ratio = 2.15; 95% confidence interval (CI) = 1.43-3.24], but negatively associated with average adherence scores (risk ratio = 0.55; 95% CI = 0.40-0.77) within services. CONCLUSIONS:The fidelity index is a reliable measure for quantifying intervention fidelity of delivering smoking cessation behavioural support. Recommended revisions of the fidelity index include incorporation of additional interaction-based items, such as the relational techniques used in motivational interviewing.

Project description:The focus on acute care, time pressure, and lack of resources hamper the delivery of smoking cessation interventions in the emergency department (ED). The aim of this study was to 1) determine the effect of an emergency nurse-initiated intervention on delivery of smoking cessation counseling based on the 5As framework (ask-advise-assess-assist-arrange) and 2) assess ED nurses' and physicians' perceptions of smoking cessation counseling.The authors conducted a pre-post trial in 789 adult smokers (five or more cigarettes/day) who presented to two EDs. The intervention focused on improving delivery of the 5As by ED nurses and physicians and included face-to-face training and an online tutorial, use of a charting/reminder tool, fax referral of motivated smokers to the state tobacco quitline for proactive telephone counseling, and group feedback to ED staff. To assess ED performance of cessation counseling, a telephone interview of subjects was conducted shortly after the ED visit. Nurses' and physicians' self-efficacy, role satisfaction, and attitudes toward smoking cessation counseling were assessed by survey. Multivariable logistic regression was used to assess the effect of the intervention on performance of the 5As, while adjusting for key covariates.Of 650 smokers who completed the post-ED interview, a greater proportion had been asked about smoking by an ED nurse (68% vs. 53%, adjusted odds ratio [OR] = 2.0, 95% confidence interval [CI] = 1.3 to 2.9), assessed for willingness to quit (31% vs. 9%, adjusted OR= 4.9, 95% CI = 2.9 to 7.9), and assisted in quitting (23% vs. 6%, adjusted OR = 5.1, 95% CI = 2.7 to 9.5) and had arrangements for follow-up cessation counseling (7% vs. 1%, adjusted OR = 7.1, 95% CI = 2.3 to 21) during the intervention compared to the baseline period. A similar increase was observed for emergency physicians (EPs). ED nurses' self-efficacy and role satisfaction in cessation counseling significantly improved following the intervention; however, there was no change in "pros" and "cons" attitudes toward smoking cessation in either ED nurses or physicians.Emergency department nurses and physicians can effectively deliver smoking cessation counseling to smokers in a time-efficient manner. This trial also provides empirical support for expert recommendations that call for nursing staff to play a larger role in delivering public health interventions in the ED.

Project description:BACKGROUND AND AIMS:A combination of behavioural and pharmacological support is judged to be the optimal approach for assisting smoking cessation. Allen Carr's Easyway (ACE) is a single-session pharmacotherapy-free programme that has been in operation internationally for 38 years. We compared the effectiveness of ACE with specialist behavioural and pharmacological support delivered to the national standard in England. DESIGN:A two-arm, parallel-group, single-blind, randomized controlled trial. SETTING:London, UK, between February 2017 and May 2018. PARTICIPANTS:A total of 620 participants (310 in ACE and 310 in the combined behavioural and pharmacological support condition) were included in the analysis. Adult (? 18 years) smokers wanting to quit were randomized in a 1 : 1 ratio. Mean age for the total sample was 40.8 years, with 53.4% being male. Participant baseline characteristics (ethnicity, educational level, number of previous quit attempts, nicotine dependence) were evenly balanced between treatment groups. INTERVENTION AND COMPARATOR:The intervention was the ACE method of stopping smoking. This centres on a 4.5-6-hour session of group-based support, alongside subsequent text messages and top-up sessions if needed. It aims to make it easy to stop smoking by convincing smokers that smoking provides no benefits for them. The comparator was a specialist stop smoking service (SSS) providing behavioural and pharmacological support in accordance with national standards. MEASUREMENTS:The primary outcome was self-reported continuous abstinence for 26 weeks from the quit/quit re-set date verified by exhaled breath carbon monoxide measurement < 10 parts per million (p.p.m.). Primary analysis was by intention to treat. Secondary outcomes were: use of pharmacotherapy, adverse events and continuous abstinence up to 4 and 12 weeks. FINDINGS:A total of 468 participants attended treatment (255 ACE versus 213 SSS, P < 0.05). Of those who did attend treatment, 100 completed 6-month measures (23.7% ACE versus 20.7% SSS). Continuous abstinence to 26 weeks was 19.4% (60 of 310) in the ACE intervention and 14.8% (46 of 310) in the SSS intervention [risk difference for ACE versus SSS 4.5% (95% confidence interval (CI) = -1.4 to 10.4%, odds ratio (OR) = 1.38)]. The Bayes factor for superiority of the ACE condition was 1.24. CONCLUSION:There was no clear evidence of a difference in the efficacies of the Allen Carr's Easyway (ACE) and specialist smoking cessation support involving behavioural support and pharmacotherapy.

Project description:BACKGROUND: Many young people report they want to stop smoking and have tried to do so, but most of their quit attempts fail. For adult smokers, there is strong evidence that group behavioural support enhances quit rates. However, it is uncertain whether group behavioural support enhances abstinence in young smokers trying to quit. FINDINGS: A cluster randomised trial for young people trying to stop smoking to compare the efficacy of a school-based 9 week intensive group behavioural support course versus a school-based 7 week brief advice only course. Participants were assessed for evidence of tobacco addiction and nicotine replacement therapy (NRT) was used if it was deemed appropriate by the therapist. Both types of course aimed to recruit approximately one hundred participants from approximately ten schools.The primary outcome was successful quitting at 4 weeks after quit day judged according to the Russell standard. Had the trial been completed, abstinence at 6 months after quit day and the relationships between successful quit attempts and 1) psychological assessments of dependence prior to quitting 2) salivary cotinine concentration prior to quitting and 3) sociodemographic characteristics would also have been assessed. The proportion of participants who stopped smoking in each arm of the trial were compared using Chi square tests.The trial was stopped shortly after it had started because funding to support the therapists running the stop smoking group behavioural support programme was withdrawn. Only three stop smoking courses were completed (two group support courses and one brief advice pharmacotherapy course). Seventeen participants in total entered the trial. At the end of the courses, one participant (10%) attending the group support programme had stopped smoking and no participant attending the brief advice programme had stopped smoking. DISCUSSION: The trial was stopped so we were unable to determine whether group support helped more young people to stop smoking than brief advice. Engagement and recruitment of participants proved much more difficult than had been anticipated. Fifteen of the seventeen participants reported that quitting smoking was either pretty important or very important to them. Thus, the stop smoking success rate could, nevertheless, be considered disappointing. TRIAL REGISTRATION: Current Controlled Trials ISRCTN25181936.

Project description:IntroductionIntervention fidelity concerns the degree to which interventions are implemented as intended. Fidelity frameworks propose fidelity is a multidimensional concept relevant at intervention designer, provider, and recipient levels; yet the extent to which it is assessed multidimensionally is unclear. Smoking cessation interventions are complex, including multiple components, often delivered over multiple sessions and/or at scale in clinical practice; this increases susceptibility variation in the fidelity with which they are delivered. This review examined the extent to which five dimensions from the Behaviour Change Consortium fidelity framework (design, training, delivery, receipt, and enactment) were assessed in fidelity assessments of smoking cessation interventions (randomised control trials (RCTs)).MethodsFive electronic databases were searched using terms "smoking cessation," "interventions," "fidelity," and "randomised control trials." Eligible studies included RCTs of smoking cessation behavioural interventions, published post 2006 after publication of the framework, reporting assessment of fidelity. The data extraction form was structured around the framework, which specifies a number of items regarding assessment and reporting of each dimension. Data extraction included study characteristics, dimensions assessed, data collection, and analysis strategies. A score per dimension was calculated, indicating its presence.Results55 studies were reviewed. There was a wide variability in data collection approaches used to assess fidelity. Fidelity of delivery was the most commonly assessed and linked to the intervention outcomes (73% of the studies). Fidelity of enactment scored the highest according to the framework (average of 92.7%), and fidelity of training scored the lowest (average of 37.1%). Only a quarter of studies linked fidelity data to outcomes (27%).ConclusionThere is wide variability in methodological and analytical approaches that precludes comparison and synthesis. In order to realise the potential of fidelity investigations to increase scientific confidence in the interpretation of observed trial outcomes, studies should include analyses of the association between fidelity data and outcomes. Findings have highlighted recommendations for improving fidelity evaluations and reporting practices.

Dataset Information

Assessing fidelity of delivery of smoking cessation behavioural support in practice.

Background

Methods

Results

Conclusions

Publications

Assessing fidelity of delivery of smoking cessation behavioural support in practice.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets