Dataset Information

Treatment fidelity of brief motivational interviewing and health education in a randomized clinical trial to promote dental attendance of low-income mothers and children: Community-Based Intergenerational Oral Health Study "Baby Smiles".

ABSTRACT: BACKGROUND:Fidelity assessments are integral to intervention research but few published trials report these processes in detail. We included plans for fidelity monitoring in the design of a community-based intervention trial. METHODS:The study design was a randomized clinical trial of an intervention provided to low-income women to increase utilization of dental care during pregnancy (mother) or the postpartum (child) period. Group assignment followed a 2 × 2 factorial design in which participants were randomly assigned to receive either brief Motivational Interviewing (MI) or Health Education (HE) during pregnancy (prenatal) and then randomly reassigned to one of these groups for the postpartum intervention. The study setting was four county health departments in rural Oregon State, USA. Counseling was standardized using a step-by-step manual. Counselors were trained to criteria prior to delivering the intervention and fidelity monitoring continued throughout the implementation period based on audio recordings of counselor-participant sessions. The Yale Adherence and Competence Scale (YACS), modified for this study, was used to code the audio recordings of the counselors' delivery of both the MI and HE interventions. Using Interclass Correlation Coefficients totaling the occurrences of specific MI counseling behaviors, ICC for prenatal was .93, for postpartum the ICC was .75. Participants provided a second source of fidelity data. As a second source of fidelity data, the participants completed the Feedback Questionnaire that included ratings of their satisfaction with the counselors at the completion of the prenatal and post-partum interventions. RESULTS:Coding indicated counselor adherence to MI protocol and variation among counselors in the use of MI skills in the MI condition. Almost no MI behaviors were found in the HE condition. Differences in the length of time to deliver intervention were found; as expected, the HE intervention took less time. There were no differences between the overall participants' satisfaction ratings of the HE and MI sessions by individual counselor or overall (p?>?.05). CONCLUSIONS:Trial design, protocol specification, training, and continuous supervision led to a high degree of treatment fidelity for the counseling interventions in this randomized clinical trial and will increase confidence in the interpretation of the trial findings.

SUBMITTER: Weinstein P

PROVIDER: S-EPMC3996055 | biostudies-literature | 2014 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Treatment fidelity of brief motivational interviewing and health education in a randomized clinical trial to promote dental attendance of low-income mothers and children: Community-Based Intergenerational Oral Health Study "Baby Smiles".

Weinstein Philip P Milgrom Peter P Riedy Christine A CA Mancl Lloyd A LA Garson Gayle G Huebner Colleen E CE Smolen Darlene D Sutherland Marilynn M Nykamp Ann A

BMC oral health 20140224

<h4>Background</h4>Fidelity assessments are integral to intervention research but few published trials report these processes in detail. We included plans for fidelity monitoring in the design of a community-based intervention trial.<h4>Methods</h4>The study design was a randomized clinical trial of an intervention provided to low-income women to increase utilization of dental care during pregnancy (mother) or the postpartum (child) period. Group assignment followed a 2 × 2 factorial design in w ...[more]

PMID: 24559035

Similar Datasets

Project description:IntroductionSuboptimal and differential participant engagement in randomized trials-including retention at primary outcome assessments and attendance at intervention sessions-undermines rigor, internal validity, and trial conclusions.MethodsFirst, this study describes Methods-Motivational Interviewing approach and strategies for implementation. This approach engages potential participants before randomization through interactive, prerequisite orientation sessions that illustrate the scientific rationale behind trial methods in accessible language and use motivational interviewing to diffuse ambivalence about participation. Then, this study examines the potential improvements in retention (proportion of participants assessed at follow-up visits) and attendance (e.g., mean percentage of intervention sessions attended, percentage of participants who attended 0 sessions) in 3 randomized weight-management trials that quickly added prerequisite orientations to their protocols following early signs of suboptimal or differential participant engagement (Supporting Health by Integrating Nutrition and Exercise [2009-2013, n=194]; Get Social [2016-2020, n=217]; GestationaL Weight Gain and Optimal Wellness [2014-2018, n=389]). Using a pre-post analytical design, adjusted estimates from regression models controlling for condition and assessment timepoint (analyses from 2020) are reported.ResultsAfter adding prerequisite orientations, all 3 trials attained higher participant engagement. Retention at assessments was 11.4% and 17.3% higher (Get Social and Supporting Health by Integrating Nutrition and Exercise, respectively). Mean percentage of attendance at intervention sessions was 8.8% higher (GestationaL Weight Gain and Optimal Wellness), and 10.1% fewer participants attended 0 intervention sessions (Get Social). Descriptively, all the remaining retention and attendance outcomes were consistently higher but were nonsignificant. Across the trials, adding prerequisite orientations did not impact the proportion of eligible participants enrolled or the baseline demographics.ConclusionsThe Methods-Motivational Interviewing approach shows promise for increasing the rigor of randomized trials and is readily adaptable to in-person, webinar, and conference call formats.Trial registrationAll 3 trials are registered at www.clinicaltrials.gov (Supporting Health by Integrating Nutrition and Exercise: NCT00960414; Get Social: NCT02646618; and GestationaL Weight Gain and Optimal Wellness: NCT02130232).

Project description:BackgroundBehavioral interventions such as psychotherapy are leading, evidence-based practices for a variety of problems (e.g., substance abuse), but the evaluation of provider fidelity to behavioral interventions is limited by the need for human judgment. The current study evaluated the accuracy of statistical text classification in replicating human-based judgments of provider fidelity in one specific psychotherapy--motivational interviewing (MI).MethodParticipants (n?=?148) came from five previously conducted randomized trials and were either primary care patients at a safety-net hospital or university students. To be eligible for the original studies, participants met criteria for either problematic drug or alcohol use. All participants received a type of brief motivational interview, an evidence-based intervention for alcohol and substance use disorders. The Motivational Interviewing Skills Code is a standard measure of MI provider fidelity based on human ratings that was used to evaluate all therapy sessions. A text classification approach called a labeled topic model was used to learn associations between human-based fidelity ratings and MI session transcripts. It was then used to generate codes for new sessions. The primary comparison was the accuracy of model-based codes with human-based codes.ResultsReceiver operating characteristic (ROC) analyses of model-based codes showed reasonably strong sensitivity and specificity with those from human raters (range of area under ROC curve (AUC) scores: 0.62 - 0.81; average AUC: 0.72). Agreement with human raters was evaluated based on talk turns as well as code tallies for an entire session. Generated codes had higher reliability with human codes for session tallies and also varied strongly by individual code.ConclusionTo scale up the evaluation of behavioral interventions, technological solutions will be required. The current study demonstrated preliminary, encouraging findings regarding the utility of statistical text classification in bridging this methodological gap.

Project description:BACKGROUND:Motivational Interviewing (MI), Brief Advice (BA) and Health Education (HE) are established smoking cessation induction methods for smokers with low desire to quit. Although randomized controlled trials (RCT's) have been frequently used to assess these interventions the temporal efficacy and effectiveness of these interventions have been poorly elaborated. The present work endeavors to fill the gap by considering the full range of possible motivational outcomes for all of the participants. METHODS:As a two-step process, Markov Chain (MC) and Ordinary Differential Equation (ODE) models were successively employed to examine the temporal efficacy and effectiveness of these interventions by computing the gradual movements of participants from an initial stage of unmotivated smoker to stages of increased motivation to quit and cessation. Specifically, in our re-analysis of data from the RCT we examined the proportion of participants in 4 stages of readiness to quit (unmotivated, undecided, motivated, former smokers) over 6 months, across treatment groups [MI (n = 87), BA (n = 43) and HE (n = 91)]. RESULTS:Although HE had greater efficacy compared to MI and BA (i.e., the highest smoking cessation rates), it had lower effectiveness at certain time points. This was due to the fact that HE had the greatest proportion of motivated smokers who quit smoking but simultaneously a large proportion of the motivated smokers became unmotivated to quit. The effectiveness of HE dropped substantially in weeks 3-12 and remained below the effectiveness of BA from week 12 onward. The 2-year ODE model projections show that the prevalence of motivated smokers in HE group may fall below 5%. The prevalence of HE former smokers can reach an equilibrium of 26%, where the prevalence of both BA and MI former smokers exceeds this equilibrium. CONCLUSIONS:The methodology proposed in this paper strongly benefits from the capabilities of both MC and ODE modeling approaches, in the event of low observations over the time. Particularly, the temporal population sizes are first estimated by the MC model. Then they are used to parametrize the ODE model and predict future values. The methodology enabes us to determine and compare the temporal efficacy and effectiveness of smoking cessation interventions, yielding predictive and analytic insights related to temporal characteristics and capabilities of these interventions during the study period and beyond. TRIAL REGISTRATION:Testing Counseling Styles to Motivate Smokers to Quit, NCT01188018 , (July 4, 2012). This study is registered at www.clinicaltrials.gov NCT01188018.

Project description:IntroductionTreatment fidelity is an important and often neglected component of complex behaviour change research. It is central to understanding treatment effects, especially for evaluations conducted outside of highly controlled research settings. Ensuring that promising interventions can be delivered adequately (ie, with fidelity) by real-world clinicians within real-world settings is an essential step in developing interventions that are both effective and 'implementable'. Whether this is the case for behaviour change counselling, a complex intervention developed specifically for maximising the effectiveness of real-world consultations about health behaviour change, remains unclear. To improve our understanding of treatment effects, best practice guidelines recommend the use of strategies to enhance, monitor and evaluate what clinicians deliver during patient consultations. There has yet to be a systematic evaluation of whether and how these recommendations have been employed within evaluations of behaviour change counselling, nor the impact on patient health behaviour and/or outcome. We seek to address this gap.Methods and analysisMethods are informed by published guidelines. Ten electronic databases (Medline, PubMed, EMBASE, PsycINFO, CINAHL Complete, ScienceDirect, Taylor and Francis; Wiley, ProQuest and Open Grey) will be searched for published and unpublished articles that evaluate behaviour change counselling within real-world clinical settings (randomised and non-randomised). Eligible papers will be rated against the National Institute of Health fidelity framework. A synthesis, evaluation and critical overview of fidelity practices will be reported and linear regression used to explore change across time. Random-effect meta-regression is planned to explore whether fidelity (outcomes reported and methods used) is associated with the impact of behaviour change counselling. Standardised effect sizes will be calculated using Hedges' g (continuous outcomes) and ORs (binary/dichotomous outcomes).Ethics and disseminationNo ethical issues are foreseen. Findings will be disseminated via journal publication and conference presentation(s).Prospero registration numberCRD42019131169.

Project description:Current veterinary communication skills training often focuses on the strategies necessary to successfully transfer information and promote shared decision making rather than inspiring client motivation to engage in behaviour change(s). One evidence-based communication methodology with a specific focus on enhancing conversations about change is Motivational Interviewing (MI), which is perceived by veterinarians to be highly relevant to their profession. We examined whether veterinarians who experienced brief (4-5 hours) MI training (BMIT) were able to change their communication behaviours to be more MI consistent. Fourteen veterinarians recorded 31 veterinary herd health consultations before (n = 15) and after (n = 16) BMIT to allow pre-post intervention analysis of veterinarian and farmer verbal behaviour. Additionally, using a sequential linguistic analysis of 3885 veterinarian-farmer communication events within these consultations, the influence of veterinarians' verbal behaviours on farmers' response language was explored. Analysis of veterinary consultations undertaken before and after BMIT revealed that veterinarians changed their communication style to be more consistent with the MI methodology, including more use of reflection statements, a more empathic and partnership-oriented consultation style and greater emphasis on clients' own language in favour of change goals. In response, farmers contributed more to the conversation and discussed more herd health-related changes. Sequential linguistic analysis suggested that following a veterinarian emphasising something positive about the farmer (e.g. efforts, strengths), seeking collaboration or emphasising farmer choice, farmers were subsequently more likely to express arguments in favour of change ('Change Talk'), especially phrases indicative of commitment. This study offers the first evidence of the potential value of a BMIT experience to enhance veterinary communication skills, although conscious and disciplined use of MI principles, strategies and Spirit-an ethos of compassion, acceptance, partnership and evocation-requires longer and more complex training. Further studies examining the longevity and consistency of these verbal behaviour changes following BMIT are required.

Dataset Information

Treatment fidelity of brief motivational interviewing and health education in a randomized clinical trial to promote dental attendance of low-income mothers and children: Community-Based Intergenerational Oral Health Study "Baby Smiles".

Publications

Treatment fidelity of brief motivational interviewing and health education in a randomized clinical trial to promote dental attendance of low-income mothers and children: Community-Based Intergenerational Oral Health Study "Baby Smiles".

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets