Dataset Information

Measuring fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention.

ABSTRACT:

Background

Interpreting data about intervention effectiveness requires an understanding of which intervention components were delivered and whether they were delivered as planned (fidelity of delivery). These studies aimed to develop a reliable measure for assessing fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention (COTiD-UK) (Study 1) and measure fidelity of delivery of COTiD-UK across sessions, sites and occupational therapists (Study 2).

Methods

The studies used a longitudinal observational design nested within a multi-site randomised controlled trial. Where practicable, all intervention sessions were audio-recorded. Fidelity checklists and coding guidelines were developed, piloted and refined until good agreement was achieved between two coders. Ten percent of sessions were purposively sampled from 12 sites and 31 occupational therapists. Transcripts were coded using checklists developed in Study 1; 10% of sets of intervention session transcripts were double coded to ensure that agreement was maintained. Percentages of components that were delivered were calculated for each session, site and occupational therapist.

Results

A reliable measure of fidelity of delivery for COTiD-UK was developed after several rounds of piloting and amendments. COTiD-UK was delivered with moderate fidelity across all six sessions (range: 52.4-75.5%). The mean range of fidelity varied across sites (26.7-91.2%) and occupational therapists (26.7-94.1%).

Conclusions

A reliable, systematic method for measuring fidelity of delivery of COTiD-UK was developed and applied, and can be adapted for use in similar interventions. As COTiD-UK was delivered with moderate fidelity, there is a reasonable degree of confidence that intervention effects were attributable to COTiD-UK.

SUBMITTER: Walton H

PROVIDER: S-EPMC6929510 | biostudies-literature | 2019 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention.

Walton Holly H Tombor Ildiko I Burgess Jane J Groarke Hilary H Swinson Tom T Wenborn Jennifer J Spector Aimee A Orrell Martin M Mountain Gail G Michie Susan S

BMC geriatrics 20191223 1

<h4>Background</h4>Interpreting data about intervention effectiveness requires an understanding of which intervention components were delivered and whether they were delivered as planned (fidelity of delivery). These studies aimed to develop a reliable measure for assessing fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention (COTiD-UK) (Study 1) and measure fidelity of delivery of COTiD-UK across sessions, sites and occupational therapists (Study 2).<h4>Methods ...[more]

PMID: 31870306

Similar Datasets

Project description:BACKGROUND: A multifaceted implementation (MFI) strategy was used to implement an evidence-based occupational therapy program for people with dementia (COTiD program). This strategy was successful in increasing the number of referrals, but not in improving occupational therapists' (OTs) adherence. Therefore, a process evaluation was conducted to identify factors that influenced the effectiveness of the MFI strategy. METHODS: A mixed-method approach of qualitative and quantitative research was used to evaluate the implementation process. The MFI strategy as planned and as executed were reported and evaluated based on the framework of Hulscher et al. (2003; 2006). Data on OTs attitudes and expected barriers were collected at baseline from 94 OTs using a 19-item questionnaire. Data on the experiences were collected after finishing the implementation using focus groups with OTs and telephone interviews with physicians and managers. For quantitative data, frequencies and correlations were calculated and qualitative data were analyzed using inductive content analysis. RESULTS: The implementation strategy as executed had a stronger focus than planned on increasing OTs promotional skills due to an initial lack of referrals. This resulted in less attention for increasing OTs' skills in using the COTiD program as initially intended. At baseline, OTs had a positive attitude toward the program, however, 75% did not feel experienced enough and only 14.3% felt competent in using the program. Focus groups and interviews revealed various determinants that influenced implementation. Most managers were positive about the program. However, the degree of operational support of managers for OTs regarding the implementation was not always adequate. Managers stated that a well-defined place for occupational therapy within the dementia care network was lacking although this was perceived necessary for successful implementation. Several physicians perceived psychosocial interventions not to be in their area of expertise or not their responsibility. All professionals perceived inter-professional collaboration to be a facilitator for effective implementation, and general practitioners were perceived as key partners in this collaboration. However, collaboration was not always optimal. OTs indicated that increasing the referral rate was most effective when promoting OT via other disciplines within a physician's network. CONCLUSION: Our data suggests that a first step in successful implementation should be to make sure that individual and organizational barriers are resolved. In addition, implementation should be network-based and encourage inter-professional collaboration. Initial promotion of COTiD should focus on physicians that have a positive attitude toward non-pharmacological interventions.

Project description:BackgroundWe aimed to estimate the clinical effectiveness of Community Occupational Therapy for people with dementia and family carers-UK version (Community Occupational Therapy in Dementia-UK version [COTiD-UK]) relative to treatment as usual (TAU). We hypothesised that COTiD-UK would improve the ability of people with dementia to perform activities of daily living (ADL), and family carers' sense of competence, compared with TAU.Methods and findingsThe study design was a multicentre, 2-arm, parallel-group, assessor-masked, individually randomised controlled trial (RCT) with internal pilot. It was conducted in 15 sites across England from September 2014 to January 2018. People with a diagnosis of mild to moderate dementia living in their own home were recruited in pairs with a family carer who provided domestic or personal support for at least 4 hours per week. Pairs were randomised to either receive COTiD-UK, which comprised 10 hours of occupational therapy delivered over 10 weeks in the person with dementia's home or TAU, which comprised the usual local service provision that may or may not include standard occupational therapy. The primary outcome was the Bristol Activities of Daily Living Scale (BADLS) score at 26 weeks. Secondary outcomes for the person with dementia included the following: the BADLS scores at 52 and 78 weeks, cognition, quality of life, and mood; and for the family carer: sense of competence and mood; plus the number of social contacts and leisure activities for both partners. Participants were analysed by treatment allocated. A total of 468 pairs were recruited: people with dementia ranged from 55 to 97 years with a mean age of 78.6 and family carers ranged from 29 to 94 with a mean of 69.1 years. Of the people with dementia, 74.8% were married and 19.2% lived alone. Of the family carers, 72.6% were spouses, and 22.2% were adult children. On randomisation, 249 pairs were assigned to COTiD-UK (62% people with dementia and 23% carers were male) and 219 to TAU (52% people with dementia and 32% carers were male). At the 26 weeks follow-up, data were available for 364 pairs (77.8%). The BADLS score at 26 weeks did not differ significantly between groups (adjusted mean difference estimate 0.35, 95% CI -0.81 to 1.51; p = 0.55). Secondary outcomes did not differ between the groups. In total, 91% of the activity-based goals set by the pairs taking part in the COTiD-UK intervention were fully or partially achieved by the final COTiD-UK session. Study limitations include the following: Intervention fidelity was moderate but varied across and within sites, and the reliance on primarily proxy data focused on measuring the level of functional or cognitive impairment which may not truly reflect the actual performance and views of the person living with dementia.ConclusionsProviding community occupational therapy as delivered in this study did not improve ADL performance, cognition, quality of life, or mood in people with dementia nor sense of competence or mood in family carers. Future research should consider measuring person-centred outcomes that are more meaningful and closely aligned to participants' priorities, such as goal achievement or the quantity and quality of activity engagement and participation.Trial registrationCurrent Controlled Trials ISRCTN10748953.

Project description:ObjectiveTo determine the effectiveness of community based occupational therapy on daily functioning of patients with dementia and the sense of competence of their care givers.DesignSingle blind randomised controlled trial. Assessors were blinded for treatment allocation.SettingMemory clinic and day clinic of a geriatrics department and participants' homes.Participants135 patients aged > or =65 with mild to moderate dementia living in the community and their primary care givers.Interventions10 sessions of occupational therapy over five weeks, including cognitive and behavioural interventions, to train patients in the use of aids to compensate for cognitive decline and care givers in coping behaviours and supervision.Main outcome measuresPatients' daily functioning assessed with the assessment of motor and process skills (AMPS) and the performance scale of the interview of deterioration in daily activities in dementia (IDDD). Care giver burden assessed with the sense of competence questionnaire (SCQ). Participants were evaluated at baseline, six weeks, and three months.ResultsScores improved significantly relative to baseline in patients and care givers in the intervention group compared with the controls (differences were 1.5 (95% confidence interval 1.3 to 1.7) for the process scale; -11.7 (-13.6 to -9.7) for the performance scale; and (11.0; 9.2 to 12.8) for the competence scale). This improvement was still significant at three months. The number needed to treat to reach a clinically relevant improvement in motor and process skills score was 1.3 (1.2 to 1.4) at six weeks. Effect sizes were 2.5, 2.3, and 1.2, respectively, at six weeks and 2.7, 2.4, and 0.8, respectively, at 12 weeks.ConclusionsOccupational therapy improved patients' daily functioning and reduced the burden on the care giver, despite the patients' limited learning ability. Effects were still present at 12 weeks, which justifies implementation of this intervention.Trial registrationClinical Trials NCT00295152 [ClinicalTrials.gov].

Project description:BackgroundUnderstanding intervention delivery as intended, particularly in complex interventions, should be underpinned by good quality fidelity assessment. We present the findings from a fidelity assessment embedded as part of a trial of a complex community-based psychosocial intervention, Journeying through Dementia (JtD). The intervention was designed to equip individuals with the knowledge and skills to successfully self-manage, maintain independence, and live well with dementia and involves both group and individual sessions. The methodological challenges of developing a conceptual framework for fidelity assessment and creating and applying purposely designed measures derived from this framework are discussed to inform future studies.MethodsA conceptual fidelity framework was created out of core components of the intervention (including the intervention manual and training for delivery), associated trial protocols and pre-defined fidelity standards and criteria against which intervention delivery and receipt could be measured. Fidelity data collection tools were designed and piloted for reliability and usability. Data collection in four selected sites (fidelity sites) was via non-participatory observations of the group aspect of the intervention, attendance registers and interventionist (facilitator and supervisor) self-report.ResultsInterventionists from all four fidelity sites attended intervention training. The majority of group participants at the four sites (71%) received the therapeutic dose of 10 out of 16 sessions. Weekly group meeting attendance (including at 'out of venue' sessions) was excellent at 80%. Additionally, all but one individual session was attended by the participants who completed the intervention. It proved feasible to create tools derived from the fidelity framework to assess in-venue group aspects of this complex intervention. Results of fidelity assessment of the observed groups were good with substantial inter-rater reliability between researchers KAPPA 0.68 95% CI (0.58-0.78). Self-report by interventionists concurred with researcher assessments.ConclusionsThere was good fidelity to training and delivery of the group aspect of the intervention at four sites. However, the methodological challenges of assessing all aspects of this complex intervention could not be overcome due to practicalities, assessment methods and ethical considerations. Questions remain regarding how we can assess fidelity in community-based complex interventions without impacting upon intervention or trial delivery.Trial registrationISRCTN17993825 .

Project description:Group-based psychosocial therapy, such as group Cognitive Stimulation Therapy, improves cognition and quality of life in people living with dementia. Neuropsychiatric symptoms and restricted mobility are common complications for people with Parkinson's-related dementia (PRD) and may limit access to, and participation in, group activities. This study describes the development of a condition-specific, home-based psychosocial therapy for people with PRD ready to be trialled in a clinical population.By means of a multistage process, a draft therapy manual was developed in an iterative manner through collaboration with medical experts, researchers and Patient and Public Involvement (PPI) representatives. In stage 1, an extensive literature search of psychosocial therapies for dementia with potential relevance for Parkinson's disease (PD) was undertaken to select a candidate therapy for adaptation. In stage 2, qualitative feedback from stakeholders and intelligence regarding existing nonpharmacological therapies for cognitive impairment in PD was combined to produce a prototype therapy manual. In stage 3, the manual was field tested in: 1) a home-setting using a 25-item assessment tool; and 2) at a local PD support group with PPI representatives. Based on the feedback from this phase, final design modifications were implemented and a draft therapy manual produced.The manual was developed in an iterative manner. Interview and focus group transcripts identified three enduring themes: manual form and content, therapy acceptability by people with PRD, and companion guidance and support. Major adaptations included: removal of discrete levels of task complexity, removal of images that were potentially hallucinogenic or lacked clarity, and updating of the content.We have successfully developed a Cognitive Stimulation Therapy-based psychosocial therapy specifically adapted for people with PRD. The therapy is ready to trial in a pilot randomized controlled study.

Project description:IntroductionTobacco smoking among tuberculosis (TB) patients leads to poorer treatment outcomes. Smoking cessation support should be integrated into routine TB care. We measured healthcare providers' fidelity to a smoking cessation intervention integrated into routine TB care, in Bangladesh and Pakistan. We aimed to understand the role of providers and settings in the implementation of behavior support (BS) messages for TB and smoking cessation.MethodsThe integrated BS intervention was implemented in TB clinics (24 public and 1 private). Cross-sectional data were collected on the fidelity of delivery of the BS intervention using a predefined fidelity index based on an existing validated method of measuring intervention fidelity. Audio-recordings of patient-provider BS sessions were coded using the fidelity index. Intervention fidelity was presented as the proportion of sessions that implemented BS messages.ResultsA total of 96 sessions were conducted, 37 in Bangladesh and 59 in Pakistan. In public settings, TB medication advice was offered in 91.9% (95% CI: 78.7- 97.2) of sessions in Bangladesh, and in 75.5% (95% CI: 62.4-85.1) of sessions in Pakistan; whilst it was offered in 83.3% (95% CI: 43.7-97.0) of sessions in the private setting in Pakistan. Patients' smoking status was assessed in 70.3% (95% CI: 54.2-82.5) of sessions in Bangladesh, and in 34.0% (95% CI: 22.7-47.4) of sessions in the public setting and in 66.7% (95% CI: 30.0-90.3) of sessions in the private setting in Pakistan. A quit date was set in 32.4% (95% CI: 19.6-48.5) of all sessions in Bangladesh, and in 33.3% (95% CI: 9.6-70.0) of all sessions in the public setting in Pakistan.ConclusionsFidelity to the intended delivery of the intervention was found to be high for TB-related messages but not for smoking cessation messages. Clinic contexts may play a mediating role in health workers' opportunities to deliver the intervention as planned.Trial registrationInternational Standard Randomized Clinical Trial Number (ISRCTN43811467). Registered 23 March 2016, https://doi.org/10.1186/ISRCTN43811467.

Dataset Information

Measuring fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention.

Background

Methods

Results

Conclusions

Publications

Measuring fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets