Dataset Information

Immediate versus sustained effects: interrupted time series analysis of a tailored intervention.

ABSTRACT:

Background

Detailed intervention descriptions and robust evaluations that test intervention impact--and explore reasons for impact--are an essential part of progressing implementation science. Time series designs enable the impact and sustainability of intervention effects to be tested. When combined with time series designs, qualitative methods can provide insight into intervention effectiveness and help identify areas for improvement for future interventions. This paper describes the development, delivery, and evaluation of a tailored intervention designed to increase primary health care professionals' adoption of a national recommendation that women with mild to moderate postnatal depression (PND) are referred for psychological therapy as a first stage treatment.

Methods

Three factors influencing referral for psychological treatment were targeted using three related intervention components: a tailored educational meeting, a tailored educational leaflet, and changes to an electronic system data template used by health professionals during consultations for PND. Evaluation comprised time series analysis of monthly audit data on percentage referral rates and monthly first prescription rates for anti-depressants. Interviews were conducted with a sample of health professionals to explore their perceptions of the intervention components and to identify possible factors influencing intervention effectiveness.

Results

The intervention was associated with a significant, immediate, positive effect upon percentage referral rates for psychological treatments. This effect was not sustained over the ten month follow-on period. Monthly rates of anti-depressant prescriptions remained consistently high after the intervention. Qualitative interview findings suggest key messages received from the intervention concerned what appropriate antidepressant prescribing is, suggesting this to underlie the lack of impact upon prescribing rates. However, an understanding that psychological treatment can have long-term benefits was also cited. Barriers to referral identified before intervention were cited again after the intervention, suggesting the intervention had not successfully tackled the barriers targeted.

Conclusion

A time series design allowed the initial and sustained impact of our intervention to be tested. Combined with qualitative interviews, this provided insight into intervention effectiveness. Future research should test factors influencing intervention sustainability, and promote adoption of the targeted behavior and dis-adoption of competing behaviors where appropriate.

SUBMITTER: Hanbury A

PROVIDER: S-EPMC4228338 | biostudies-literature | 2013 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Immediate versus sustained effects: interrupted time series analysis of a tailored intervention.

Hanbury Andria A Farley Katherine K Thompson Carl C Wilson Paul M PM Chambers Duncan D Holmes Heather H

Implementation science : IS 20131105

<h4>Background</h4>Detailed intervention descriptions and robust evaluations that test intervention impact--and explore reasons for impact--are an essential part of progressing implementation science. Time series designs enable the impact and sustainability of intervention effects to be tested. When combined with time series designs, qualitative methods can provide insight into intervention effectiveness and help identify areas for improvement for future interventions. This paper describes the d ...[more]

PMID: 24188718

Similar Datasets

Project description:BACKGROUND:As part of a partnership between the Institute for Healthcare Improvement and the Ethiopian Federal Ministry of Health, woreda-based quality improvement collaboratives took place between November 2016 and December 2017 aiming to accelerate reduction of maternal and neonatal mortality in Lemu Bilbilu, Tanqua Abergele and Duguna Fango woredas. Before starting the collaboratives, assessments found inaccuracies in core measures obtained from Health Management Information System reports. METHODS AND RESULTS:Building on the quality improvement collaborative design, data quality improvement activities were added and we used the World Health Organization review methodology to drive a verification factor for the core measures of number of pregnant women that received their first antenatal care visit, number of pregnant women that received antenatal care on at least four visits, number of pregnant women tested for syphilis and number of births attended by skilled health personnel. Impact of the data quality improvement was assessed using interrupted time series analysis. We found accurate data across all time periods for Tanqua Abergele. In Lemu Bilbilu and Duguna Fango, data quality improved for all core metrics over time. In Duguna Fango, the verification factor for number of pregnant women that received their first antenatal care visit improved from 0.794 (95%CI 0.753, 0.836; p<0.001) pre-intervention by 0.173 (95%CI 0.128, 0.219; p<0.001) during the collaborative; and the verification factor for number of pregnant women tested for syphilis improved from 0.472 (95%CI 0.390, 0.554; p<0.001) pre-intervention by 0.460 (95%CI 0.369, 0.552; p<0.001) during the collaborative. In Lemu Bilbilu, the verification factor for number of pregnant women receiving a fourth antenatal visit rose from 0.589 (95%CI 0.513, 0.664; p<0.001) at baseline by 0.358 (95%CI 0.258, 0.458; p<0.001) post-intervention; and skilled birth attendance rose from 0.917 (95%CI 0.869, 0.965) at baseline by 0.083 (95%CI 0.030, 0.136; p<0.001) during the collaborative. CONCLUSIONS:A Data quality improvement initiative embedded within woreda clinical improvement collaborative improved accuracy of data used to monitor maternal and newborn health services in Ethiopia.

Project description:BackgroundThe purpose of our study was to evaluate the effects of a new reimbursement rule for antihypertensive medication that made thiazides mandatory first-line drugs for newly treated, uncomplicated hypertension. The objective of the new regulation was to reduce drug expenditures.Methods and findingsWe conducted an interrupted time-series analysis on prescribing data before and after the new reimbursement rule for antihypertensive medication was put into effect. All patients started on antihypertensive medication in 61 general practices in Norway were included in the analysis. The new rule was put forward by the Ministry of Health and was approved by parliament. Adherence to the rule was monitored only minimally, and there were no penalties for non-adherence. Our primary outcome was the proportion of thiazide prescriptions among all prescriptions made for persons started on antihypertensive medication. Secondary outcomes included the proportion of patients who, within 4 mo, reached recommended blood-pressure goals and the proportion of patients who, within 4 mo, were not started on a second antihypertensive drug. We also compared drug costs before and after the intervention. During the baseline period, 10% of patients started on antihypertensive medication were given a thiazide prescription. This proportion rose steadily during the transition period, after which it remained stable at 25%. For other outcomes, no statistically significant differences were demonstrated. Achievement of treatment goals was slightly higher (56.6% versus 58.4%) after the new rule was introduced, and the prescribing of a second drug was slightly lower (24.0% versus 21.8%). Drug costs were reduced by an estimated Norwegian kroner 4.8 million (0.58 million Euros, US$0.72 million) in the first year, which is equivalent to Norwegian kroner 1.06 per inhabitant (0.13 Euros, US$0.16).ConclusionsPrescribing of thiazides in Norway for uncomplicated hypertension more than doubled after a reimbursement rule requiring the use of thiazides as the first-choice therapy was put into effect. However, the resulting savings on drug expenditures were modest. There were no significant changes in the achievement of treatment goals or in the prescribing of a second antihypertensive drug.

Project description:BackgroundIn uncontrolled before-after studies, CONSORT was shown to improve the reporting of randomised trials. Before-after studies ignore underlying secular trends and may overestimate the impact of interventions. Our aim was to assess the impact of the 2007 STROBE statement publication on the quality of observational study reporting, using both uncontrolled before-after analyses and interrupted time series.MethodsFor this quasi-experimental study, original articles reporting cohort, case-control, and cross-sectional studies published between 2004 and 2010 in the four dermatological journals having the highest 5-year impact factors (? 4) were selected. We compared the proportions of STROBE items (STROBE score) adequately reported in each article during three periods, two pre STROBE period (2004-2005 and 2006-2007) and one post STROBE period (2008-2010). Segmented regression analysis of interrupted time series was also performed.ResultsOf the 456 included articles, 187 (41%) reported cohort studies, 166 (36.4%) cross-sectional studies, and 103 (22.6%) case-control studies. The median STROBE score was 57% (range, 18%-98%). Before-after analysis evidenced significant STROBE score increases between the two pre-STROBE periods and between the earliest pre-STROBE period and the post-STROBE period (median score2004-05 48% versus median score2008-10 58%, p<0.001) but not between the immediate pre-STROBE period and the post-STROBE period (median score2006-07 58% versus median score2008-10 58%, p?=?0.42). In the pre STROBE period, the six-monthly mean STROBE score increased significantly, by 1.19% per six-month period (absolute increase 95%CI, 0.26% to 2.11%, p?=?0.016). By segmented analysis, no significant changes in STROBE score trends occurred (-0.40%; 95%CI, -2.20 to 1.41; p?=?0.64) in the post STROBE statement publication.InterpretationThe quality of reports increased over time but was not affected by STROBE. Our findings raise concerns about the relevance of uncontrolled before-after analysis for estimating the impact of guidelines.

Project description:BackgroundVerbal rating scales (VRS) are widely used in patient-reported outcome (PRO) measures. At our institution, patients complete an online instrument using VRSs with a five-point brief response scale to assess symptoms as part of routine follow-up after ambulatory cancer surgery. We received feedback from patients that the brief VRS descriptors such as "mild" or "somewhat" were vague. We added explicit descriptors to our VRSs, for instance, "Mild: I can generally ignore my pain" for pain severity or "Somewhat: I can do some things okay, but most of my daily activities are harder because of fatigue" for fatigue interference. We then compared responses before and after this change was made.MethodsThe symptoms investigated were pain, fatigue and nausea. Our hypothesis was that the explicit descriptors would reduce overall variance. We therefore compared the coefficient of variation of scores and tested the association between symptoms scores and known predictors thereof. We also compared time to completion between questionnaires with and without the additional descriptors.ResultsA total of 17,500 patients undergoing 21,497 operations were assigned questionnaires in the period before the descriptors were added; allowing for a short transition period, 1,417 patients having 1436 operations were assigned questionnaires with the additional descriptors. Symptom scores were about 10% lower with the additional descriptors but the coefficient of variation was slightly higher. Moreover, the only statistically significant difference between groups for association with a known predictor favored the item without the additional language for nausea severity (p = 0.004). Total completion time was longer when the instrument included the additional descriptors, particularly the first and second time that the questionnaire was completed.ConclusionsAdding descriptors to a VRS of post-operative symptoms did not improve scale properties in patients undergoing ambulatory cancer surgery. We have removed the additional descriptors from our tool. We recommend further comparative psychometric research using data from PROs collected as part of routine clinical care.

Project description:BackgroundDespite improvement, sepsis mortality rates remain high, with an estimated 11 million sepsis-related deaths globally in 2017 (Rudd et. al, Lancet 395:200-211, 2020). Low- and middle-income countries (LMICs) are estimated to account for 85% of global sepsis mortality; however, evidence for improved sepsis mortality in LMICs is lacking. We aimed to improve sepsis care and outcomes through development and evaluation of a sepsis treatment protocol tailored to the Tikur Anbessa Specialized Hospital Emergency Department, Ethiopia, context.MethodsWe employed a mixed methods design, including an interrupted times series study, pre-post knowledge testing, and process evaluation. The primary outcome was the proportion of patients receiving appropriate sepsis care (blood culture collection before antibiotics and initiation of appropriate antibiotics within 1 h of assessment). Secondary outcomes included time to antibiotic administration, 72-h sepsis mortality, and 90-day all-cause mortality. Due to poor documentation, we were unable to assess our primary outcome and time to antibiotic administration. We used segmented regression with outcomes as binomial proportions to assess the impact of the intervention on mortality. Pre-post knowledge test scores were analyzed using the Student's t-test to compare group means for percentage of scenarios with correct diagnosis.ResultsA total of 113 and 300 patients were enrolled in the pre-implementation and post-implementation phases respectively. While age and gender were similar across the phases, a higher proportion (31 vs. 57%) of patients had malignancies in the post-implementation phase. We found a significant change in trend between the phases, with a trend for increasing odds of survival in the pre-implementation phase (OR 1.24, 95% CI 0.98-1.56), and a shift down, with odds of survival virtually flat (OR 0.95, 95% CI. 0.88-1.03) in the post-implementation phases for 72-h mortality, and trends for survival pre- and post-implementation are virtually flat for 90-day mortality. We found no significant difference in pre-post knowledge test scores, with interpretation limited by response rate. Implementation quality was negatively impacted by resource challenges.ConclusionWe found no improvement in sepsis outcomes, with a trend for increasing odds of survival lost post-implementation and no significant change in knowledge pre- and post-implementation. Variable availability of resources was the principal barrier to implementation.Trial registrationOpen Science Framework osf.io/ju4ga . Registered June 28, 2017.

Dataset Information

Immediate versus sustained effects: interrupted time series analysis of a tailored intervention.

Background

Methods

Results

Conclusion

Publications

Immediate versus sustained effects: interrupted time series analysis of a tailored intervention.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets