Dataset Information

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

ABSTRACT:

Background

Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured.

Methods

This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST) drug prevention program with fidelity. Regression analysis was used to examine factors influencing four dimensions of fidelity: adherence, dosage, quality of delivery, and student responsiveness.

Results

Although most sites faced common barriers, such as finding room in the school schedule for the program, gaining full support from key participants (i.e., site coordinators, principals, and LST teachers), ensuring teacher participation in training workshops, and classroom management difficulties, most schools involved in the project implemented LST with very high levels of fidelity. Across sites, 86% of program objectives and activities required in the three-year curriculum were delivered to students. Moreover, teachers were observed using all four recommended teaching practices, and 71% of instructors taught all the required LST lessons. Multivariate analyses found that highly rated LST program characteristics and better student behavior were significantly related to a greater proportion of material taught by teachers (adherence). Instructors who rated the LST program characteristics as ideal were more likely to teach all lessons (dosage). Student behavior and use of interactive teaching techniques (quality of delivery) were positively related. No variables were related to student participation (student responsiveness).

Conclusion

Although difficult, high implementation fidelity by community-based organizations can be achieved. This study suggests some important factors that organizations should consider to ensure fidelity, such as selecting programs with features that minimize complexity while maximizing flexibility. Time constraints in the classroom should be considered when choosing a program. Student behavior also influences program delivery, so schools should train teachers in the use of classroom management skills. This project involved comprehensive program monitoring and technical assistance that likely facilitated the identification and resolution of problems and contributed to the overall high quality of implementation. Schools should recognize the importance of training and technical assistance to ensure quality program delivery.

SUBMITTER: Mihalic SF

PROVIDER: S-EPMC2265741 | biostudies-literature | 2008 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

Mihalic Sharon F SF Fagan Abigail A AA Argamaso Susanne S

Implementation science : IS 20080118

<h4>Background</h4>Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured.<h4>Methods</h4>This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST) drug preven ...[more]

PMID: 18205919

Similar Datasets

Project description:BackgroundFalls are a common, costly global public health burden. In hospitals, multifactorial fall prevention programs have proved effective in reducing falls' incidence; however, translating those programs accurately into daily clinical practice remains challenging. This study's aim was to identify ward-level system factors associated with implementation fidelity to a multifactorial fall prevention program (StuPA) targeting hospitalized adult patients in an acute care setting.MethodsThis retrospective cross-sectional study used administrative data on 11,827 patients admitted between July and December 2019 to 19 acute care wards at the University Hospital Basel, Switzerland, as well as data on the StuPA implementation evaluation survey conducted in April 2019. Data were analysed using descriptive statistics, Pearson's coefficients and linear regression modelling for variables of interest.ResultsThe patient sample had an average age of 68 years and a median length of stay of 8.4 (IQR: 2.1) days. The mean care dependency score was 35.4 points (ePA-AC scale: from 10 points (totally dependent) to 40 points (totally independent)); the mean number of transfers per patient -(e.g., change of room, admission, discharge) was 2.6 (range: 2.4- 2.8). Overall, 336 patients (2.8%) experienced at least one fall, resulting in a rate of 5.1 falls per 1'000 patient days. The median inter-ward StuPA implementation fidelity was 80.6% (range: 63.9-91.7%). We found the mean number of inpatient transfers during hospitalisation and the mean ward-level patient care dependency to be statistically significant predictors of StuPA implementation fidelity.ConclusionWards with higher care dependency and patient transfer levels showed higher implementation fidelity to the fall prevention program. Therefore, we assume that patients with the highest fall prevention needs received greater exposure to the program. For the StuPA fall prevention program, our results suggest a need for implementation strategies contextually adapted to the specific characteristics of the target wards and patients.

Project description:BackgroundWhen tested in a randomized controlled trial (RCT) of 31,411 patients, the nurse-led 6-PACK falls prevention program did not reduce falls. Poor implementation fidelity (i.e., program not implemented as intended) may explain this result. Despite repeated calls for the examination of implementation fidelity as an essential component of evaluating interventions designed to improve the delivery of care, it has been neglected in prior falls prevention studies. This study examined implementation fidelity of the 6-PACK program during a large multi-site RCT.MethodsBased on the 6-PACK implementation framework and intervention description, implementation fidelity was examined by quantifying adherence to program components and organizational support. Adherence indicators were: 1) falls-risk tool completion; and for patients classified as high-risk, provision of 2) a 'Falls alert' sign; and 3) at least one additional 6-PACK intervention. Organizational support indicators were: 1) provision of resources (executive sponsorship, site clinical leaders and equipment); 2) implementation activities (modification of patient care plans; training; implementation tailoring; audits, reminders and feedback; and provision of data); and 3) program acceptability. Data were collected from daily bedside observation, medical records, resource utilization diaries and nurse surveys.ResultsAll seven intervention components were delivered on the 12 intervention wards. Program adherence data were collected from 103,398 observations and medical record audits. The falls-risk tool was completed each day for 75% of patients. Of the 38% of patients classified as high-risk, 79% had a 'Falls alert' sign and 63% were provided with at least one additional 6-PACK intervention, as recommended. All hospitals provided the recommended resources and undertook the nine outlined program implementation activities. Most of the nurses surveyed considered program components important for falls prevention.ConclusionsWhile implementation fidelity was variable across wards, overall it was found to be acceptable during the RCT. Implementation failure is unlikely to be a key factor for the observed lack of program effectiveness in the 6-PACK trial.Trial registrationThe 6-PACK cluster RCT is registered with the Australian New Zealand Clinical Trials Registry, number ACTRN12611000332921 (29 March 2011).

Project description:BackgroundUntil now, there is no clear overview of how fidelity is assessed in school-based obesity prevention programmes. In order to move the field of obesity prevention programmes forward, the current review aimed to 1) identify which fidelity components have been measured in school-based obesity prevention programmes; 2) identify how fidelity components have been measured; and 3) score the quality of these methods.MethodsStudies published between January 2001-October 2017 were selected from searches in PubMed, EMBASE, PsycINFO, CINAHL, Cochrane Library and ERIC. We included studies examining the fidelity of obesity prevention programmes (nutrition and/or physical activity and/or sitting) at school (children aged 4-18 year) measuring at least one component of implementation fidelity. A data extraction was performed to identify which and how fidelity components were measured. Thereafter, a quality assessment was performed to score the quality of these methods. We scored each fidelity component on 7 quality criteria. Each fidelity component was rated high (>?75% positive), moderate (50-75%) or low (<?50%).ResultsOf the 26,294 retrieved articles, 73 articles reporting on 63 different studies were included in this review. In 17 studies a process evaluation was based on a theoretical framework. In total, 120 fidelity components were measured across studies: dose was measured most often (N =?50), followed by responsiveness (N =?36), adherence (N =?26) and quality of delivery (N =?8). There was substantial variability in how fidelity components were defined as well as how they were measured. Most common methods were observations, logbooks and questionnaires targeting teachers. The quality assessment scores ranged from 0 to 86%; most fidelity components scored low quality (n =?77).ConclusionsThere is no consensus on the operationalisation of concepts and methods used for assessing fidelity in school-based obesity prevention programmes and the quality of methods used is weak. As a result, we call for more consensus on the concepts and clear reporting on the methods employed for measurements of fidelity to increase the quality of fidelity measurements. Moreover, researchers should focus on the relation between fidelity and programme outcomes and determine to what extent adaptations to programmes have been made, whilst still being effective.

Dataset Information

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

Background

Methods

Results

Conclusion

Publications

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets