Dataset Information

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

ABSTRACT:

Background

Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured.

Methods

This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST) drug prevention program with fidelity. Regression analysis was used to examine factors influencing four dimensions of fidelity: adherence, dosage, quality of delivery, and student responsiveness.

Results

Although most sites faced common barriers, such as finding room in the school schedule for the program, gaining full support from key participants (i.e., site coordinators, principals, and LST teachers), ensuring teacher participation in training workshops, and classroom management difficulties, most schools involved in the project implemented LST with very high levels of fidelity. Across sites, 86% of program objectives and activities required in the three-year curriculum were delivered to students. Moreover, teachers were observed using all four recommended teaching practices, and 71% of instructors taught all the required LST lessons. Multivariate analyses found that highly rated LST program characteristics and better student behavior were significantly related to a greater proportion of material taught by teachers (adherence). Instructors who rated the LST program characteristics as ideal were more likely to teach all lessons (dosage). Student behavior and use of interactive teaching techniques (quality of delivery) were positively related. No variables were related to student participation (student responsiveness).

Conclusion

Although difficult, high implementation fidelity by community-based organizations can be achieved. This study suggests some important factors that organizations should consider to ensure fidelity, such as selecting programs with features that minimize complexity while maximizing flexibility. Time constraints in the classroom should be considered when choosing a program. Student behavior also influences program delivery, so schools should train teachers in the use of classroom management skills. This project involved comprehensive program monitoring and technical assistance that likely facilitated the identification and resolution of problems and contributed to the overall high quality of implementation. Schools should recognize the importance of training and technical assistance to ensure quality program delivery.

SUBMITTER: Mihalic SF

PROVIDER: S-EPMC2265741 | biostudies-literature | 2008 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

Mihalic Sharon F SF Fagan Abigail A AA Argamaso Susanne S

Implementation science : IS 20080118

<h4>Background</h4>Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured.<h4>Methods</h4>This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST) drug preven ...[more]

PMID: 18205919

Similar Datasets

Project description:BackgroundWhen tested in a randomized controlled trial (RCT) of 31,411 patients, the nurse-led 6-PACK falls prevention program did not reduce falls. Poor implementation fidelity (i.e., program not implemented as intended) may explain this result. Despite repeated calls for the examination of implementation fidelity as an essential component of evaluating interventions designed to improve the delivery of care, it has been neglected in prior falls prevention studies. This study examined implementation fidelity of the 6-PACK program during a large multi-site RCT.MethodsBased on the 6-PACK implementation framework and intervention description, implementation fidelity was examined by quantifying adherence to program components and organizational support. Adherence indicators were: 1) falls-risk tool completion; and for patients classified as high-risk, provision of 2) a 'Falls alert' sign; and 3) at least one additional 6-PACK intervention. Organizational support indicators were: 1) provision of resources (executive sponsorship, site clinical leaders and equipment); 2) implementation activities (modification of patient care plans; training; implementation tailoring; audits, reminders and feedback; and provision of data); and 3) program acceptability. Data were collected from daily bedside observation, medical records, resource utilization diaries and nurse surveys.ResultsAll seven intervention components were delivered on the 12 intervention wards. Program adherence data were collected from 103,398 observations and medical record audits. The falls-risk tool was completed each day for 75% of patients. Of the 38% of patients classified as high-risk, 79% had a 'Falls alert' sign and 63% were provided with at least one additional 6-PACK intervention, as recommended. All hospitals provided the recommended resources and undertook the nine outlined program implementation activities. Most of the nurses surveyed considered program components important for falls prevention.ConclusionsWhile implementation fidelity was variable across wards, overall it was found to be acceptable during the RCT. Implementation failure is unlikely to be a key factor for the observed lack of program effectiveness in the 6-PACK trial.Trial registrationThe 6-PACK cluster RCT is registered with the Australian New Zealand Clinical Trials Registry, number ACTRN12611000332921 (29 March 2011).

Project description:BackgroundUntil now, there is no clear overview of how fidelity is assessed in school-based obesity prevention programmes. In order to move the field of obesity prevention programmes forward, the current review aimed to 1) identify which fidelity components have been measured in school-based obesity prevention programmes; 2) identify how fidelity components have been measured; and 3) score the quality of these methods.MethodsStudies published between January 2001-October 2017 were selected from searches in PubMed, EMBASE, PsycINFO, CINAHL, Cochrane Library and ERIC. We included studies examining the fidelity of obesity prevention programmes (nutrition and/or physical activity and/or sitting) at school (children aged 4-18 year) measuring at least one component of implementation fidelity. A data extraction was performed to identify which and how fidelity components were measured. Thereafter, a quality assessment was performed to score the quality of these methods. We scored each fidelity component on 7 quality criteria. Each fidelity component was rated high (>?75% positive), moderate (50-75%) or low (<?50%).ResultsOf the 26,294 retrieved articles, 73 articles reporting on 63 different studies were included in this review. In 17 studies a process evaluation was based on a theoretical framework. In total, 120 fidelity components were measured across studies: dose was measured most often (N =?50), followed by responsiveness (N =?36), adherence (N =?26) and quality of delivery (N =?8). There was substantial variability in how fidelity components were defined as well as how they were measured. Most common methods were observations, logbooks and questionnaires targeting teachers. The quality assessment scores ranged from 0 to 86%; most fidelity components scored low quality (n =?77).ConclusionsThere is no consensus on the operationalisation of concepts and methods used for assessing fidelity in school-based obesity prevention programmes and the quality of methods used is weak. As a result, we call for more consensus on the concepts and clear reporting on the methods employed for measurements of fidelity to increase the quality of fidelity measurements. Moreover, researchers should focus on the relation between fidelity and programme outcomes and determine to what extent adaptations to programmes have been made, whilst still being effective.

Project description:Humanistic care in medicine has shown to improve healthcare outcomes. Language barriers are a significant obstacle to humanistic care, and trained medical interpreters have demonstrated to effectively bridge the gap for the vulnerable limited English proficiency (LEP) patient population. One way in which medical schools can train more humanistic physicians and provide language access is through the implementation of programs to train bilingual medical students as medical interpreters. The purpose of this prospective study was to evaluate whether such training had an impact on bilingual medical student's interpretation skills and humanistic traits.Between 2015 and 2017, whole-day (~?8 h) workshops on medical interpretation were offered periodically to 80 bilingual medical students at the Penn State College of Medicine. Students completed a series of questionnaires before and after the training that assessed the program's effectiveness and its overall impact on interpretation skills and humanistic traits. Students also had the opportunity to become certified medical interpreters.The 80 student participants were first- to third- year medical students representing 21 languages. Following training, most students felt more confident interpreting (98%) and more empathetic towards LEP patients (87.5%). Students' scores in the multiple-choice questions about medical interpretation/role of the interpreter were also significantly improved (Chi-Square test, p?<?0.05). All students who decided to take the exam were able to successfully become certified interpreters. Ninety-two percent of participants reported they would recommend the program and would be willing to serve as a future "coaches" for interpreter training workshops delivered to peer students.Our program was successful in increasing self-reported measures of empathy and humanism in medical students. Our data suggests that implementation of medical interpreter training programs can be a successful strategy to develop of humanism in medical students, and aid in the development of sustainable language access for LEP patients.

Dataset Information

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

Background

Methods

Results

Conclusion

Publications

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets