Dataset Information

A framework for outcome-level evaluation of in-service training of health care workers.

ABSTRACT:

Background

In-service training is a key strategic approach to addressing the severe shortage of health care workers in many countries. However, there is a lack of evidence linking these health care worker trainings to improved health outcomes. In response, the United States President's Emergency Plan for AIDS Relief's Human Resources for Health Technical Working Group initiated a project to develop an outcome-focused training evaluation framework. This paper presents the methods and results of that project.

Methods

A general inductive methodology was used for the conceptualization and development of the framework. Fifteen key informant interviews were conducted to explore contextual factors, perceived needs, barriers and facilitators affecting the evaluation of training outcomes. In addition, a thematic analysis of 70 published articles reporting health care worker training outcomes identified key themes and categories. These were integrated, synthesized and compared to several existing training evaluation models. This formed an overall typology which was used to draft a new framework. Finally, the framework was refined and validated through an iterative process of feedback, pilot testing and revision.

Results

The inductive process resulted in identification of themes and categories, as well as relationships among several levels and types of outcomes. The resulting framework includes nine distinct types of outcomes that can be evaluated, which are organized within three nested levels: individual, organizational and health system/population. The outcome types are: (1) individual knowledge, attitudes and skills; (2) individual performance; (3) individual patient health; (4) organizational systems; (5) organizational performance; (6) organizational-level patient health; (7) health systems; (8) population-level performance; and (9) population-level health. The framework also addresses contextual factors which may influence the outcomes of training, as well as the ability of evaluators to determine training outcomes. In addition, a group of user-friendly resources, the Training Evaluation Framework and Tools (TEFT) were created to help evaluators and stakeholders understand and apply the framework.

Conclusions

Feedback from pilot users suggests that using the framework and accompanying tools may support outcome evaluation planning. Further assessment will assist in strengthening guidelines and tools for operationalization.

SUBMITTER: O'Malley G

PROVIDER: S-EPMC3851191 | biostudies-literature | 2013 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A framework for outcome-level evaluation of in-service training of health care workers.

O'Malley Gabrielle G Perdue Thomas T Petracca Frances F

Human resources for health 20131001

<h4>Background</h4>In-service training is a key strategic approach to addressing the severe shortage of health care workers in many countries. However, there is a lack of evidence linking these health care worker trainings to improved health outcomes. In response, the United States President's Emergency Plan for AIDS Relief's Human Resources for Health Technical Working Group initiated a project to develop an outcome-focused training evaluation framework. This paper presents the methods and resu ...[more]

PMID: 24083635

Similar Datasets

Project description:BackgroundThe training of health workers in the use of malaria rapid diagnostic tests (RDTs) is an important component of a wider strategy to improve parasite-based malaria diagnosis at lower level health care facilities (LLHFs) where microscopy is not readily available for all patients with suspected malaria. This study describes the process and cost of training to attain competence of lower level health workers to perform malaria RDTs in a public health system setting in eastern Uganda.MethodsHealth workers from 21 health facilities in Uganda were given a one-day central training on the use of RDTs in malaria case management, including practical skills on how to perform read and interpret the test results. Successful trainees subsequently integrated the use of RDTs into their routine care for febrile patients at their LLHFs and transferred their acquired skills to colleagues (cascade training model). A cross-sectional evaluation of the health workers' competence in performing RDTs was conducted six weeks following the training, incorporating observation, in-depth interviews with health workers and the review of health facility records relating to tests offered and antimalarial drug (AMD) prescriptions pre and post training. The direct costs relating to the training processes were also documented.ResultsOverall, 135 health workers were trained including 63 (47%) nursing assistants, a group of care providers without formal medical training. All trainees passed the post-training concordance test with???80% except 12 that required re-training. Six weeks after the one-day training, 51/64 (80%) of the health workers accurately performed the critical steps in performing the RDT. The performance was similar among the 10 (16%) participants who were peer-trained by their trained colleagues. Only 9 (14%) did not draw the appropriate amount of blood using pipette. The average cost of the one-day training was US$ 101 (range $92-$112), with the main cost drivers being trainee travel and per-diems. Health workers offered RDTs to 76% of febrile patients and AMD prescriptions reduced by 37% six weeks post-training.ConclusionOne-day training on the use of RDTs successfully provided adequate skill and competency among health workers to perform RDTs in fever case management at LLHF in a Uganda setting. The cost averaged at US$101 per health worker trained, with the main cost drivers being trainee travel and per diems. Given the good peer training noted in this study, there is need to explore the cost-effectiveness of a cascade training model for large scale implementation of RDTs.

Project description:CONTEXT:As public health needs and priorities evolve, maintaining a trained public health workforce is critical to the success of public health efforts. Researchers have examined training needs in various contexts and subpopulations, but a nationally representative study of what motivates public health workers to seek out training has yet to be conducted. By understanding these motivations, public health agencies and policy makers can appeal to worker motivations in both training programs and organizational incentives. OBJECTIVE:The purpose of this article was to describe overall training motivations and identify patterns of training motivations among public health workers. This study also explored whether or not training needs differ across prevalent motivational patterns. DESIGN AND PARTICIPANTS:Using data from the 2017 Public Health Workforce Interests and Needs Survey (PH WINS), the study used latent class analysis (LCA) to identify motivational patterns and logistic regression to analyze associations with training needs. RESULTS:The most prominent motivation to seek training was personal growth (82.7% of respondents). LCA identified 4 motivational classes of public health workers: those motivated by organizational pressure and requirements (31.8%), those motivated indiscriminately by all factors (28.4%), those motivated primarily by personal growth (21.7%), and those motivated by organizational accommodations and supports (18.2%). Motivational class was not associated with indicating training needs in any of 8 training domains, nor was it associated with indicating any training need in any domain. CONCLUSIONS:Public health agencies should consider the different motivational classes present in the public health workforce. In particular, motivational classes that represent organizational choices suggest that public health agencies should both motivate workers with organizational requirements and pressure from managers and offer institutional support via paid travel and covered time for training.

Project description:IntroductionA 2016 assessment of frontline health care workers (HCWs) in Ghana identified knowledge, skill, and attitude gaps related to immunization during the second year of life (2YL). The U.S. Centers for Disease Control and Prevention subsequently supported the Ghana Health Service Immunization Program to apply best practices of adult learning and training of trainers (TOT) for a cascade training program for 2YL.MethodsFive districts from each of the 3 regions (Greater Accra, Northern, and Volta) were selected for the TOT based on key measles and rubella vaccination coverage indicators. The design incorporated best practices of adult learning and TOT. The curriculum integrated 3 major topical themes: technical (immunization topics), operational, and training adults. The technical and operational content was based on HCW tasks most directly affecting 2YL objectives. A cross-functional team developed all classroom, field activity, and training evaluation materials.ResultsSeventy-four participants attended TOT workshops in 2017. Based on a rubric defined by the course designers, 99% of the participants reported an acceptable level of confidence to apply and teach the course content. After the TOTs, participants conducted 65 workshops, 43 field visits, and 4 review meetings, reaching 1,378 HCWs within 7 months. Fifty-four percent of HCWs who received training from TOT participants reported an acceptable level of confidence in using the skills, and 92% reported they would prioritize applying the skills acquired during the training.DiscussionThe success factors for effective adult learning and TOT can be applied to design and implement high-quality TOT even in resource-limited settings. The factors include using a variety of approaches, spending enough class time to prepare TOT participants for their training role, setting specific expectations for cascading the training, and following up through mentorship and reporting. Strong collaboration across the administrative levels of the Ghana Health Service enabled cascade training.

Project description:Background: Occupational health hazard pertaining to health care providers is one of the neglected areas that need serious attention. Any compromise in their safety would result in reduction in workforce, which may affect patient care, keeping in mind the wide gap between the required number and actual health care workers (HCWs) available in the world over. Aim: This study was undertaken to evaluate the change in knowledge through a sensitization training program on occupational health hazards and vaccination for HCWs. Materials and Methods: Participants of the study included nursing and allied HCWs of a tertiary care health institute in Uttarakhand, India. Multiple training sessions, each of around 180 min, were held periodically in small groups with 20-40 participants over 2 years. Participants were assessed with pretest and posttest questionnaires, and feedback was taken. Questionnaires comprised three categories: general safety and ergonomics, biological hazards, and chemical and radiation hazards. Data of incident reporting for needlestick injury from 2017 to 2019 were retrieved. All data were compiled in Excel sheet and analyzed. Results: A total of 352 participants were included in the study. Mean ± SD for pretest and posttest scores were 5.3 ± 2.13 and 11.22 ± 2.15, respectively. There was considerable improvement in knowledge, which was found to be statistically significant with p-value of 0.001 for all categories. Participants in their feedback suggested for inclusion of psychosocial aspect in further training programs. Conclusion: Low baseline knowledge prior to attending the course highlights a need for an intervention through such structured sensitization program to create awareness and educate HCWs on common occupational health hazards and vaccination. Statistically significant improvement in posttest knowledge highlights effectiveness of the training program. A drastic rise in incident reporting for needlestick injury reflects fairly good impact of training program. Regular and appropriate form of training can reduce injuries resulting from occupational hazards and ensure healthy workforce contributing toward a positive impact on national economy.

Dataset Information

A framework for outcome-level evaluation of in-service training of health care workers.

Background

Methods

Results

Conclusions

Publications

A framework for outcome-level evaluation of in-service training of health care workers.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets