Dataset Information

A framework for outcome-level evaluation of in-service training of health care workers.

ABSTRACT:

Background

In-service training is a key strategic approach to addressing the severe shortage of health care workers in many countries. However, there is a lack of evidence linking these health care worker trainings to improved health outcomes. In response, the United States President's Emergency Plan for AIDS Relief's Human Resources for Health Technical Working Group initiated a project to develop an outcome-focused training evaluation framework. This paper presents the methods and results of that project.

Methods

A general inductive methodology was used for the conceptualization and development of the framework. Fifteen key informant interviews were conducted to explore contextual factors, perceived needs, barriers and facilitators affecting the evaluation of training outcomes. In addition, a thematic analysis of 70 published articles reporting health care worker training outcomes identified key themes and categories. These were integrated, synthesized and compared to several existing training evaluation models. This formed an overall typology which was used to draft a new framework. Finally, the framework was refined and validated through an iterative process of feedback, pilot testing and revision.

Results

The inductive process resulted in identification of themes and categories, as well as relationships among several levels and types of outcomes. The resulting framework includes nine distinct types of outcomes that can be evaluated, which are organized within three nested levels: individual, organizational and health system/population. The outcome types are: (1) individual knowledge, attitudes and skills; (2) individual performance; (3) individual patient health; (4) organizational systems; (5) organizational performance; (6) organizational-level patient health; (7) health systems; (8) population-level performance; and (9) population-level health. The framework also addresses contextual factors which may influence the outcomes of training, as well as the ability of evaluators to determine training outcomes. In addition, a group of user-friendly resources, the Training Evaluation Framework and Tools (TEFT) were created to help evaluators and stakeholders understand and apply the framework.

Conclusions

Feedback from pilot users suggests that using the framework and accompanying tools may support outcome evaluation planning. Further assessment will assist in strengthening guidelines and tools for operationalization.

SUBMITTER: O'Malley G

PROVIDER: S-EPMC3851191 | biostudies-literature | 2013 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A framework for outcome-level evaluation of in-service training of health care workers.

O'Malley Gabrielle G Perdue Thomas T Petracca Frances F

Human resources for health 20131001

<h4>Background</h4>In-service training is a key strategic approach to addressing the severe shortage of health care workers in many countries. However, there is a lack of evidence linking these health care worker trainings to improved health outcomes. In response, the United States President's Emergency Plan for AIDS Relief's Human Resources for Health Technical Working Group initiated a project to develop an outcome-focused training evaluation framework. This paper presents the methods and resu ...[more]

PMID: 24083635

Similar Datasets

Project description:BackgroundThe training of health workers in the use of malaria rapid diagnostic tests (RDTs) is an important component of a wider strategy to improve parasite-based malaria diagnosis at lower level health care facilities (LLHFs) where microscopy is not readily available for all patients with suspected malaria. This study describes the process and cost of training to attain competence of lower level health workers to perform malaria RDTs in a public health system setting in eastern Uganda.MethodsHealth workers from 21 health facilities in Uganda were given a one-day central training on the use of RDTs in malaria case management, including practical skills on how to perform read and interpret the test results. Successful trainees subsequently integrated the use of RDTs into their routine care for febrile patients at their LLHFs and transferred their acquired skills to colleagues (cascade training model). A cross-sectional evaluation of the health workers' competence in performing RDTs was conducted six weeks following the training, incorporating observation, in-depth interviews with health workers and the review of health facility records relating to tests offered and antimalarial drug (AMD) prescriptions pre and post training. The direct costs relating to the training processes were also documented.ResultsOverall, 135 health workers were trained including 63 (47%) nursing assistants, a group of care providers without formal medical training. All trainees passed the post-training concordance test with???80% except 12 that required re-training. Six weeks after the one-day training, 51/64 (80%) of the health workers accurately performed the critical steps in performing the RDT. The performance was similar among the 10 (16%) participants who were peer-trained by their trained colleagues. Only 9 (14%) did not draw the appropriate amount of blood using pipette. The average cost of the one-day training was US$ 101 (range $92-$112), with the main cost drivers being trainee travel and per-diems. Health workers offered RDTs to 76% of febrile patients and AMD prescriptions reduced by 37% six weeks post-training.ConclusionOne-day training on the use of RDTs successfully provided adequate skill and competency among health workers to perform RDTs in fever case management at LLHF in a Uganda setting. The cost averaged at US$101 per health worker trained, with the main cost drivers being trainee travel and per diems. Given the good peer training noted in this study, there is need to explore the cost-effectiveness of a cascade training model for large scale implementation of RDTs.

Project description:BackgroundA growing number of older adults require complex care, but coordination among professionals to provide comprehensive and high-quality care is perceived to be inadequate. Opportunities to gain the knowledge and skills important for interprofessional collaboration in the context of geriatric care are limited, particularly for those already in the workforce. A short-term training programme in interprofessional collaboration for health and social care workers in the Philippines was designed and pilot tested. The programme was devised following a review of the literature about geriatric care education and group interviews about training needs. The objectives of this paper are to introduce the training programme and to evaluate its influence on attitudes and readiness to collaborate among participants using both quantitative and qualitative methodologies.MethodsA total of 42 community health workers and 40 health institution workers participated in the training in July 2019. Quantitative indicators were used to evaluate attitudes towards and readiness for collaboration before and after the training. Content analysis was performed of responses to open-ended questions asking participants to evaluate the training. A convergent parallel mixed-methods design was applied to determine the patterns of similarities or differences between the quantitative and qualitative data.ResultsSignificant improvements were seen in scores on the Attitudes Towards Health Care Teams Scale among community health (P < 0.001) and health institution (P < 0.001) staff after the training. Scenario-based case studies allowed participants to work in groups to practise collaboration across professional and institutional boundaries; the case studies fostered greater collaboration and continuity of care. Exposure to other professionals during the training led to a deeper understanding of current practices among health and social care workers. Use of the scenario-based case studies followed by task-based discussion in groups was successful in engaging care professionals to provide patient-centred care.ConclusionsThis pilot test of in-service training in interprofessional collaboration in geriatric care improved community and health institution workers' attitudes towards such collaboration. A 3-day training attended by health and social care workers from diverse healthcare settings resulted in recommendations to enhance collaboration when caring for older adults in their current work settings.

Project description:CONTEXT:As public health needs and priorities evolve, maintaining a trained public health workforce is critical to the success of public health efforts. Researchers have examined training needs in various contexts and subpopulations, but a nationally representative study of what motivates public health workers to seek out training has yet to be conducted. By understanding these motivations, public health agencies and policy makers can appeal to worker motivations in both training programs and organizational incentives. OBJECTIVE:The purpose of this article was to describe overall training motivations and identify patterns of training motivations among public health workers. This study also explored whether or not training needs differ across prevalent motivational patterns. DESIGN AND PARTICIPANTS:Using data from the 2017 Public Health Workforce Interests and Needs Survey (PH WINS), the study used latent class analysis (LCA) to identify motivational patterns and logistic regression to analyze associations with training needs. RESULTS:The most prominent motivation to seek training was personal growth (82.7% of respondents). LCA identified 4 motivational classes of public health workers: those motivated by organizational pressure and requirements (31.8%), those motivated indiscriminately by all factors (28.4%), those motivated primarily by personal growth (21.7%), and those motivated by organizational accommodations and supports (18.2%). Motivational class was not associated with indicating training needs in any of 8 training domains, nor was it associated with indicating any training need in any domain. CONCLUSIONS:Public health agencies should consider the different motivational classes present in the public health workforce. In particular, motivational classes that represent organizational choices suggest that public health agencies should both motivate workers with organizational requirements and pressure from managers and offer institutional support via paid travel and covered time for training.

Project description:IntroductionA 2016 assessment of frontline health care workers (HCWs) in Ghana identified knowledge, skill, and attitude gaps related to immunization during the second year of life (2YL). The U.S. Centers for Disease Control and Prevention subsequently supported the Ghana Health Service Immunization Program to apply best practices of adult learning and training of trainers (TOT) for a cascade training program for 2YL.MethodsFive districts from each of the 3 regions (Greater Accra, Northern, and Volta) were selected for the TOT based on key measles and rubella vaccination coverage indicators. The design incorporated best practices of adult learning and TOT. The curriculum integrated 3 major topical themes: technical (immunization topics), operational, and training adults. The technical and operational content was based on HCW tasks most directly affecting 2YL objectives. A cross-functional team developed all classroom, field activity, and training evaluation materials.ResultsSeventy-four participants attended TOT workshops in 2017. Based on a rubric defined by the course designers, 99% of the participants reported an acceptable level of confidence to apply and teach the course content. After the TOTs, participants conducted 65 workshops, 43 field visits, and 4 review meetings, reaching 1,378 HCWs within 7 months. Fifty-four percent of HCWs who received training from TOT participants reported an acceptable level of confidence in using the skills, and 92% reported they would prioritize applying the skills acquired during the training.DiscussionThe success factors for effective adult learning and TOT can be applied to design and implement high-quality TOT even in resource-limited settings. The factors include using a variety of approaches, spending enough class time to prepare TOT participants for their training role, setting specific expectations for cascading the training, and following up through mentorship and reporting. Strong collaboration across the administrative levels of the Ghana Health Service enabled cascade training.

Dataset Information

A framework for outcome-level evaluation of in-service training of health care workers.

Background

Methods

Results

Conclusions

Publications

A framework for outcome-level evaluation of in-service training of health care workers.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets