Dataset Information

Programme evaluation training for health professionals in francophone Africa: process, competence acquisition and use.

ABSTRACT: BACKGROUND: While evaluation is, in theory, a component of training programmes in health planning, training needs in this area remain significant. Improving health systems necessarily calls for having more professionals who are skilled in evaluation. Thus, the Université de Ouagadougou (Burkina Faso) and the Université de Montréal (Canada) have partnered to establish, in Burkina Faso, a master's-degree programme in population and health with a course in programme evaluation. This article describes the four-week (150-hour) course taken by two cohorts (2005-2006/2006-2007) of health professionals from 11 francophone African countries. We discuss how the course came to be, its content, its teaching processes and the master's programme results for students. METHODS: The conceptual framework was adapted from Kirkpatrick's (1996) four-level evaluation model: reaction, learning, behaviour, results. Reaction was evaluated based on a standardized questionnaire for all the master's courses and lessons. Learning and behaviour competences were assessed by means of a questionnaire (pretest/post-test, one year after) adapted from the work of Stevahn L, King JA, Ghere G, Minnema J: Establishing Essential Competencies for Program Evaluators. Am J Eval 2005, 26(1):43-59. Master's programme effects were tested by comparing the difference in mean scores between times (before, after, one year after) using pretest/post-test designs. Paired sample tests were used to compare mean scores. RESULTS: The teaching is skills-based, interactive and participative. Students of the first cohort gave the evaluation course the highest score (4.4/5) for overall satisfaction among the 16 courses (3.4-4.4) in the master's programme. What they most appreciated was that the forms of evaluation were well adapted to the content and format of the learning activities. By the end of the master's programme, both cohorts of students considered that they had greatly improved their mastery of the 60 competences (p<0.001). This level was maintained one year after completing the master's degree, except for reflective practice (p<0.05). Those who had carried out an evaluation in the intervening 12 months reported a negative gap between their declared mastery and their actual application. However, this is only statistically significant for reflective practice (p < 0.05). CONCLUSION: This study shows the importance of integrating summative evaluation into the learning process. Skills-based teaching is much appreciated and well-adapted. Creating a master's programme in population and health in Africa and providing training in evaluation to high-level health professionals from many countries augurs well for scaling up the practice of evaluation in African health systems.

SUBMITTER: Ridde V

PROVIDER: S-EPMC2647897 | biostudies-other | 2009

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Programme evaluation training for health professionals in francophone Africa: process, competence acquisition and use.

Ridde Valéry V Fournier Pierre P Banza Baya B Tourigny Caroline C Ouédraogo Dieudonné D

Human resources for health 20090115

<h4>Background</h4>While evaluation is, in theory, a component of training programmes in health planning, training needs in this area remain significant. Improving health systems necessarily calls for having more professionals who are skilled in evaluation. Thus, the Université de Ouagadougou (Burkina Faso) and the Université de Montréal (Canada) have partnered to establish, in Burkina Faso, a master's-degree programme in population and health with a course in programme evaluation. This article ...[more]

PMID: 19146690

Similar Datasets

Project description:BACKGROUND:To evaluate whether a training programme is a feasible approach to facilitate occupational health professionals' (OHPs) use of knowledge and skills provided by a guideline. METHODS:Feasibility was evaluated by researching three aspects: 'acceptability', 'implementation' and 'limited efficacy'. Statements on acceptability and implementation were rated by OHPs on 10-point visual analogue scales after following the training programme (T2). Answers were analysed using descriptive statistics. Barriers to and facilitators of implementation were explored through open-ended questions at T2, which were qualitatively analysed. Limited efficacy was evaluated by measuring the level of knowledge and skills at baseline (T0), after reading the guideline (T1) and directly after completing the training programme (T2). Increase in knowledge and skills was analysed using a non-paramatric Friedman test and post-hoc Wilcoxon signed rank tests (two-tailed). RESULTS:The 38 OHPs found the training programme acceptable, judging that it was relevant (M: 8, SD: 1), increased their capability (M: 7, SD: 1), adhered to their daily practice (M: 8, SD: 1) and enhanced their guidance and assessment of people with a chronic disease (M: 8, SD: 1). OHPs found that it was feasible to implement the programme on a larger scale (M: 7, SD: 1) but foresaw barriers such as 'time', 'money' and organizational constraints. The reported facilitators were primarily related to the added value of the knowledge and skills to the OHPs' guidance and assessment, and that the programme taught them to apply the evidence in practice. Regarding limited efficacy, a significant increase was seen in OHPs' knowledge and skills over time (X2 (2)?=?53.656, p <?0.001), with the median score improving from 6.3 (T0), 8.3 (T1) and 12.3 (T2). Post-hoc tests indicated a significant improvement between T0 and T1 (p?<?0.001) and between T1 and T2 (p?<?0.001). CONCLUSIONS:The training programme was found to be a feasible approach to facilitate OHPs' use of knowledge and skills provided by the guideline, from the perspective of OHPs generally (acceptability and implementation) and with respect to their increase in knowledge and skills in particular (limited efficacy).

Project description:BackgroundMany low and middle- income countries (LMICs) are repositioning community health worker (CHW) programmes to provide a more comprehensive range of promotive and preventive services and referrals to the formal health service. However, insufficient supervision, fragmented programmes, and the low literacy levels of CHWs often result in the under-performance of the programmes. We evaluate the impact of a roving nurse mentor working with CHW teams proving supportive supervision in a semi-rural area of South Africa.MethodsWe conducted a longitudinal process evaluation, using in-depth interviews, focus groups and observations prior to the intervention, during the intervention, and 6 months post-intervention to assess how the effects of the intervention were generated and sustained. Our participants were CHWs, their supervisors, clients and facility staff members and community representatives.ResultsThe nurse mentor operated in an environment of resource shortages, conflicts between CHWs and facility staff, and an active CHW labour union. Over 15 months, the mentor was able to (1) support and train CHWs and their supervisors to gain and practice new skills, (2) address their fears of failing and (3) establish operational systems to address inefficiencies in the CHWs' activities, resulting in improved service provision. Towards the end of the intervention the direct employment of the CHWs by the Department of Health and an increase in their stipend added to their motivation and integration into the local primary care clinic team. However, given the communities' focus on accessing government housing, rather than better healthcare, and volatile nature of the communities, the nurse mentor was not able to establish a collaboration with local structures.ConclusionsA roving nurse mentor overseeing several CHW teams within a district healthcare system is a feasible option, particularly in a context where there is a shortage of qualified supervisors to support CHWs activities. A roving nurse mentor can contribute to the knowledge and skills development of the CHWs and enhance the capacity of junior supervisors. However, the long-term sustainability of the effects of intervention is dependent on CHWs' formal employment by the Department of Health.

Project description:BackgroundThe World Health Organization recommends promoting exclusive breastfeeding for six months. Women often end breastfeeding earlier than planned, however women who continue to breastfeed despite problems often experience good support and counselling from health professionals. The aim of this study was to evaluate the effects of a process-oriented training in breastfeeding support counselling for midwives and child health nurses, on women's satisfaction with breastfeeding counselling, problems with insufficient breast milk and nipple pain in relation to exclusive breastfeeding shorter or longer than 3 months.MethodsAn intervention through process-oriented training for health professionals regarding support in childbearing and breastfeeding took part in the south west of Sweden. This study was conducted in Sweden, in 2000 - 2003. Ten municipalities were paired, and within each pair, one was randomly assigned to the group of five intervention (IG) municipalities and one to the group of five control municipalities. Primiparas (n?=?540) were invited to participate in a longitudinal study to evaluate the care they received. A survey was distributed at 3 days, 3 months and 9 months postpartum. Data collection for control group A (n?=?162) started before the intervention was initiated. Data for control group B (n?=?172) were collected simultaneously with the intervention group (IG) (n?=?206). Women were also divided into two groups depending on whether they exclusive breastfed?<?3 months or???3 months.ResultsWomen in IG were more satisfied with the breastfeeding counselling (p?=?0.008) and felt the breastfeeding counselling was more coherent (p?=?0.002) compared to control groups, when exclusive breastfeeding was?<?3 months. In addition fewer women in the IG, among the group exclusively breastfeeding?<?3 months, had problems with insufficient breast milk compared to the control groups (p?=?0.01).ConclusionA process-oriented training for health professionals in support influenced women's ability to solve breastfeeding problems such as the experience of insufficient breast milk production. Women with exclusive breastfeeding lasting???3 months more often had breastfeeding duration in line with their planned breastfeeding duration, compared to women who had breastfeeding duration?<?3 months.Trial registrationACTRN12611000354987.

Project description:BackgroundRates of noncommunicable diseases continue to rise worldwide. Many of these diseases are a result of engaging in risk behaviors. Without lifestyle and behavioral intervention, noncommunicable diseases can worsen and develop into more debilitating diseases. Behavioral interventions are an effective strategy to reduce the burden of disease. Behavior change techniques can be described as the "active ingredients" in behavior change and address the components that need to be altered in order for the target behavior to change. Health professionals, such as pharmacists and nurses, can engage in opportunistic behavior change with their patients, to encourage positive health behaviors.ObjectiveWe aimed to develop, implement, and evaluate a behavior change workshop targeted at health professionals in Australia, with the goal of increasing knowledge of behavior change techniques and psychological variables.MethodsA prospective study design was used to develop and evaluate a 2-hour behavior change workshop targeted at health professionals. The workshop was developed based on the Capability, Opportunity, Motivation, and Behavior Model and had five core objectives: (1) to detail the role of health professionals in delivering optimal care, (2) to demonstrate opportunities to change behavior, (3) to describe principles of behavior change, (4) to explain behavior change techniques, and (5) to determine the most appropriate behavior change techniques to use and when to use them. A total of 10 workshops were conducted. To evaluate the workshops and identify any potential long-term changes in behavior, we collected pre- and postworkshop data on knowledge and psychological constructs from the attendees.ResultsA final sample of 41 health professionals comprising general practitioners, nurses, and pharmacists completed the pre- and postworkshop surveys. Following the workshops, there were significant improvements in knowledge of behavior change techniques (t40=-5.27, P<.001), subjective norms (t40=-3.49, P=.001), descriptive norms (t40=-3.65, P<.001), perceived behavioral control (t40=-3.30, P=.002), and intention (t36=-3.32, P=.002); each had a large effect size. There was no significant difference in postworkshop attitude (t40=0.78, P=.44). The participants also found the workshops to be highly acceptable.ConclusionsA 2-hour, theoretically informed workshop designed to facilitate the use of behavior change techniques by health professionals was shown to be largely effective. The workshops resulted in increases in knowledge, descriptive and subjective norms, perceived behavioral control, and intention, but not in attitude. The intervention was also shown to be highly acceptable, with the large majority of participants deeming the intervention to be needed, useful, appropriate, and applicable, as well as interesting and worth their time. Future research should examine the lasting impacts of the workshop on health professionals' practices.

Project description:Background: Neonatal mortality rates remain high in Sub-Saharan African countries. Improving the newborn resuscitation skills of healthcare professionals is important in addressing this challenge. The aim of this study was to evaluate a neonatal resuscitation training programme delivered over a two-year period for healthcare professionals in Zanzibar, Tanzania. Methods: A pre- and post-intervention study was designed. We delivered neonatal resuscitation training over a 2-day period in 2017 and 2 days of refresher training in 2018. Knowledge was evaluated by a self-designed survey (11 items with a total score of 22) before and after the two training periods, and skills were evaluated by a skills checklist (six domains with 25 items with a total score of 50) completed by the trainers based on their observations. Statistical analysis included differences in the knowledge and skills scores before and after the training sessions and between the two periods. Results: A total of 23 healthcare professionals participated and completed both neonatal resuscitation training sessions. The knowledge mean scores before and after the training in 2017 increased from 9.60 to 13.60 (95% CI: -5.900; -2.099, p < 0.001), and in 2018, the scores increased from 10.80 to 15.44 (95% CI: -6.062; -3.217, p < 0.001). The mean knowledge scores post-training over time were 13.60 in 2017 and 15.44 in 2018 (95% CI: -3.489; 0.190, p = 0.030). The resuscitation skills performance between the two time periods increased from a mean of 32.26 (SD = 2.35) to a mean of 42.43 (SD = 1.73) (95% CI: -11.402; -8.945, p < 0.001). Conclusion: The neonatal resuscitation training programme increased the theoretical knowledge and resuscitation skills before and after the two training sessions and over time after a 9-month period. Continuous neonatal resuscitation training based on the local needs in resource-limited countries is essential to provide confidence in healthcare professionals to initiate resuscitation and to improve newborn outcomes.

Project description:BackgroundStrengthening infection prevention and control (IPC) capacity was identified as a key intervention to prepare African Union member states to curb the COVID-19 pandemic. As part of the Africa Taskforce for Coronavirus, which helped implement the Africa Joint Continental Strategy for COVID-19 Outbreak response, the IPC Technical Working Group (IPC TWG) was convened to coordinate the development of IPC core components for preparedness, response, and recovery from COVID-19. As part of the IPC TWG's work, the Africa Centres for Disease Control and Prevention, in collaboration with the Infection Control Africa Network, delivered virtual IPC training sessions targeted to African Union member states. We aimed to undertake a process evaluation of this training to inform and improve both ongoing and future programming.MethodsThe scope of the evaluation was agreed upon through discussion with the training organizers and advisory members and a design workshop. A mixed-methods approach was used; data collection was partly prospective and partly retrospective due to the rapid start of some of the training activities. Existing available data included: usage analytics, the content of questions posed during the webinar and community of practice, and participant feedback survey results. In addition, in-depth qualitative interviews were conducted with a sample of webinar participants.ResultsThe rapid development of this training was efficient and responsive. The training reached more than 3,000 participants across the 2 rounds, but the numbers varied substantially by location. Participants engaged well during the question period during each webinar, but the asynchronous community of practice was less utilized during the evaluation time frame. Many participants appreciated the African focus of the webinars and gave positive feedback on the practical and context-specific content.ConclusionsThe move toward online training provides an important opportunity to improve IPC across the African continent.

Project description:INTRODUCTION:Patients with cancer having minor children experience particular burden and strains. Being patient and parent at the same time is associated with specific needs of support. Therefore, the communication of child-related and family-related issues plays an important role in patient care. This study aims at testing the feasibility of a training to improve the situation of patients with cancer having minor children and their families by enhancing the competencies of healthcare professionals (HCPs, eg, physicians, nurses, psychologists) in caring for patients with cancer having minor children. Moreover, the study aims at testing the study design and outcomes of the evaluation concept and preliminary effects of the training. METHODS AND ANALYSIS:We will conduct a randomised controlled pilot trial with three arms (face-to-face training versus web-based training versus waitlist control group) to investigate the study aims. Primary outcome will be the competency to approach child-related and family-related topics in patients with cancer measured using comprehensive case vignettes. Secondary outcomes will be communication and attitudes regarding child-related and family-related topics and self-efficacy in clinical communication skills. Outcomes will be assessed prior to the training and after the training as well as 3 months after the training. Data will be analysed using descriptive analyses, group comparisons and linear mixed models. ETHICS AND DISSEMINATION:The study was approved by the Local Psychological Ethics Committee of the Center for Psychosocial Medicine of the University Medical Center Hamburg-Eppendorf (LPEK-001). At the end of the study, a web-based training and a face-to-face training intervention to enhance the competencies of HCPs in caring for patients with cancer having minor children will have been systematically developed and the study design and evaluation concept will have been evaluated. The results of the study will be disseminated through peer-reviewed journals and conference presentations. TRIAL REGISTRATION NUMBER:DRKS00015794.

Project description:BackgroundThe InfAct (Information for Action) is a Joint Action of the European Commission's 3rd Health Programme with the main goal to build an infrastructure of a health information system for a stronger European Union and to strengthen its core elements. The InfAct Joint Action was developed along 36 months and structured in 10 work packages. Portugal co-led the Work Package 6 (WP6) of this project, which included the development of the proposal of a flagship capacity building programme - the European Health Information Training Programme - and its evaluation. The evaluation objectives included: to evaluate the adequacy of the training programme to the health information needs in the European Member States; to identify possible changes regarding the participants selection process, the training activities and the pedagogical project; and to contribute to the understanding of the potential of the programme to add to available offers in learning on the topics of Public Health information, on the capacity building and behavioural changes in Public Health activities which can be attributed to the course, and of the potential of the programme to contribute to the alignment of health information criteria and procedures between the European Member States.MethodsThe evaluation process was developed using an observational descriptive study design using a mixed methodological approach with both document analysis and primary data collected by questionnaires and interviews analysis. Mixed quantitative and qualitative data collection methods and analysis were used.ResultsThe proposal of the European Health Information Training Programme seemed adequate to the formative needs and capacities in line with the work performed by the InfAct project. In what concerns about its main thematic areas, it was also aligned with the areas identified in the previous formative needs and capacities mapping. The participants selection process proposed seemed, in general, adequate. The potential of the European Health Information Training Programme proposal to learning, capacity building and behavioral changes at work attributable to the course was considered positive, as well as the potential to the alignment of health information criteria and procedures between European Union Member States.DiscussionIn general, we found high consistency between the results obtained from data collected by the techniques used. However, different suggestions for improvement were outlined by the evaluation study population.ConclusionsThe proposed European Health Information Training Programme was a dynamic, flexible, sustainable formative programme in health information and focused on reducing inequalities.

Dataset Information

Programme evaluation training for health professionals in francophone Africa: process, competence acquisition and use.

Publications

Programme evaluation training for health professionals in francophone Africa: process, competence acquisition and use.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets