Dataset Information

Supervision training interventions in the health and human services: realist synthesis protocol.

ABSTRACT:

Introduction

Supervision training aims to develop workplace supervisory competencies. Despite extensive supervision literature, including literature reviews, the processes through which supervision training interventions produce their effects, for whom and under what circumstances is not clearly delineated. The purpose of this study is to explain the effect of contextual factors on the underpinning mechanisms of supervision training outcomes.

Methods and analysis

We propose to examine supervision training interventions across the health and human services workforce using realist methods. Pawson's five stages for undertaking a realist synthesis will be followed: (1) clarifying the scope of the review; (2) determining the search strategy; (3) study selection; (4) extracting data and (5) synthesising the evidence and drawing conclusions. Extracted data will include study characteristics, characteristics of participant cohort, intervention type, contextual factors, underlying mechanisms and supervision training outcomes. Patterns in context-mechanism-outcome configurations will be identified. Initial programme theories will be developed based on a comprehensive search of the literature, which will include key terms relating to supervision and training. The search strategy will involve: (1) electronic database searching using Medline, Cumulative Index to Nursing and Allied Health Literature, Social Services Abstracts, Educational Resources Information Center, PsycINFO and Australian Public Affairs Information Service and (2) hand and citation searching. We will also contact authors where necessary and discuss identified literature among the project team with extensive expertise in supervision training.

Ethics and dissemination

The realist synthesis will propose an evidence-informed theory of supervision training interventions (ie, what interventions work for whom and why). The findings will be disseminated in peer-reviewed journals and presentations and through discussions with relevant organisations and stakeholders. The research will be used by educators to develop evidenced-based supervision training interventions. It will also help workplace supervisors to better understand what types of supervision training might work most optimally for them and their colleagues. Other researchers could use the synthesis findings to guide future supervision research.

Prospero registration number

CRD42018094186.

SUBMITTER: Lee S

PROVIDER: S-EPMC6549728 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:PurposeSupervision training supports health care supervisors to perform their essential functions. Realist evaluations are increasingly popular for evaluating complex educational interventions, but no such evaluations exist appraising supervision workshops. Building on an earlier realist synthesis of supervision training, the authors evaluated whether supervision workshops work, for whom and under what circumstances, and why.MethodThe authors conducted a 2-stage realist evaluation during 2018-2019 to refine and develop program theory. The intervention involved half-day, face-to-face supervision workshops as part of an Australian state-wide government-funded program for health care and human services supervisors. Data collection involved realist interviews with 10 workshop developers (stage 1) and 43 supervisors (stage 2). The authors employed team-based data analysis using realist logic to refine and develop program theory by identifying contexts, mechanisms, outcomes, and context-mechanism-outcome configurations.ResultsDespite their brevity, the supervision workshops had many reported benefits for supervisors (e.g., improved satisfaction) through various perceived mechanisms pertaining to pedagogy (e.g., mixed pedagogies), workshops (e.g., optimal duration), and individuals (e.g., supervisor engagement). However, they also yielded negative reported outcomes (e.g., suboptimal knowledge gains) brought about by assorted perceived mechanisms related to pedagogy (e.g., suboptimal peer learning), workshops (e.g., content irrelevance), and individuals (e.g., suboptimal facilitator competence). Such mechanisms were thought to be triggered by diverse contexts including supervisors' levels of experience, sector, and workplace supervision cultures.ConclusionsWhile the findings partly support the realist synthesis of supervision training and previous realist evaluations of faculty development, this realist evaluation extends this literature considerably. Health care educators should employ mixed pedagogies (e.g., didactic teaching, peer learning), relevant content, optimal workshop duration, and competent/engaging facilitators. Educators also need to tailor workshops according to supervisors' contexts including the sectors and supervision cultures in which supervision is practiced, and supervisors' levels of experience (e.g., experienced supervisors appreciated workshop brevity).

Project description:INTRODUCTION:Scaling-up is essential to ensure universal access of effective health interventions. Scaling-up is a complex process, which occurs across diverse systems and contexts with no one-size-fits-all approach. To date, little attention has been paid to the process of scaling-up in how to make adaptations for local fit. The aim of this research is to develop theory on what actions can be used to make adaptations to health interventions for local fit when scaling-up across diverse contexts that will have practical application for implementers involved in scaling-up. METHODS AND ANALYSIS:Given the complexity of this subject, a realist review methodology was selected. Specifically, realist review emphasises an iterative, non-linear process, whereby the review is refined as it progresses. The identification of how the context may activate mechanisms to achieve outcomes is used to generate theories on what works for whom in what circumstances. This protocol will describe the first completed stage of development of an initial programme theory framework, which identified potential actions, contexts, mechanisms and outcomes that could be used to make adaptations when scaling-up. It will then outline the methods for future stages of the review which will focus on identifying case examples of scale-up and adaptation in practice. This realist review consists of six stages: (i) clarifying scope and development of a theoretical framework, (ii) developing a search strategy, (iii) selection and appraisal, (iv) data extraction, (v) data synthesis and analysis and (vi) further theory refinement with stakeholders. ETHICS AND DISSEMINATION:This review will develop theory on how adaptations can be made when scaling-up. Findings will be disseminated in a peer-reviewed journal and through stakeholder engagement as part of the research process. Ethical approval has been received through Health Policy and Management/Centre for Global Health Research Ethics Committee of Trinity College Dublin.

Project description:Background Four years prior to the Millenium Development Goals (MDGs) deadline, low- and middle-income countries and international stakeholders are looking for evidence-based policies to improve access to healthcare for the most vulnerable populations. User fee exemption policies are one of the potential solutions. However, the evidence is disparate, and systematic reviews have failed to provide valuable lessons. The authors propose to produce an innovative synthesis of the available evidence on user fee exemption policies in Africa to feed the policy-making process. Methods The authors will carry out a realist review to answer the following research question: what are the outcomes of user fee exemption policies implemented in Africa? why do they produce such outcomes? and what contextual elements come into play? This type of review aims to understand how contextual elements influence the production of outcomes through the activation of specific mechanisms, in the form of context-mechanism-outcome configurations. The review will be conducted in five steps: (1) identifying with key stakeholders the mechanisms underlying user fee exemption policies to develop the analytical framework, (2) searching for and selecting primary data, (3) assessing the quality of evidence using the Mixed-Method Appraisal Tool, (4) extracting the data using the analytical framework and (5) synthesising the data in the form of context-mechanism-outcomes configurations. The output will be a middle-range theory specifying how user fee exemption policies work, for what populations and under what circumstances. Ethics and dissemination The two main target audiences are researchers who are looking for examples to implement a realist review, and policy-makers and international stakeholders looking for lessons learnt on user fee exemption. For the latter, a knowledge-sharing strategy involving local scientific and policy networks will be implemented. The study has been approved by the ethics committee of the CHUM Research Centre (CR-CHUM). It received funding from the Canadian Institutes of Health Research. The funders will not have any role in study design; collection, management, analysis, and interpretation of data; writing of the report and the decision to submit the report for publication, including who will have ultimate authority over each of these activities.

Project description:BackgroundLegislation is one of the most powerful weapons for improving population health and is often used by policy and decision makers. Little research exists to guide them as to whether legislation is feasible and/or will succeed. We aimed to produce a coherent and transferable evidence based framework of threats to legislative interventions to assist the decision making process and to test this through the 'case study' of legislation to ban smoking in cars carrying children.MethodsWe conceptualised legislative interventions as a complex social interventions and so used the realist synthesis method to systematically review the literature for evidence. 99 articles were found through searches on five electronic databases (MEDLINE, HMIC, EMBASE, PsychINFO, Social Policy and Practice) and iterative purposive searching. Our initial searches sought any studies that contained information on smoking in vehicles carrying children. Throughout the review we continued where needed to search for additional studies of any type that would conceptually contribute to helping build and/or test our framework.ResultsOur framework identified a series of transferable threats to public health legislation. When applied to smoking bans in vehicles; problem misidentification; public support; opposition; and enforcement issues were particularly prominent threats. Our framework enabled us to understand and explain the nature of each threat and to infer the most likely outcome if such legislation were to be proposed in a jurisdiction where no such ban existed. Specifically, the micro-environment of a vehicle can contain highly hazardous levels of second hand smoke. Public support for such legislation is high amongst smokers and non-smokers and their underlying motivations were very similar - wanting to practice the Millian principle of protecting children from harm. Evidence indicated that the tobacco industry was not likely to oppose legislation and arguments that such a law would be 'unenforceable' were unfounded.ConclusionIt is possible to develop a coherent and transferable evidence based framework of the ideas and assumptions behind the threats to legislative intervention that may assist policy and decision makers to analyse and judge if legislation is feasible and/or likely to succeed.

Project description:BackgroundThere is a need to identify evidence-based interventions to be delivered in schools that can be used to improve child and adolescent mental health and wellbeing. Creative bibliotherapy is one proposed intervention. However, there has been, to date, no comprehensive assessment of the evidence for its impact on mental health and wellbeing. To fill this gap, we will conduct a systematic review and realist synthesis.MethodsA systematic search of the bibliographic databases APA PsycINFO, Medline (via Ovid), CINAHL, ERIC, Education Research Complete (via EBSCOhost) and Web of Science (SCI, SSCI, AHCI, ESCI) for school-based creative bibliotherapy interventions on child and adolescent mental health. Types of study to be included: cohort studies, non-randomised comparative evaluations, randomised controlled trials. The data from all included studies will be summarised descriptively and strength of evidence appraised. This is a potentially large field of practice, with heterogeneous interventions; we will use methods from intervention components analysis to describe and categorise the range of components and approaches used in included interventions. To understand how interventions work and in which contexts, we will use methods from realist synthesis to develop an exploratory account of mechanisms in different settings and for different young people (contexts).DiscussionFindings will assess the range of evidence for the impact of creative bibliotherapy on child and adolescent mental health and wellbeing, the strength of evidence for the impact identified, and describe potential mechanisms. This review will be useful for a wide range of stakeholders considering implementing or developing interventions using creative bibliotherapy in school-based settings.Systematic review registrationThis protocol was registered at the International Prospective Register of Systematic Reviews ( https://www.crd.york.ac.uk/prospero/ ), registration number CRD42023410333. This review is funded by Wellcome Trust (221457/Z/20/Z).

Project description:IntroductionDespite the established relationship between physical activity and health, data suggest that many children are insufficiently active, and that levels decline into adolescence. Engaging the family in interventions may increase and maintain children's physical activity levels at the critical juncture before secondary school. Synthesis of existing evidence will inform future studies, but the heterogeneity in target populations recruited, behaviour change techniques and intervention strategies employed, and measurement conducted, may require a multifaceted review method. The primary objective of this work will therefore be to synthesis evidence from intervention studies that explicitly engage the family unit to increase children's physical activity using an innovative dual meta-analysis and realist approach.Methods and analysisPeer-reviewed studies will be independently screened by two authors for inclusion based on (1) including 'healthy' participants aged 5-12 years; (2) having a substantive intervention aim of increasing physical activity, by engaging the family and (3) reporting on physical activity. Duplicate data extraction and quality assessment will be conducted using a specially designed proforma and the Effective Public Health Practice Project Quality Assessment Tool respectively. STATA software will be used to compute effect sizes for meta-analyses, with subgroup analyses conducted to identify moderating characteristics. Realist syntheses will be conducted according to RAMESES quality and publication guidelines, including development of a programme theory and evidence mapping.DisseminationThis review will be the first to use the framework of a traditional review to conduct a dual meta-analysis and realist synthesis, examining interventions that engage the family to increase physical activity in children. The results will be disseminated through peer-reviewed publications, conferences, formal presentations to policy makers and practitioners and informal meetings. Evidence generated from this synthesis will also be used to inform the development of theory-driven, evidence-based interventions aimed at engaging the family to increase physical activity levels in children.Protocol registrationInternational Prospective Register for Systematic Reviews (PROSPERO): number CRD42013005780.

Project description:Context This paper presents a realist synthesis of the literature that began with the objective of developing a theory of workplace learning specific to postgraduate medical education (PME). As the review progressed, we focused on informal learning between trainee and senior doctor or supervisor, asking what mechanisms occur between trainee and senior doctor that lead to the outcomes of PME, and what contexts shape the operation of these mechanisms and the outcomes they produce? Methods We followed the procedures outlined in the RAMESES Publication Standards for Realist Synthesis. We searched the English‐language literature published between 1995 and 2017 for empirical papers related to informal workplace learning between supervisor and trainee, excluding formal interventions such as workplace‐based assessment. We made a pragmatic decision to exclude general practice training to keep the review within manageable limits. Results We reviewed 5197 papers and selected 90. Synthesis revealed three workplace learning processes occurring between supervisors and trainees, each underpinned by a pair of mechanisms: supervised participation in practice (entrustment and support seeking); mutual observation of practice (monitoring and modelling), and dialogue during practice (meaning making and feedback). These mechanisms result in outcomes of PME, including safe participation in practice, learning skills, attitudes and behaviours and professional identity development. Contexts shaping the outcomes of these mechanisms were identified at individual, interpersonal, local and systems levels. Conclusions Our realist theory of workplace learning between supervisors and trainees is informed by theory and empirical research. It highlights the two‐way nature of supervision, the importance of trainees’ agency in their own learning and the deleterious effect of fragmented working patterns on supervisor–trainee learning mechanisms. Further empirical research is required to test and refine this theory. In the meantime, it provides a useful framework for the design of supportive learning environments and for the preparation of supervisors and trainees for their roles in workplace learning. The authors describe a realist theory of learning between supervisor and postgraduate trainee in the workplace, emphasising the role of individual, interpersonal, local and systems contexts in shaping key mechanisms and their outcomes.

Project description:BackgroundThe health system in South Sudan faces extreme domestic resource constraints, low capacity, and protracted humanitarian crises. Supportive supervision is believed to improve the quality of health care and service delivery by compensating for flaws in health workforce management. This study aimed to explore the current supervision practices in South Sudan and identify areas for quality improvement.MethodsThe study employed qualitative approaches to collect and analyse data from six purposefully selected counties. Data were collected from 194 participants using semi-structured interviews (43 health managers) and focus group discussions (151 health workers). Thematic content analysis was used to yield an in-depth understanding of the supervision practices in the health sector.ResultsThe study found that integrated supportive supervision and monitoring visits were the main approaches used for health services supervision in South Sudan. Supportive supervision focused more on health system administration and less on clinical matters. Although fragmented, supportive supervision was carried out quarterly, while monitoring visits were either conducted monthly or ad hoc. Prioritization for supportive supervision was mainly data driven. Paper-based checklists were the most commonly used supervision tools. Many supervisors had no formal training on supportive supervision and only learned on the job. The health workers received on-site verbal feedback and, most times, on-the-job training sessions through coaching and mentorship. Action plans developed during supervision were inadequately followed up due to insufficient funding. Insecurity, poor road networks, lack of competent health managers, poor coordination, and lack of adequate means of transport were some of the challenges experienced during supervision. The presumed outcomes of supportive supervision were improvements in human resource management, drug management, health data reporting, teamwork, and staff respect for one another.ConclusionSupportive supervision remains a daunting task in the South Sudan health sector due to a combination of external and health system factors. Our study findings suggest that strengthening the processes and providing inputs for supervision should be prioritized if quality improvement is to be attained. This necessitates stronger stewardship from the Ministry of Health, integration of different supervision practices, investment in the capacity of the health workforce, and health infrastructure development.

Project description:IntroductionEarly identification and appropriate treatment of child and adolescent mental health disorders can often be hampered by patchwork services with poorly planned or unclear pathways. The Choice and Partnership Approach (CAPA) is an evidence-based transformational model of community (community-based or outpatient) mental health and addictions services for children and adolescents that aims to better match services to needs and to improve timely access to care. CAPA has been variably implemented across jurisdictions but has not been comprehensively evaluated for its impact on system and client outcomes. Our research question is, 'To what degree does CAPA work, for whom and under what circumstances?'. The purpose of this review is twofold: (1) to gain an understanding of the extent and outcomes of the implementation of CAPA in community mental health and addictions services; and (2) to identify the role of context as it influences the implementation of CAPA and resulting client and system outcomes.Methods and analysisWe will conduct a realist-informed scoping review of the literature related to CAPA in either child and adolescent or adult community mental health and addictions services. Relevant studies, reports and documentation will be identified by searching the following online databases: MEDLINE, Embase, CINAHL, PsycINFO, Academic Search Premier, ERIC, Web of Science, Cochrane, Dissertations Abstracts, NCBI Bookshelf, PubMed Central and the Canadian Health Research Collection. The search strategy was developed by a health sciences library scientist and informed by a multidisciplinary team comprising methodological and content knowledge experts. The search will gather evidence from multiple online databases of peer-reviewed literature and grey literature repositories. All articles will be independently assessed for inclusion by pairs of reviewers. The key themes derived from a thematic analysis of extracted data will be presented in a narrative overview.Ethics and disseminationResearch ethics review is not required for this scoping review. The results will be disseminated through meetings with stakeholders (including clients and families, clinicians and decision-makers), conference presentations and peer-reviewed publication. The results of this review will inform an overarching programme of research, policy and quality indicator development to ultimately improve mental health and addictions care and subsequent mental health outcomes for children and adolescents.