Dataset Information

Opening up the black box of a Gateway to Medicine programme: a realist evaluation.

ABSTRACT:

Objectives

A Gateway to Medicine programme, developed in partnership between a further and higher education setting and implemented to increase the socioeconomic diversity of medicine, was examined to identify precisely what works within the programme and why.

Design

This study employed realist evaluation principles and was undertaken in three phases: document analysis and qualitative focus groups with widening access (WA) programme architects; focus groups and interviews with staff and students; generation of an idea of what works.

Setting

Participants were recruited from a further/higher education setting and were either enrolled or involved in the delivery of a Gateway to Medicine programme.

Participants

Twelve staff were interviewed either individually (n=3) or in one of three group interviews. Nine focus groups (ranging from 5 to 18 participants in each focus group) were carried out with Gateway students from three consecutive cohorts at 2-3 points in their Gateway programme year.

Results

Data were generated to determine what 'works' in the Gateway programme. Turning a realist lens on the data identified six inter-relating mechanisms which helped students see medicine as attainable and achievable and prepared them for the transition to medical school. These were academic confidence (M1); developing professional identity (M2); financial support/security (M3); supportive relationships with staff (M4) and peers (M5); and establishing a sense of belonging as a university student (M6).

Conclusions

By unpacking the 'black box' of a Gateway programme through realist evaluation, we have shown that such programmes are not solely about providing knowledge and skills but are rather much more complex in respect to how they work. Further work is needed to further test the mechanisms identified in our study in other contexts for theory development and to identify predictors of effectiveness in terms of students' preparedness to transition.

SUBMITTER: Gibson Smith K

PROVIDER: S-EPMC8280889 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundDigital innovations have shown promise for improving maternal health service delivery. However, low- and middle-income countries are still at the adoption-utilization stage. Evidence on mobile health has been described as a black box, with gaps in theoretical explanations that account for the ecosystem of health care and their effect on adoption mechanisms. Bliss4Midwives, a modular integrated diagnostic kit to support antenatal care service delivery, was piloted for 1 year in Northern Ghana. Although both users and beneficiaries valued Bliss4Midwives, results from the pilot showed wide variations in usage behavior and duration of use across project sites.ObjectiveTo strengthen the design and implementation of an improved prototype, the study objectives were two-fold: to identify causal factors underlying the variation in Bliss4Midwives usage behavior and understand how to overcome or leverage these in subsequent implementation cycles.MethodsUsing a multiple case study design, a realist evaluation of Bliss4Midwives was conducted. A total of 3 candidate program theories were developed and empirically tested in 6 health facilities grouped into low and moderate usage clusters. Quantitative and qualitative data were collected and analyzed using realist thinking to build configurations that link intervention, context, actors, and mechanisms to program outcomes, by employing inductive and deductive reasoning. Nonparametric t test was used to compare the perceived usefulness and perceived ease of use of Bliss4Midwives between usage clusters.ResultsWe found no statistically significant differences between the 2 usage clusters. Low to moderate adoption of Bliss4Midwives was better explained by fear, enthusiasm, and high expectations for service delivery, especially in the absence of alternatives. Recognition from pregnant women, peers, supervisors, and the program itself was a crucial mechanism for device utilization. Other supportive mechanisms included ownership, empowerment, motivation, and adaptive responses to the device, such as realignment and negotiation. Champion users displayed high adoption-utilization behavior in contexts of participative or authoritative supervision, yet used the device inconsistently. Intervention-related (technical challenges, device rotation, lack of performance feedback, and refresher training), context-related (staff turnover, competing priorities, and workload), and individual factors (low technological self-efficacy, baseline knowledge, and internal motivation) suppressed utilization mechanisms.ConclusionsThis study shed light on optimal conditions necessary for Bliss4Midwives to thrive in a complex social and organizational setting. Beyond usability and viability studies, advocates of innovative technologies for maternal care need to consider how implementation strategies and contextual factors, such as existing collaborations and supervision styles, trigger mechanisms that influence program outcomes. In addition to informing scale-up of the Bliss4Midwives prototype, our results highlight the need for interventions that are guided by research methods that account for complexity.

Project description:BackgroundThe health visitors' role in many countries is changing. In Scotland, the role has undergone substantial changes through the introduction of an enhanced health visiting programme, which includes increased, structured home visits. This evaluation was conducted within NHS Ayrshire and Arran, one of the 14 Scottish Health Boards. Our aim was to understand and explain how, and why, the programme could contribute to improving health and wellbeing outcomes for children and families.MethodsWe used a realist evaluation approach, conducted in three phases. In phase one, eight managerial staff involved in developing and implementing the programme provided data, which were used to develop initial programme theories. In phase two, the programme theories were tested using qualitative data from 25 health visitors and 22 parents. The programme theories were refined through analyses and interpretation of data in phase three.ResultsThe home visiting context provided by the programme interacted with the mechanisms of the programme and produced outcomes such as early identification of health and wellbeing issues amongst families who needed more support, leading to referral and engagement with sources of additional help. The home visits facilitated development of parent-health visitor relationships, and parents considered health visitors as their first point of contact on children's wellbeing and developmental-related issues. Moreover, the programme provided more clarity to health visitors' role, which in turn enhanced partnership working. However, there were aspects of the programme that may require further development. For instance, both parents and health visitors were concerned about the wide gaps between some home visits.ConclusionsThe enhanced health visiting programme increased opportunities for monitoring and early identification of health and wellbeing concerns. It created structures for a more efficient partnership working and ensured that the needs of children and families were supported. These benefits need to be evaluated further in an effectiveness study.