Dataset Information

Development of the Feedback Quality Instrument: a guide for health professional educators in fostering learner-centred discussions.

ABSTRACT:

Background

Face-to-face feedback plays an important role in health professionals' workplace learning. The literature describes guiding principles regarding effective feedback but it is not clear how to enact these. We aimed to create a Feedback Quality Instrument (FQI), underpinned by a social constructivist perspective, to assist educators in collaborating with learners to support learner-centred feedback interactions. In earlier research, we developed a set of observable educator behaviours designed to promote beneficial learner outcomes, supported by published research and expert consensus. This research focused on analysing and refining this provisional instrument, to create the FQI ready-to-use.

Methods

We collected videos of authentic face-to-face feedback discussions, involving educators (senior clinicians) and learners (clinicians or students), during routine clinical practice across a major metropolitan hospital network. Quantitative and qualitative analyses of the video data were used to refine the provisional instrument. Raters administered the provisional instrument to systematically analyse educators' feedback practice seen in the videos. This enabled usability testing and resulted in ratings data for psychometric analysis involving multifaceted Rasch model analysis and exploratory factor analysis. Parallel qualitative research of the video transcripts focused on two under-researched areas, psychological safety and evaluative judgement, to provide practical insights for item refinement. The provisional instrument was revised, using an iterative process, incorporating findings from usability testing, psychometric testing and parallel qualitative research and foundational research.

Results

Thirty-six videos involved diverse health professionals across medicine, nursing and physiotherapy. Administering the provisional instrument generated 174 data sets. Following refinements, the FQI contained 25 items, clustered into five domains characterising core concepts underpinning quality feedback: set the scene, analyse performance, plan improvements, foster learner agency, and foster psychological safety.

Conclusions

The FQI describes practical, empirically-informed ways for educators to foster quality, learner-centred feedback discussions. The explicit descriptions offer guidance for educators and provide a foundation for the systematic analysis of the influence of specific educator behaviours on learner outcomes.

SUBMITTER: Johnson CE

PROVIDER: S-EPMC8276464 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ProblemWritten feedback is often overly positive, nonspecific, and difficult to interpret. Learner satisfaction with written feedback is low and obtaining written feedback that encourages self-reflection is challenging. Improving feedback quality is laborious and only modestly effective.ApproachThe authors developed the LEAF (Learner-Engaged Analysis of Feedback) method to improve learner satisfaction with, and reflection on, existing written feedback. The method pairs a learner and coach to methodically identify themes in the learner's written feedback. Themes occurring more frequently or less frequently than typical offer areas for reflection, as they may identify learners' relative strengths or weaknesses. The method was introduced at the Massachusetts General Hospital in 2017 during program director (PD) meetings with anesthesiology residents. In 2018, resident satisfaction was measured (1 to 5 Likert-type questions, 1 = "not at all satisfied," 5 = "extremely satisfied") for 4 feedback sources, 2 related to the LEAF method (PD meetings, written feedback) and 2 unrelated (verbal feedback, mentor feedback). Residents' comments were qualitatively assessed to explore the impact on self-reflection.OutcomesResidents who had participated in a LEAF session (n = 54), compared with those who had not (n = 11), reported higher satisfaction with written feedback (mean 3.1 versus 2.5, d = 0.53, P = .03) and PD meeting feedback (mean 3.8 versus 2.8, d = 0.80, P = .03). There were no significant differences between groups for satisfaction with feedback unrelated to the LEAF method. Qualitative analysis of comments suggested that residents found the method useful for providing holistic self-assessment, facilitating goal setting, uncovering blind spots, and improving feedback interpretation.Next stepsNext steps should include studies determining if the association between increased learner satisfaction with written feedback and the LEAF method is causal, and whether this feedback process changes learners' subsequent behaviors.

Project description:BackgroundTo review systematically the published literature relating to interventions informed by patient feedback for improvement to quality of care in hospital settings.MethodsA systematic search was performed in the CINAHL, EMBASE, PsyInfo, MEDLINE, Cochrane Libraries, SCOPUS and Web of Science databases for English-language publications from January 2008 till October 2018 using a combination of MeSH-terms and keywords related to patient feedback, quality of health care, patient-centred care, program evaluation and public hospitals. The quality appraisal of the studies was conducted with the MMAT and the review protocol was published on PROSPERO. Narrative synthesis was used for evaluation of the effectiveness of the interventions on patient-centred quality of care.ResultsTwenty papers reporting 20 studies met the inclusion criteria, of these, there was one cluster RCT, three before and after studies, four cross-sectional studies and 12 organisational case studies. In the quality appraisal, 11 studies were rated low, five medium and only two of high methodological quality. Two studies could not be appraised because insufficient information was provided. The papers reported on interventions to improve communication with patients, professional practices in continuity of care and care transitions, responsiveness to patients, patient education, the physical hospital environment, use of patient feedback by staff and on quality improvement projects. However, quantitative outcomes were only provided for interventions in the areas of communication, professional practices in continuity of care and care transitions and responsiveness to patients. Multi-component interventions which targeted both individual and organisational levels were more effective than single interventions. Outcome measures reported in the studies were patient experiences across various diverse dimensions including, communication, responsiveness, coordination of and access to care, or patient satisfaction with waiting times, physical environment and staff courtesy.ConclusionOverall, it was found that there is limited evidence on the effectiveness of interventions, because few have been tested in well-designed trials, very few papers described the theoretical basis on which the intervention had been developed. Further research is needed to understand the choice and mechanism of action of the interventions used to improve patient experience.