Dataset Information

Leadership Observation and Feedback Tool: A Novel Instrument for Assessment of Clinical Leadership Skills.

ABSTRACT: Background :While leadership training is increasingly incorporated into residency education, existing assessment tools to provide feedback on leadership skills are only applicable in limited contexts. Objective :We developed an instrument, the Leadership Observation and Feedback Tool (LOFT), for assessing clinical leadership. Methods :We used an iterative process to develop the tool, beginning with adapting the Leadership Practices Inventory to create an open-ended survey for identification of clinical leadership behaviors. We presented these to leadership experts who defined essential behaviors through a modified Delphi approach. In May 2014 we tested the resulting 29-item tool among residents in the internal medicine and pediatrics departments at 2 academic medical centers. We analyzed instrument performance using Cronbach's alpha, interrater reliability using intraclass correlation coefficients (ICCs), and item performance using linear-by-linear test comparisons of responses by postgraduate year, site, and specialty. Results :A total of 377 (of 526, 72%) team members completed the LOFT for 95 (of 519, 18%) residents. Overall ratings were high-only 14% scored at the novice level. Cronbach's alpha was 0.79, and the ICC ranged from 0.20 to 0.79. Linear-by-linear test comparisons revealed significant differences between postgraduate year groups for some items, but no significant differences by site or specialty. Acceptability and usefulness ratings by respondents were high. Conclusions :Despite a rigorous approach to instrument design, we were unable to collect convincing validity evidence for our instrument. The tool may still have some usefulness for providing formative feedback to residents on their clinical leadership skills.

SUBMITTER: Oza SK

PROVIDER: S-EPMC6194892 | biostudies-other | 2018 Oct

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Leadership Observation and Feedback Tool: A Novel Instrument for Assessment of Clinical Leadership Skills.

Oza Sandra K SK van Schaik Sandrijn S Boscardin Christy K CK Pierce Read R Miao Edna E Lockspeiser Tai T Tad-Y Darlene D Aagaard Eva E Kuo Anda K AK

Journal of graduate medical education 20181001 5

<h4>Background</h4>While leadership training is increasingly incorporated into residency education, existing assessment tools to provide feedback on leadership skills are only applicable in limited contexts.<h4>Objective</h4>We developed an instrument, the Leadership Observation and Feedback Tool (LOFT), for assessing clinical leadership.<h4>Methods</h4>We used an iterative process to develop the tool, beginning with adapting the Leadership Practices Inventory to create an open-ended survey for ...[more]

PMID: 30386485

Similar Datasets

Project description:BackgroundThere is a need to improve students' learning in clinical practice. Undergraduate students need guidance when it comes to transferring knowledge from the classroom to clinical practice in community health services. Competence Development of Practical Procedures (COPPs), a simulation assessment tool, was used to explore students' and preceptors' experiences with feedback and reflection during the supervision of clinical skills in real practice.MethodThis was a pilot study with a qualitative exploratory and descriptive research design. Four students in their first year of a bachelor's programme in nursing and four preceptors participated. Data were collected from eight clinical skills performance assessments, audio recordings of supervision, and open-ended questionnaires. Data were systematized, categorized, and analysed using qualitative content analysis. Findings. Participants' experiences were divided into five categories: "learning environment, an atmosphere of respect, acceptance, and encouragement," "students' reflections on their own personal learning," "students' reflections on various care situations," and "students' and preceptors' assessment and feedback." Participants found COPPs easy to use and providing structure for assessment, feedback, and reflection during supervision. Concepts related to learning clinical skills became visible for both students and preceptors and helped students assess their performance of clinical skills. Through verbalization and reflection in supervision, participants established a consensus around what students knew and what they needed to learn.ConclusionsThe students and preceptors experienced the tool as a supportive structure to enhance feedback and reflection for the learning of clinical skills in municipal healthcare services. COPPs filled a gap in practice by providing a language for students and preceptors to articulate their knowledge and increasing students' awareness of what constitutes a good performance. The tool supported the coherence of concepts, enhanced clinical reasoning, and promoted deeper thinking and reflection, and the students gained insight into their own needs related to learning clinical skills.

Project description:BackgroundMedical student needs in clinical skill training may change over time, but data on this topic are limited. This study uses repeated self-assessments on clinical rotations during medical school to evaluate students' perceptions of their clinical skill growth.MethodsA self-assessment rating was completed by students during each clinical rotation as they progressed through their core clinical rotation year. The instrument consisted of questions on 5 clinical skill categories where students rated their performance as "below", "at" or "above" expected, and open-ended questions on strengths and challenges. We evaluated changes in self-ratings between the first (n=136) and third (n=118) quarters by matched-pair analysis of the shift in responses between time points using a Sign Test. We also identified the main themes from the students' responses to open-ended questions.ResultsWe found 22.4 % and 13.3 % of students increased their self-assessment ratings on "Oral Presentation Skills" and on "Differential Diagnosis", respectively. In contrast, perceived ability to communicate with patients saw the largest negative shifts. "Patient Interaction" was the most commonly identified area of strength and "Knowledge and Organization" was most frequently cited as a barrier.ConclusionsStudents demonstrated a positive shift in perceived competence in some core clinical skills that are not strongly emphasized in the preclinical curriculum, likely reflecting increased exposure over time. However, their perceived competence in communication skills declined. This may reflect initial over-estimation or true decline due to competing needs/interests. These patterns of change can inform the design of longitudinal curricula that anticipate and address students' needs during clinical rotations, such as placing increased emphasis on presentation skills and differential diagnosis earlier in the curriculum, and adding more emphasis to communication skills in later phases.

Project description:BACKGROUND:Pre-recorded videotapes have become the standard approach when teaching clinical communication skills (CCS). Furthermore, video-based feedback (VF) has proven to be beneficial in formative assessments. However, VF in CCS with the use of pre-recorded videos from real-life settings is less commonly studied than the use of simulated patients. To explore: 1) perceptions about the potential benefits and challenges in this kind of VF; 2) differences in the CCC scores in first-year medical residents in primary care, before and after a communication program using VF in a curricular formative assessment. METHOD:We conducted a pre/post study with a control group. The intervention consisted of VF sessions regarding CCS, performed in a small group with peers and a facilitator. They reviewed clinical consultations pre-recorded in a primary care setting with real patients. Before and after the intervention, 54 medical residents performed two clinical examinations with simulated patients (SP), answered quantitative scales (Perception of Patient-Centeredness and Jefferson Empathy Scale), and semi-structured qualitative questionnaires. The performances were scored by SP (Perception of Patient-Centeredness and CARE scale) and by two blind raters (SPIKES protocol-based and CCOG-based scale). The quantitative data analysis employed repeated-measures ANOVA. The qualitative analysis used the Braun and Clarke framework for thematic analysis. RESULTS:The quantitative analyses did not reveal any significant differences in the sum scores of the questionnaires, except for the Jefferson Empathy Scale. In the qualitative questionnaires, the main potential benefits that emerged from the thematic analysis of the VF method were self-perception, peer-feedback, patient-centered approach, and incorporation of reflective practices. A challenging aspect that emerged from facilitators was the struggle to relate the VF with theoretical references and the resident's initial stress to record and watch oneself on video. CONCLUSION:VF taken from real-life settings seems to be associated with a significant increase in self-perceived empathy. The study of other quantitative outcomes related to this VF intervention needs larger sample sizes. VF with clinical patients from real healthcare settings appears to be an opportunity for a deeper level of self-assessment, peer-feedback, and reflective practices.

Dataset Information

Leadership Observation and Feedback Tool: A Novel Instrument for Assessment of Clinical Leadership Skills.

Publications

Leadership Observation and Feedback Tool: A Novel Instrument for Assessment of Clinical Leadership Skills.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure