Dataset Information

Effectiveness of tutor shadowing on faculty development in problem-based learning.

ABSTRACT:

Background

To enhance tutors' teaching skills, tutor shadowing for novice tutors of problem-based learning (PBL) in addition to conventional faculty development (FD) was applied. This study aimed to develop a tutoring-skill scale (TS-scale) and evaluate the effect of shadowing on PBL tutors.

Methods

This study employed a before-and-after study design with three phases. In phase 1, a TS-scale was elaborated. A validity examination was performed in phase 2. Phase 3 was a study of the effectiveness using a TS-scale survey of novice PBL tutors before and after the FD course. The FD course for novice PBL tutors included an FD workshop and PBL shadowing activities.

Results

A TS-scale with a 32-item questionnaire of self-rated confidence for PBL tutors was identified in phase 1. In phase 2, 7 experienced specialists in medical education were invited to evaluate the content validity of the scale. The item content validity index (I-CVI) ranged from 0.86 to 1, and the scale-CVI (S-CVI) was 0.95. A total of 85 novice PBL tutors completed the TS-scale before the FD course, yielding a Cronbach's alpha of 0.98. An exploratory factor analysis with varimax rotation was performed. The twenty-four items with significant loadings greater than 0.5 were incorporated into a new TS-scale and were grouped into three factors: student contact, medical expertise, and teaching expertise. In phase 3, 76 novice PBL tutors completed the 24-item TS-scale before (pretest) and after (posttest) the FD course. Their self-rated confidence improved significantly across the three factors after the FD course. The pretest and posttest scores did not differ according to the tutors' gender, the grades they taught, or their specialty background.

Conclusions

Novice PBL tutors benefit from FD that incorporates tutor shadowing in the 3 key domains of tutoring competencies. The TS-scale developed in this study can be applied in future research on FD design.

SUBMITTER: Tsai CL

PROVIDER: S-EPMC9306026 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundUltrasound education is propagated already during medical school due to its diagnostic importance. Courses are usually supervised by experienced faculty staff (FS) with patient bedside examinations or students among each other but often overbooked due to limited FS availability. To overcome this barrier, use of teaching videos may be advantageous. Likewise, peer teaching concepts solely with trained student tutors have shown to be feasible and effective. The aim was to evaluate 1) objective learning outcomes of a combined video-based, student-tutor (ViST) as compared to a FS-led course without media support, 2) acceptance and subjective learning success of the videos.MethodsTwo ultrasound teaching videos for basic and advanced abdominal ultrasound (AU) and transthoracic echocardiography (TTE) were produced and six students trained as tutors. Fourth-year medical students (N = 96) were randomized to either the ViST- or FS course (6 students per tutor). Learning objectives were defined equally for both courses. Acquired practical basic and advanced ultrasound skills were tested in an objective structured clinical examination (OSCE) using modified validated scoring sheets with a maximum total score of 40 points. Acceptance and subjective learning success of both videos were evaluated by questionnaires based on Kirkpatrick's evaluation model with scale-rated closed and open questions.Results79 of 96 medical students completed the OSCE and 77 could be finally analyzed. There was no significant difference in the mean total point score of 31.3 in the ViST (N = 42) and 32.7 in the FS course (N = 35, P = 0.31) or in any of the examined basic or advanced ultrasound skill subtasks. Of the 42 ViST participants, 29 completed the AU and 27 the TTE video questionnaire. Acceptance and subjective learning success of both videos was rated positively in 14-52% and 48-88% of the rated responses to each category, respectively. Attendance of either the student or faculty tutor was deemed necessary in addition to the videos.ConclusionsA ViST versus FS teaching concept was able to effectively teach undergraduate students in AU and TTE, albeit acceptance of the teaching videos alone was limited. However, the ViST concept has the potential to increase course availability and FS resource allocation.

Project description:BackgroundProblem-based learning (PBL) is a pedagogy involving self-directed learning in small groups around case problems. Group function is important to PBL outcomes, but there is currently poor scaffolding around key self-reflective practices that necessarily precedes students' and tutors' attempts to improve group function. This study aims to create a structured, literature-based and stakeholder-informed tool to help anchor reflective practices on group function. This article reports on the development process and perceived utility of this tool.MethodsTool development unfolded in four steps: 1) a literature review was conducted to identify existent evaluation tools for group function in PBL, 2) literature findings informed the development of this new tool, 3) a group of PBL experts were consulted for engagement with and feedback of the tool, 4) four focus groups of stakeholders (medical students and tutors with lived PBL experiences) commented on the tool's constructs, language, and perceived utility. The tool underwent two rounds of revisions, informed by the feedback from experts and stakeholders.ResultsNineteen scales relating to group function assessment were identified in the literature, lending 18 constructs that mapped into four dimensions: Learning Climate, Facilitation and Process, Engagement and Interactivity, and Evaluation and Group Improvement. Feedback from experts informed the addition of missing items. Focus group discussions allowed further fine-tuning of the organization and language of the tool. The final tool contains 17 descriptive items under the four dimensions. Users are asked to rate each dimension holistically on a 7-point Likert scale and provide open comments. Researchers, faculty, and students highlighted three functions the tool could perform: (1) create space, structure, and language for feedback processes, (2) act as a reference, resource, or memory aid, and (3) serve as a written record for longitudinal benchmarking. They commented that the tool may be particularly helpful for inexperienced and poor-functioning groups, and indicated some practical implementation considerations.ConclusionA four-dimension tool to assist group function reflection in PBL was produced. Its constructs were well supported by literature and experts. Faculty and student stakeholders acknowledged the utility of this tool in addressing an acknowledged gap in group function reflection in PBL.