Dataset Information

Making the Grade: Using Instructional Feedback and Evaluation to Inspire Evidence-Based Teaching.

ABSTRACT: Typically, faculty receive feedback about teaching via two mechanisms: end-of-semester student evaluations and peer observation. However, instructors require more sustained encouragement and constructive feedback when implementing evidence-based teaching practices. Our study goal was to characterize the landscape of current instructional-feedback practices in biology and uncover faculty perceptions about these practices. Findings from a national survey of 400 college biology faculty reveal an overwhelming dissatisfaction with student evaluations, regardless of self-reported teaching practices, institution type, or position. Faculty view peer evaluations as most valuable, but less than half of faculty at doctoral-granting institutions report participating in peer evaluation. When peer evaluations are performed, they are more supportive of evidence-based teaching than student evaluations. Our findings reveal a large, unmet desire for greater guidance and assessment data to inform pedagogical decision making. Informed by these findings, we discuss alternate faculty-vetted feedback strategies for providing formative instructional feedback.

SUBMITTER: Brickman P

PROVIDER: S-EPMC5132372 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Making the Grade: Using Instructional Feedback and Evaluation to Inspire Evidence-Based Teaching.

Brickman Peggy P Gormally Cara C Martella Amedee Marchand AM

CBE life sciences education 20160101 4

Typically, faculty receive feedback about teaching via two mechanisms: end-of-semester student evaluations and peer observation. However, instructors require more sustained encouragement and constructive feedback when implementing evidence-based teaching practices. Our study goal was to characterize the landscape of current instructional-feedback practices in biology and uncover faculty perceptions about these practices. Findings from a national survey of 400 college biology faculty reveal an ov ...[more]

PMID: 27909025

Similar Datasets

Project description:BackgroundAccurate diagnosis is a fundamental aspect of appropriate healthcare. However, clinicians need guidance when implementing diagnostic tests given the number of tests available and resource constraints in healthcare. Practitioners of health often feel compelled to implement recommendations in guidelines, including recommendations about the use of diagnostic tests. However, the understanding about diagnostic tests by guideline panels and the methodology for developing recommendations is far from completely explored. Therefore, we evaluated the factors that guideline developers and users need to consider for the development of implementable recommendations about diagnostic tests.MethodsUsing a critical analysis of the process, we present the results of a case study using the Grading of Recommendations Applicability, Development and Evaluation (GRADE) approach to develop a clinical practice guideline for the diagnosis of Cow Milk Allergy with the World Allergy Organization.ResultsTo ensure that guideline panels can develop informed recommendations about diagnostic tests, it appears that more emphasis needs to be placed on group processes, including question formulation, defining patient-important outcomes for diagnostic tests, and summarizing evidence. Explicit consideration of concepts of diagnosis from evidence-based medicine, such as pre-test probability and treatment threshold, is required to facilitate the work of a guideline panel and to formulate implementable recommendations.DiscussionThis case study provides useful guidance for guideline developers and clinicians about what they ought to demand from clinical practice guidelines to facilitate implementation and strengthen confidence in recommendations about diagnostic tests. Applying a structured framework like the GRADE approach with its requirement for transparency in the description of the evidence and factors that influence recommendations facilitates laying out the process and decision factors that are required for the development, interpretation, and implementation of recommendations about diagnostic tests.

Project description:BACKGROUND: Residents-as-teachers (RATs) programs have been shown to improve trainees' teaching skills, yet these decline over time. INTERVENTION: We adapted a commercial Web-based system to maintain resident teaching skills through reflection and deliberate practice and assessed the system's ability to (1) prevent deterioration of resident teaching skills and (2) provide information to improve residents' teaching skills and teaching program quality. METHODS: Ten first-year obstetrics-gynecology (Ob-Gyn) residents participated in a RATs program. Following the program, they used a commercial evaluation system to complete self-assessments of their teaching encounters with medical students. Students also evaluated the residents. To assess the system's effectiveness, we compared these residents to historical controls with an Objective Structured Teaching Examination (OSTE) and analyzed the ratings and the free text comments of residents and students to explore teaching challenges and improve the RATs program. RESULTS: The intervention group outscored the control group on the OSTE (mean score ± SD = 81 ± 8 versus 74 ± 7; P = .05, using a 2-tailed Student t-test). Rating scale analysis showed resident self-assessments were consistently lower than student evaluations, with the difference reaching statistical significance in 3 of 6 skills (P < .05). Comments revealed that residents most valued using innovative teaching techniques, while students most valued a positive educational climate and interpersonal connections with residents. Recommended targets for RATs program improvement included teaching feedback, time-limited teaching, and modeling professionalism behaviors. CONCLUSIONS: Our novel electronic Web-based reinforcement system shows promise in preventing deterioration of resident teaching skills learned during an Ob-Gyn RATs program. The system also was effective in gaining resident and student insights to improve RATs programs. Because our intervention was built upon a commercially available program, our approach could prove useful to the large population of current subscribers.

Project description:Study objectivesTo better understand the sometimes catastrophic effects of sleep loss on naturalistic decision making, we investigated effects of sleep deprivation on decision making in a reversal learning paradigm requiring acquisition and updating of information based on outcome feedback.DesignSubjects were randomized to a sleep deprivation or control condition, with performance testing at baseline, after 2 nights of total sleep deprivation (or rested control), and following 2 nights of recovery sleep. Subjects performed a decision task involving initial learning of go and no go response sets followed by unannounced reversal of contingencies, requiring use of outcome feedback for decisions. A working memory scanning task and psychomotor vigilance test were also administered.SettingSix consecutive days and nights in a controlled laboratory environment with continuous behavioral monitoring.SubjectsTwenty-six subjects (22-40 y of age; 10 women).InterventionsThirteen subjects were randomized to a 62-h total sleep deprivation condition; the others were controls.Measurements and resultsUnlike controls, sleep deprived subjects had difficulty with initial learning of go and no go stimuli sets and had profound impairment adapting to reversal. Skin conductance responses to outcome feedback were diminished, indicating blunted affective reactions to feedback accompanying sleep deprivation. Working memory scanning performance was not significantly affected by sleep deprivation. And although sleep deprived subjects showed expected attentional lapses, these could not account for impairments in reversal learning decision making.ConclusionsSleep deprivation is particularly problematic for decision making involving uncertainty and unexpected change. Blunted reactions to feedback while sleep deprived underlie failures to adapt to uncertainty and changing contingencies. Thus, an error may register, but with diminished effect because of reduced affective valence of the feedback or because the feedback is not cognitively bound with the choice. This has important implications for understanding and managing sleep loss-induced cognitive impairment in emergency response, disaster management, military operations, and other dynamic real-world settings with uncertain outcomes and imperfect information.

Dataset Information

Making the Grade: Using Instructional Feedback and Evaluation to Inspire Evidence-Based Teaching.

Publications

Making the Grade: Using Instructional Feedback and Evaluation to Inspire Evidence-Based Teaching.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets