Mitigating gender bias in student evaluations of teaching.
Ontology highlight
ABSTRACT:
SUBMITTER: Peterson DAM
PROVIDER: S-EPMC6519786 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
Publications
Mitigating gender bias in student evaluations of teaching.
Peterson David A M DAM Biederman Lori A LA Andersen David D Ditonto Tessa M TM Roe Kevin K
PloS one 20190515 5
Student evaluations of teaching are widely believed to contain gender bias. In this study, we conduct a randomized experiment with the student evaluations of teaching in four classes with large enrollments, two taught by male instructors and two taught by female instructors. In each of the courses, students were randomly assigned to either receive the standard evaluation instrument or the same instrument with language intended to reduce gender bias. Students in the anti-bias language condition h ...[more]
Similar Datasets
Project description:Gendered and racial inequalities persist in even the most progressive of workplaces. There is increasing evidence to suggest that all aspects of employment, from hiring to performance evaluation to promotion, are affected by gender and cultural background. In higher education, bias in performance evaluation has been posited as one of the reasons why few women make it to the upper echelons of the academic hierarchy. With unprecedented access to institution-wide student survey data from a large public university in Australia, we investigated the role of conscious or unconscious bias in terms of gender and cultural background. We found potential bias against women and teachers with non-English speaking backgrounds. Our findings suggest that bias may decrease with better representation of minority groups in the university workforce. Our findings have implications for society beyond the academy, as over 40% of the Australian population now go to university, and graduates may carry these biases with them into the workforce.
| S-EPMC6373838 | biostudies-literature
Project description:Anonymous student evaluations of teaching (SETs) are used by colleges and universities to measure teaching effectiveness and to make decisions about faculty hiring, firing, re-appointment, promotion, tenure, and merit pay. Although numerous studies have found that SETs correlate with various teaching effectiveness irrelevant factors (TEIFs) such as subject, class size, and grading standards, it has been argued that such correlations are small and do not undermine the validity of SETs as measures of professors' teaching effectiveness. However, previous research has generally used inappropriate parametric statistics and effect sizes to examine and to evaluate the significance of TEIFs on personnel decisions. Accordingly, we examined the influence of quantitative vs. non-quantitative courses on SET ratings and SET based personnel decisions using 14,872 publicly posted class evaluations where each evaluation represents a summary of SET ratings provided by individual students responding in each class. In total, 325,538 individual student evaluations from a US mid-size university contributed to theses class evaluations. The results demonstrate that class subject (math vs. English) is strongly associated with SET ratings, has a substantial impact on professors being labeled satisfactory vs. unsatisfactory and excellent vs. non-excellent, and the impact varies substantially depending on the criteria used to classify professors as satisfactory vs. unsatisfactory. Professors teaching quantitative courses are far more likely not to receive tenure, promotion, and/or merit pay when their performance is evaluated against common standards.
| S-EPMC5426349 | biostudies-literature
Project description:Student evaluation of teaching (SET) is widely used to assess teaching effectiveness in higher education and can significantly influence professors' career outcomes. Although earlier evidence suggests SET may suffer from biases due to the gender of professors, there is a lack of large-scale examination to understand how and why gender disparities occur in SET. This study aims to address this gap in SET by analyzing approximately 9 million SET reviews from RateMyProfessors.com under the theoretical frameworks of role congruity theory and shifting standards theory. Our multiple linear regression analysis of the SET numerical ratings confirms that women professors are generally rated lower than men in many fields. Using the Dunning log-likelihood test, we show that words used in student comments vary by the gender of professors. We then use BERTopic to extract the most frequent topics from one- and five-star reviews. Our regression analysis based on the topics reveals that the probabilities of specific topics appearing in SET comments are significantly associated with professors' genders, which aligns with gender role expectations. Furtherly, sentiment analysis indicates that women professors' comments are more positively or negatively polarized than men's across most extracted topics, suggesting students' evaluative standards are subject to professors' gender. These findings contextualize the gender gap in SET ratings and caution the usage of SET in related decision-making to avoid potential systematic biases towards women professors.
| S-EPMC10019737 | biostudies-literature
Project description:BACKGROUND:In a whole-of-system approach to evaluation of teaching across any degree, multiple sources of information can help develop an educators' understanding of their teaching quality. In the health professions, student evaluations of clinical teaching are commonplace. However, self-evaluation of teaching is less common, and exploration of clinical educators' self-efficacy even less so. The aim of the study was to evaluate how a clinical educator's self-evaluation of teaching intersects with their self-efficacy, to ascertain if that matches student evaluation of their teaching. This information may assist in facilitating targeted professional development to improve teaching quality. METHODS:Clinical educators in the osteopathy program at Victoria University (VU) were invited to complete: a) self-evaluation version of the Osteopathy Clinical Teaching Questionnaire (OCTQ); and b) the Self-Efficacy in Clinical Teaching (SECT) questionnaire. Students in the VU program completed the OCTQ for each of the clinical educators they worked with during semester 2, 2017. RESULTS:Completed OCTQ and SECT were received from 37 clinical educators. These were matched with 308 student evaluations (mean of 6 student ratings per educator). Three possible educator cohorts were identified: a) high clinical eductor self-OCTQ with low student evaluation; b) low clinical educator self-evaluation and high student evaluations; and, c) no difference between self- and student evaulations. Clinical educators in the first cohort demonstrated significantly higher SECT subscale scores (effect size >?0.42) than their colleagues. Age, gender, teaching qualification, and years practicing or years as a clinical educator were not associated with clinical educator OCTQ scores or the SECT subscales. CONCLUSIONS:Targeted professional development directed towards fostering self-efficacy may provide an avenue for engaging those clinical educators whose self-efficacy is low and/or those who did not receive high student evaluations. Given there is no gold standard measure of clinical teaching quality, educators should engage with multiple sources of feedback to benchmark their current performance level, and identify opportunities to improve. Student and self-evaluations using the OCTQ and evaluation of self-efficacy using the SECT, are useful tools for inclusion in a whole-of-system approach to evaluation of the clinical learning environment.
| S-EPMC7542963 | biostudies-literature
Project description:The transition from medical school to residency is a critical step in the careers of physicians. Because of the standardized application process-wherein schools submit summative Medical Student Performance Evaluations (MSPE's)-it also represents a unique opportunity to assess the possible prevalence of racial and gender disparities, as shown elsewhere in medicine.The authors conducted textual analysis of MSPE's from 6,000 US students applying to 16 residency programs at a single institution in 2014-15. They used custom software to extract demographic data and keyword frequency from each MSPE. The main outcome measure was the proportion of applicants described using 24 pre-determined words from four thematic categories ("standout traits", "ability", "grindstone habits", and "compassion").The data showed significant differences based on race and gender. White applicants were more likely to be described using "standout" or "ability" keywords (including "exceptional", "best", and "outstanding") while Black applicants were more likely to be described as "competent". These differences remained significant after controlling for United States Medical Licensing Examination Step 1 scores. Female applicants were more frequently described as "caring", "compassionate", and "empathic" or "empathetic". Women were also more frequently described as "bright" and "organized".While the MSPE is intended to reflect an objective, summative assessment of students' qualifications, these data demonstrate for the first time systematic differences in how candidates are described based on racial/ethnic and gender group membership. Recognizing possible implicit biases and their potential impact is important for faculty who strive to create a more egalitarian medical community.
| S-EPMC5549898 | biostudies-other
Project description:Identifying what motivates and hinders higher education instructors in their self-regulated learning from student evaluations of teaching (SETs) is important for improving future teaching and facilitating student learning. According to models of self-regulated learning, we propose a model for the usage of SETs as a learning situation. In a longitudinal study, we investigate the associations between achievement goals and the usage of and learning from SETs in the context of higher education. In total, 407 higher education instructors (46.4% female; 38.60 years on average) with teaching commitments in Germany or Austria reported their achievement goals in an online survey. Out of these participants, 152 instructors voluntarily conducted SET(s) and subsequently reported their intentions to act on the feedback and improve future teaching in a short survey. Using structural equation modeling, we found, in line with our hypotheses, that learning avoidance, appearance approach, and appearance avoidance goals predicted whether instructors voluntarily conducted SET(s). As expected, learning approach and (avoidance) goals were positively associated with intentions to act on received SET-results and improve future teaching. These findings support our hypotheses, are in line with assumptions of self-regulated learning models, and highlight the importance of achievement goals for instructors' voluntary usage of and intended learning from SET(s). To facilitate instructors' learning from SET-results, our study constitutes a first step for future intervention studies to build on. Future researchers and practitioners might support instructors' professional learning by encouraging them to reflect on their SET-results.
| S-EPMC8329422 | biostudies-literature
Project description:IntroductionSimulation is a valuable and novel tool in the expanding approach to racism and bias education for medical practitioners. We present a simulation case focused on identifying and addressing the implicit bias of a consultant to teach bias mitigation skills and limit harm to patients and families.MethodsLearners were presented with a case of a classic toddler's fracture in an African American child. The learners interacted with an orthopedic resident who insisted on child welfare involvement, with nonspecific and increasingly biased concerns about the child/family. The learners were expected to identify that this case was not concerning for nonaccidental trauma and that the orthopedic resident was demonstrating bias. They were expected to communicate with both the resident and the parent effectively to defuse the situation and prevent harm from reaching the family. A debrief and an anonymous survey followed the case.ResultsSeventy-five learners participated, including pediatric and emergency medicine residents, fellows, attendings, and medical students. After the case, the majority of learners expressed confidence that they could recognize racial bias in the care of a patient (90%), ensure patient care was not influenced by racial bias (88%), and utilize a tool to frame a concern about bias (79%).DiscussionParticipants felt that this simulation was relevant and effective and overall left the experience feeling confident in their abilities to identify and manage racially biased patient care. This anti-racist simulation offers an important skill-building opportunity that has been well received by learners.
| S-EPMC10507144 | biostudies-literature
Project description:BackgroundTransgender and gender diverse (TGD) people face many obstacles in accessing health care, including discrimination, institutional bias, and clinician knowledge deficits. We developed a clinical skills and education module on gender-affirming care for pre-clinical medical students, in collaboration with a TGD-led civil society organisation. The module consisted of an educational session followed by preceptor-facilitated small group tutorials, led by TGD patient-educators (n = 22) who used their lived experience to explore medical history-taking and broader issues related to TGD healthcare with students (n = 199). This study aimed to explore the views of students and TGD patient-educators on the structure, delivery and impact of the module.MethodsAnalysis of responses of TGD patient-educators and students to the module (2020 and 2021), in post-intervention surveys using open-ended questions for TGD patient-educators (18 responses from 22 educators) and free text comments as part of a quantitative survey for medical students (89 responses).ResultsResponses from students and patient-educators to the session were highly positive. Students and patient-educators emphasised that the teaching session succeeded through elevating the centrality of shared experience and creating a safe space for learning and teaching. Safety was experienced by patient-educators through the recognition of their own expertise in a medical environment, while students reported a non-judgemental teaching space which allowed them to explore and redress recognised limitations in knowledge and skill. Patient-educators described their motivation to teach as being driven by a sense of responsibility to their community. Preceptor attitudes may function as a barrier to the effectiveness of this teaching, and further attention should be paid to supporting the education of clinical facilitators in TGD health.ConclusionThe experiences of TGD patient-educators and medical students in this study suggest that this model of teaching could serve as a transferable template for TGD health and the inclusion of other historically marginalised groups in medical education.
| S-EPMC10472656 | biostudies-literature
Project description:Effective classroom management is a critical teaching skill and a key concern for educators. Disruptive behaviors disturb effective classroom management and can influence school satisfaction if the teacher does not have the competencies to control them. Two objectives were set in this work: to understand the differences that exist in school satisfaction, disruptive behaviors, and teaching competencies according to the gender of the students; and to analyze school satisfaction and disruptive student behaviors based on perceived teaching competence. A non-probabilistic and convenience sample selection process was employed, based on the subjects that we were able to access. 758 students participated (male = 45.8%) from seven public secondary schools in the Murcia Region (Spain). The age range was between 13 and 18 years (M = 15.22; DT = 1.27). A questionnaire composed of the following scales was used: Competencies Evaluation Scale for Teachers in Physical Education, School Satisfaction and Disruptive Behaviors in Physical Education. Mixed Linear Models performed with the SPSS v.23 was used for statistical analyses. The results revealed statistically significant differences based on gender and physical education teaching competencies. In conclusion, the study highlights that physical education teacher skills influence disruptive behaviors in the classroom, and that this is also related to school satisfaction. Furthermore, it highlights that boys showed higher levels of negative behaviors than girls.
| S-EPMC6997464 | biostudies-literature
Project description:BackgroundThe lung allocation system in the U.S. prioritizes lung transplant candidates based on estimated pre- and post-transplant survival via the Lung Allocation Scores (LAS). However, these models do not account for selection bias, which results from individuals being removed from the waitlist due to receipt of transplant, as well as transplanted individuals necessarily having survived long enough to receive a transplant. Such selection biases lead to inaccurate predictions.MethodsWe used a weighted estimation strategy to account for selection bias in the pre- and post-transplant models used to calculate the LAS. We then created a modified LAS using these weights, and compared its performance to that of the existing LAS via time-dependent receiver operating characteristic (ROC) curves, calibration curves, and Bland-Altman plots.ResultsThe modified LAS exhibited better discrimination and calibration than the existing LAS, and led to changes in patient prioritization.ConclusionsOur approach to addressing selection bias is intuitive and can be applied to any organ allocation system that prioritizes patients based on estimated pre- and post-transplant survival. This work is especially relevant to current efforts to ensure more equitable distribution of organs.
| S-EPMC8454078 | biostudies-literature