Dataset Information

Are There Gender-based Differences in Language in Letters of Recommendation to an Orthopaedic Surgery Residency Program?

ABSTRACT:

Background

Letters of recommendation are considered one of the most important factors for whether an applicant is selected for an interview for orthopaedic surgery residency programs. Language differences in letters describing men versus women candidates may create differential perceptions by gender. Given the gender imbalance in orthopaedic surgery, we sought to determine whether there are differences in the language of letters of recommendation by applicant gender.

Questions/purposes

(1) Are there differences in word count and word categories in letters of recommendation describing women and men applicants, regardless of author gender? (2) Is author gender associated with word category differences in letters of recommendation? (3) Do authors of different academic rank use different words to describe women versus men applicants?

Methods

Using a linguistic analysis in a retrospective study, we analyzed all letters of recommendation (2834 letters) written for all 738 applicants with completed Electronic Residency Application Service applications submitted to the Johns Hopkins Orthopaedic Surgery Residency program during the 2018 to 2019 cycle to determine differences in word category use among applicants by gender, authors by gender, and authors by academic rank. Thirty nine validated word categories from the Linguistic Inquiry and Word Count dictionary along with seven additional word categories from previous publications were used in this analysis. The occurrence of words in each word category was divided by the number of words in the letter to obtain a word frequency for each letter. We calculated the mean word category frequency across all letters and analyzed means using non-parametric tests. For comparison of two groups, a p value threshold of 0.05 was used. For comparison of multiple groups, the Bonferroni correction was used to calculate an adjusted p value (p = 0.00058).

Results

Letters of recommendation for women applicants were slightly longer compared with those for men applicants (366 ± 188 versus 339 ± 199 words; p = 0.003). When comparing word category differences by applicant gender, letters for women applicants had slightly more "achieve" words (0.036 ± 0.015 versus 0.035 ± 0.018; p < 0.0001). Letters for men had more use of their first name (0.016 ± 0.013 versus 0.014 ± 0.009; p < 0.0001), and more "young" words (0.001 ± 0.003 versus 0.000 ± 0.001; p < 0.0001) than letters for women applicants. These differences were very small as each 0.001 difference in mean word frequency was equivalent to one more additional word from the word category appearing when comparing three letters for women to three letters for men. For differences in letters by author gender, there were no word category differences between men and women authors. Finally, when looking at author academic rank, letters for men applicants written by professors had slightly more "research" terms (0.011 ± 0.010) than letters written by associate professors (0.010 ± 0.010) or faculty of other rank (0.009 ± 0.011; p < 0.0001), a finding not observed in letters written for women.

Conclusions

Although there were some minor differences favoring women, language in letters of recommendation to an academic orthopaedic surgery residency program were overall similar between men and women applicants.

Clinical relevance

Given the similarity in language between men and women applicants, increasing women applicants may be a more important factor in addressing the gender gap in orthopaedics.

SUBMITTER: Kobayashi AN

PROVIDER: S-EPMC7310286 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Background: This survey aims to identify the relative value and the critical components of anesthesiology letters of recommendation(LORs) from the perspective of Program Directors (PDs) and Associate/Assistant Program Directors (APDs). Knowledge and insights originating from this survey might add to the understanding of the anesthesiology residency selection process and mitigate unintended linguistic biases.Methodology: Anonymous online surveys were sent to anesthesiology PDs/APDs from the Accreditation Council for Graduate Medical Education (ACGME) accredited anesthesiology residency Programs in the USA (US), as listed on the ACGME website and the American Medical Association Fellowship and Residency Electronic Interactive Database (AMA FREIDA) Residency Program Database. The survey authors were blinded to the identity of the respondents.Results: 62 out of 183 (33.8%) invited anesthesiology PDs/APDs completed the survey anonymously. In our survey, LORs are reported as more important in granting an interview than in making the rank list. 64% of respondents prefer narrative LORs. 77.4% of respondents look for specific keywords in LORs. Keywords such as 'top % of students' and 'we are recruiting this candidate' indicate a strong letter of recommendation while keywords such as 'I recommend to your program' or non-superlative descriptions indicate a weak letter of recommendation. Other key components of LORs include the specialty of the letter-writer, according to 84% of respondents, with anesthesiology as the most valuable specialty. Although narrative LORs are preferred, 55.1% of respondents are not satisfied with the content of narrative LORs.Conclusion: LORs containing specific keywords play an important role in the application to anesthesiology residency, particularly when submitted by an anesthesiologist. While narrative LORs are still the preferred format, most of our respondents feel they need improvements. The authors suggest specific LOR improvements including creating formalized LOR training, adding a style guide, and applying comparative scales, with standardized vocabulary in the narrative LOR.

Project description:Abstract Objective Application for otolaryngology residency is highly competitive, with letters of recommendation (LORs) and applicant personal statements (PSs) representing important components of the application process. However, their inherently subjective nature predisposes them to potential implicit bias. Otolaryngology has historically been predominated by male physicians and while implicit sex bias has been demonstrated in LORs for application to residency of multiple specialties, data is limited for otolaryngology. Methods LORs and PSs for all otolaryngology applicants to an academic medical center during the 2019–20 and 2020–21 cycles were abstracted. Quantitative analysis was performed using Linguistic Inquiry and Word Count 2015 (LIWC2015), a validated software application designed to analyze various emotional, cognitive, and structural components of written text. Results LORs written for females were found to be written from a perspective of higher expertise and confidence while LORs written for males were associated with a more honest, personal, and disclosing tone. Moreover, LORs written for female applicants were found to reference achievement and “grindstone” terminology more than those written for men. No differences were observed in any word category between PSs written by male and female applicants. Conclusion Minor linguistic differences exist in multiple domains between LORs written for male and female applicants for otolaryngology residency. These tended to favor female applicants, with their letters demonstrating higher clout, achievement, and grindstone scores. This trend was unexpected in this historically predominantly male specialty. While differences were statistically significant, the overall difference in an entire letter of recommendation is likely subtle. Level of Evidence 3. Implicit sex bias has been demonstrated in letters of recommendation for application to residency of multiple specialties; however, data is limited for otolaryngology. Letters of recommendation and personal statements for all otolaryngology applicants to an academic medical center during the 2019–20 and 2020–21 cycles were analyzed using Linguistic Inquiry and Word Count 2015, a validated software application designed to analyze various emotional, cognitive, and structural components of written text. Minor linguistic differences exist in multiple domains between LORs written for male and female applicants for otolaryngology residency.

Project description:ObjectiveWe surveyed Orthopaedic Surgery Residency (OSR) programs to determine international opportunities by the academic institutional region within the United States, location of the international experience, duration, residency program year (PGY), funding source, and resident participation to date.DesignWe emailed a survey to all OSR programs in the United States to inquire about global opportunities in their residency programs. Further contact was made through an additional e-mail and up to three telephone calls. Data were analyzed using descriptive and chi-square statistics. This study was institutional review board exempt.SettingThis research study was conducted at the University of Nebraska Medical Center, a tertiary care facility in conjunction with the University of Nebraska Medical Center College of Medicine.ParticipantsThe participants of this research study included program directors and coordinators of all OSR programs (185) across the United States.ResultsA total of 102 OSR programs completed the survey (55% response rate). Notably, 50% of the responding programs offered a global health opportunity to their residents. Of the institutions that responded, those in the Midwest or South were more likely to offer the opportunity than institutions found in other US regions, although regional differences were not significant. Global experiences were most commonly: in Central or South America (41%); 1 to 2 weeks in duration (54%); and during PGY4 or PGY5 (71%). Furthermore, half of the programs provided full funding for the residents to participate in the global experience. In 33% of the programs, 10 or more residents had participated to date.ConclusionsInterest in global health among medical students is increasing. OSR programs have followed this trend, increasing their global health opportunities by 92% since 2015. Communicating the availability of and support for international opportunities to future residents may help interested students make informed decisions when applying to residency programs.