Dataset Information

A novel faculty development tool for writing a letter of recommendation.

ABSTRACT:

Objective

Based on a national survey of program directors we developed a letter of recommendation (LOR) scoring rubric (SR) to assess LORs submitted to a pediatric residency program. The objective was to use the SR to analyze: the consistency of LOR ratings across raters and LOR components that contributed to impression of the LOR and candidate.

Methods

We graded 30 LORs submitted to a pediatric residency program that were evenly distributed based on final rank by our program. The SR contained 3 sections (letter features, phrases, and applicant abilities) and 2 questions about the quality of the LOR (LORQ) and impression of the candidate (IC) after reading the LOR on a 5-point Likert scale. Inter-rater reliability was calculated with intraclass correlation coefficients (ICC(2,1)). Pearson (r) correlations and stepwise multivariate linear regression modeling predicted LORQ and IC. Mean scores of phrases, features, and applicant abilities were analyzed with ANOVA and Bonferroni correction.

Results

Phrases (ICC(2,1) = 0.82, p<0.001)) and features (ICC(2,1) = 0.60, p<0.001)) were rated consistently, while applicant abilities were not (ICC(2,1) = 0.28, p<0.001)). For features, LORQ (R2 = 0.75, p<0.001) and IC (R2 = 0.58, p<0.001) were best predicated by: writing about candidates' abilities, strength of recommendation, and depth of interaction with the applicant. For abilities, LORQ (R2 = 0.47, p<0.001) and IC (R2 = 0.51, p<0.001) were best predicted by: clinical reasoning, leadership, and communication skills (0.2). There were significant differences for phrases and features (p<0.05).

Conclusions

The SR was consistent across raters and correlates with impression of LORQ and IC. This rubric has potential as a faculty development tool for writing LORS.

SUBMITTER: Saudek K

PROVIDER: S-EPMC7743943 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A novel faculty development tool for writing a letter of recommendation.

Saudek Kris K Treat Robert R Rogers Amanda A Hahn Danita D Lauck Sara S Saudek David D Weisgerber Michael M

PloS one 20201216 12

<h4>Objective</h4>Based on a national survey of program directors we developed a letter of recommendation (LOR) scoring rubric (SR) to assess LORs submitted to a pediatric residency program. The objective was to use the SR to analyze: the consistency of LOR ratings across raters and LOR components that contributed to impression of the LOR and candidate.<h4>Methods</h4>We graded 30 LORs submitted to a pediatric residency program that were evenly distributed based on final rank by our program. The ...[more]

PMID: 33326489

Similar Datasets

Project description:Everywhere there are children, there are screens, and child-computer interaction is ubiquitous. Despite their omnipresence, research on the impact of screens on children's learning lags behind the development of digital tools. Apple's App Store has an abundance of "educational" apps, but many of these apps' claims are unsubstantiated. Organizations responsible for vetting quality products for young people, such as the American Library Association, are developing resources to help identify the best digital products available, but they remain difficult to find, and there is limited guidance for app designers when it comes to designing apps for younger audiences. Our interdisciplinary, empirical study was inspired by "co-creation" (Sanders and Stappers, 2008) and "cooperative inquiry" (Druin, 2005). Starting with a seed grant from Kent State University's College of Communication and Information, our team sought to create a high-quality and inclusive alphabet app with haptic interactions and simplified gamification to reinforce the basic letter writing skills of young children. The app rewards a child's successful handwriting with an animation of a verb that corresponds with the letter they traced. Concrete animations and digital and verbal demonstrations connect the typographic letter to the handwritten counterpart. Librarian Claudia Haines' rubric (Haines, 2016) and the Dig Checklist (Kidmap, 2018.) guided our definition of "quality," and children served as co-designers in two qualitative user studies. Our young designers tested prototypes, completed task booklets, and were interviewed about their preferences and their feedback informed our design. Additionally, a focus group interview with kindergarten and preschool teachers provided further feedback about the typographic design, stroke order, and gaming rewards. To be inclusive, children in both our app design and user studies were selected from a diverse pool. Our research contributes to work on co-design and cooperative inquiry in the fields of User Experience Design, human-computer interaction, human information behavior, information science, interface design, motion design, typeface design and typography for children, and early literacy development. A post-study is planned upon completion of the app.

Project description:During the last years, digital writing devices are increasingly replacing handwriting with pencil and paper. As reading and writing skills are central for education, it is important to know, which writing tool is optimal for initial literacy education. The present training study was therefore set up to test the influence of the writing tool on the acquisition of literacy skills at the letter and word level with various tests in a large sample of kindergarten children (n = 147). Using closely matched letter learning games, children were trained with 16 letters by handwriting with a pencil on a sheet of paper, by writing with a stylus on a tablet computer, or by typing letters using a virtual keyboard on a tablet across 7 weeks. Training using a stylus on a touchscreen is an interesting comparison condition for traditional handwriting, because the slippery surface of a touchscreen has lower friction than paper and thus increases difficulty of motor control. Before training, immediately after training and four to five weeks after training, we assessed reading and writing performance using standardized tests. We also assessed visuo-spatial skills before and after training, in order to test, whether the different training regimens affected cognitive domains other than written language. Children of the pencil group showed superior performance in letter recognition and improved visuo-spatial skills compared with keyboard training. The performance of the stylus group did not differ significantly neither from the keyboard nor from the pencil group. Keyboard training, however, resulted in superior performance in word writing and reading compared with handwriting training with a stylus on the tablet, but not compared with the pencil group. Our results suggest that handwriting with pencil fosters acquisition of letter knowledge and improves visuo-spatial skills compared with keyboarding. At least given the current technological state, writing with a stylus on a touchscreen seems to be the least favorable writing tool, possibly because of increased demands on motor control. Future training studies covering a more extended observation period over years are needed to allow conclusions about long-term effects of writing tools on literacy acquisition as well as on general cognitive development.

Dataset Information

A novel faculty development tool for writing a letter of recommendation.

Objective

Methods

Results

Conclusions

Publications

A novel faculty development tool for writing a letter of recommendation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets