Evaluation of residency programs: a novel approach using simulation.
Ontology highlight
ABSTRACT:
SUBMITTER: Doyle K
PROVIDER: S-EPMC3963795 | biostudies-other | 2014 Mar
REPOSITORIES: biostudies-other
Similar Datasets
Project description:BackgroundThe residency match process for competitive specialties hinders programs' ability to holistically review applications.ObjectiveA computer simulation model of the residency application process was created to test the hypotheses that (1) it is advantageous to medical students to apply to the maximum number of programs under the current system, and (2) including a medical student's residency program preferences at the beginning of the application process improves the efficiency of the system for applicants and programs as quantified by the number of interview invitations received.MethodsThe study was conducted in 2016 using 2014 Otolaryngology Match data. A computer model was created to perform simulations for multiple scenarios to test the hypotheses. Students were assigned scores representing easy and hard metrics and program preferences, simulating a mixture of individual student preference and general program popularity.ResultsWe modeled a system of 99 otolaryngology residency programs with 292 residency spots and 460 student applicants. While it was individually advantageous for an applicant to apply to the maximum number of programs, this led to a poor result for the majority of students when all applicants undertook the strategy. The number of interview invitations improved for most applicants when preference was revealed.ConclusionsOffering applicants an option to provide program preference improves the practical number of interview invitations. This enables programs to review applicants holistically-instead of using single parameters such as United States Medical Licensing Examination scores-which facilitates a selection of applicants who will be successful in residency.
| S-EPMC6375320 | biostudies-literature
Project description:BackgroundResidency training is the basis of good clinical and surgical practice.PurposeThe aim is to know the demographics, training experience, and perception of young ophthalmologists to improve the present residency programs in India.SettingYoung ophthalmologists trained in India.MethodsA survey was conducted by the Academic and Research Committee of the All India Ophthalmology Society, in 2014-2016 of young ophthalmologists (those trained between 2002 and 2012, with 2-10 years' postresidency experience) to gauge teaching of clinical and surgical skills during the postgraduate residency program.Statistical analysisStatistical Package for Social Sciences version 16.ResultsOf the 1005 respondents, 531 fulfilled inclusion criteria. Average age was 32.6 years (standard deviation [SD] 4). On a scale of 0-10, clinical skills teaching was graded as (mean, SD): Slit lamp examination (7.2, SD 2.8), indirect ophthalmoscopy (6.2, SD 3.3), gonioscopy (5.7, SD 3.4), perimetry (6.2, SD 3.2), optical coherence tomography (4.6, SD 4), and orthoptic evaluation (4.3, SD 3.1). The mean (SD) and median of surgeries performed independently was intracapsular cataract extraction 3.0 (14.9), 0; extracapsular cataract extraction 39.9 (53.2), 18; small incision cataract surgery 75.3 (64.4), 55; phacoemulsification 30 (52.6), 1; pterygium excision 31.5 (43.5), 15; dacryocystectomy 20.3 (38.1), 4; dacryocystorhinostomy 11.7 (26.2), 2; chalazion 46.4 (48.3), 30; trabeculectomies 4 (14.9), 0; strabismus correction 1.4 (4.9), 0; laser-assisted in situ Keratomileusis 1.5 (12.2), 0; retinal detachment 1.5 (12.5), 0; vitrectomy 3.0 (17.0), 0; keratoplasty 5.2 (17.8), 0; eyelid surgery 8.6 (18.9), 2 and ocular emergencies 41.7 (52.4), 20. Observed and assisted surgeries were more common. However, the range of grading was 0-10 in all categories.ConclusionResidency training in India varies considerably from program to program. Standardization is needed to assure all graduates are competent and render consistent quality of service.
| S-EPMC5508454 | biostudies-literature
Project description:ImportanceOver two-thirds of the adult population in the United States use Facebook. Despite the high interest in and use of social media by the general public, the presence and accessibility of health care organizations on social media has not yet been fully evaluated.ObjectiveTo determine the use and popularity of social media among otolaryngology residency programs in the United States.Design, setting, and participantsA cross-sectional study of the presence of accredited otolaryngology residency programs in the United States in an internet data repository was conducted. Programs were stratified by Doximity Residency Navigator reputation rankings (dividing programs into quartiles) and US News & World Report (comparing programs affiliated with hospitals ranked in the top 50 vs programs affiliated with unranked hospitals). Social media sites and activity for each program were assessed using internet searches. The study was conducted in April 2017.ResultsAmong 101 otolaryngology residency programs, 30 were found to have social media sites (29.7%). Facebook and Twitter were the most commonly used services, with 25 (24.8%) and 14 (13.9%) accounts, respectively. Based on Doximity Residency Navigator rankings, programs in the first quartile were more likely to have Facebook profiles than programs in the fourth quartile (42.3% vs 12.0%; absolute difference, 30%; 95% CI, 2.9% to 52.6%). First- and second-quartile programs showed increased Facebook activity. There was greater Twitter presence in first- vs fourth-quartile programs (19.2% vs 8.0%; absolute difference, 11.2%; 95% CI, -11.6% to 33.0%). Higher-quartile programs were more active on Twitter and exhibited increased numbers of likes and followers. Analysis of US News & World Report rankings revealed that ranked programs had higher rates of presence, activity, and popularity on both Facebook and Twitter. However, these were smaller differences than seen when comparing Doximity Residency Navigator rankings. Correlation between the 2 ranking systems was indicated (Spearman ??=?0.59; 95% CI, 0.34 to 0.76).Conclusions and relevanceThis study suggests that otolaryngology residency programs with higher Doximity Residency Navigator reputation rankings have a stronger presence on social media. Smaller trends were observed for programs in the top 50 US News & World Report rankings. Overall, social media use among otolaryngology programs seems relatively low, and this may present an opportunity to increase communication with the public via these technologies.
| S-EPMC6233632 | biostudies-literature
Project description:The goal of this study was to analyze the content availability and accessibility of preventive medicine residency program websites. In COVID-related travel restrictions, the information provided on program websites has become increasingly crucial for residency applicants. A cross-sectional study was conducted by extracting the list of preventive medicine residency programs on the Fellowship and Residency Electronic and Interactive Database (FRIEDA). A 40-point criterion was used for the quality evaluation of residency programs. The study was conducted and analyzed in 2021. 82 preventive medicine residency programs were identified, and listed on FRIEDA, out of which 65 program websites were accessible. The median number of 40-point criteria met by the preventive medicine residency website was 25. The criteria fulfilled by the greatest number of program websites was research opportunity/facilities (94%). The majority of the preventive medicine residency program websites were not up to the mark regarding accessibility and quality. An updated preventive medicine residency program website is essential for the applicants. Programs with relevant and precise information on their websites have higher chances of attracting potential candidates and better chances of finding the match between applicants and programs.
| S-EPMC9758379 | biostudies-literature
Project description:BackgroundThe Canadian Pharmacy Residency Board (CPRB) specifies the competencies that pharmacy residents must attain and the need for assessment and evaluation. Methods of assessment and evaluation are left to the discretion of individual programs. There is a scarcity of published literature compiling and comparing the strategies used by Canadian residency programs.ObjectivesTo determine curricular components used for assessment and evaluation; to describe the tools used by programs; to characterize the scheduling, frequency, and repetition of curricular components; and to determine the individuals or groups involved.MethodsCoordinators of hospital pharmacy residency programs with CPRB accreditation or accreditation pending were surveyed to collect information about the assessment and evaluation of select CPRB standards.ResultsFrom the 37 eligible residency programs, 20 unique responses (54%) were received. All respondents were general practice programs (100%) in predominantly multicentre organizations (70%). Programs were similar in terms of assessment components used, with all respondents citing care plan review, direct observation of patient care, journal clubs, creation of project timelines, and ethics submission. The predominant evaluation components were within-department presentations (100%), written manuscripts (95%), drug information rotations (85%), and longitudinal evaluations (75%). Standardized forms (70%-100%) defined by Bloom's taxonomy (65%) and the CPRB "levels and ranges" document (60%) were the principle means used. Assessments for patient care and for provision of education were generally carried out immediately (80% and 95%, respectively), whereas project management skills were assessed predominantly at final evaluation (75%). Self-assessment and assessment by pharmacy team members occurred for every competency, whereas patients (0%-10%) and allied health professionals (5%) were less frequently involved.ConclusionsThe assessment and evaluation strategies reported by programs were congruent. The results provide a summary of national practices and will allow existing and developing programs to examine their approach to assessment and evaluation for alignment with national standards.
| S-EPMC6799962 | biostudies-literature
Project description: Not available
| S-EPMC9187507 | biostudies-literature
Project description:BackgroundThe Association of American Medical Colleges has recently issued recommendations for the upcoming 2022-2023 application cycle that residency programs should conduct all interviews for this upcoming application cycle over the web. In light of these recommendations, many students will have limited exposure to anesthesiology programs and will rely on information gleaned digitally. This change means that the aspects of program websites used to provide information, such as size, structure, location, requirements, and contact information, will be crucial in helping prospective residents decide where and how to apply in the future. An evaluation of website usability, which includes initial appearance along with factors that influence its ease of navigation and convenience of use, can thus be applied to anesthesiology residency websites. Areas of need can be targeted to increase web presence and provide effective pathways to exhibit the different attributes of their programs to future applicants.ObjectiveThis study aimed to compile a list of US anesthesiology residency programs and their websites while objectively analyzing the websites using a formally published usability scoring system, as well as to identify positive and negative trends to offer areas of improvement among anesthesiology residency websites.MethodsWe included only 114 US anesthesiology residency program websites in our sample set, since some websites we analyzed showed errors or inconclusive. Website usability was separated into 4 distinct categories for analysis based on methodology outlined in previous literature on both health care website usability and residency website usability. The 4 categories were Accessibility, Marketing, Content Quality, and Technology. Each website was then analyzed and scored based on key components highlighted within the 4 categories. The multiple factors were then graded using a percentage system to create a comprehensive score for each program.ResultsThe highest scoring category was Content Quality (mean 4.7, SD 2.48, SE 0.23). The lowest scoring category was Technology (mean 0.9, SD 0.38, SE 0.04).ConclusionsThrough the application of a health care website usability framework, multiple anesthesiology residency programs were analyzed and scored in the areas of Accessibility, Marketing, Content Quality, and Technology, which allowed us to determine the effectiveness of the usability of these websites to convey information to their end user. Websites must communicate vital information, with usability at the forefront, to continue to grow, especially as the United States faces challenges due to the COVID-19 pandemic. Our recommendation is that anesthesiology programs should strive to improve website usability to increase the ease by which applicants can collect vital information about anesthesiology programs. A few proposed solutions include making changes such as decreasing error pages on websites, migrating away from using in-line cascading style sheets, and improving web page loading speeds to improve the Technology category.
| S-EPMC9634514 | biostudies-literature
Project description:Background Mentorship during residency training is correlated with improved outcomes. Many residency programs have implemented formal mentorship programs; however, reported data for these programs have not been previously synthesized. Thus, existing programs may fall short on delivering effective mentorship. Objective To synthesize current literature on formal mentorship programs in residency training in Canada and the United States, including program structure, outcomes, and evaluation. Methods In December 2019, the authors performed a scoping review of the literature in Ovid MEDLINE and Embase. The search strategy included keywords relevant to mentorship and residency training. Eligibility criteria included any study describing a formal mentorship program for resident physicians within Canada or the United States. Data from each study were extracted in parallel by 2 team members and reconciled. Results A total of 6567 articles were identified through the database search, and 55 studies met inclusion criteria and underwent data extraction and analysis. Though reported program characteristics were heterogenous, programs most commonly assigned a staff physician mentor to a resident mentee with meetings occurring every 3 to 6 months. The most common evaluation strategy was a satisfaction survey at a single time point. Few studies performed qualitative evaluations or used evaluation tools appropriate to the stated objectives. Analysis of data from qualitative studies allowed us to identify key barriers and facilitators for successful mentorship programs. Conclusions While most programs did not utilize rigorous evaluation strategies, data from qualitative studies provided insights into barriers and facilitators of successful mentorship programs, which can inform program design and improvement.
| S-EPMC10150829 | biostudies-literature
Project description:ObjectivesPediatric training is an essential component of emergency medicine (EM) residency. The heterogeneity of pediatric experiences poses a significant challenge to training programs. A national simulation curriculum can assist in providing a standardized foundation of pediatric training experience to all EM trainees. Previously, a consensus-derived set of content for a pediatric curriculum for EM was published. This study aimed to prioritize that content to establish a pediatric simulation-based curriculum for all EM residency programs.MethodsSeventy-three participants were recruited to participate in a three-round modified Delphi project from 10 stakeholder organizations. In round 1, participants ranked 275 content items from a published set of pediatric curricular items for EM residents into one of four categories: definitely must, probably should, possibly could, or should not be taught using simulation in all residency programs. Additionally, in round 1 participants were asked to contribute additional items. These items were then added to the survey in round 2. In round 2, participants were provided the ratings of the entire panel and asked to rerank the items. Round 3 involved participants dichotomously rating the items.ResultsA total of 73 participants participated and 98% completed all three rounds. Round 1 resulted in 61 items rated as definitely must, 72 as probably should, 56 as possibly could, 17 as should not, and 99 new items were suggested. Round 2 resulted in 52 items rated as definitely must, 91 as probably should, 120 as possibly could, and 42 as should not. Round 3 resulted in 56 items rated as definitely must be taught using simulation in all programs.ConclusionsThe completed modified Delphi process developed a consensus on 56 pediatric items that definitely must be taught using simulation in all EM residency programs (20 resuscitation, nine nonresuscitation, and 26 skills). These data will serve as a targeted needs assessment to inform the development of a standard pediatric simulation curriculum for all EM residency programs.
| S-EPMC7592831 | biostudies-literature
Project description:BackgroundGeriatric patients account for a growing proportion of dermatology clinic visits. Although their biopsychosocial needs differ from those of younger adults, there are no geriatrics training requirements for dermatology residency programs.ObjectiveThis study explored the state of geriatrics education in dermatology programs in 2016.MethodsThis constructivist study employed cross-sectional, mixed-methods analysis with triangulation of semistructured interviews, surveys, and commonly used curricular materials. We used purposive sampling of 5 US academic allopathic dermatology programs of different sizes, geographic locations, and institutional resources. Participants were interviewed about informal curricula, barriers, and suggestions for improving geriatrics education, and they also completed a survey about the geriatrics topics that should be taught. The constant comparative method with grounded theory was used for qualitative analysis. We identified formal geriatrics curricular content by electronically searching and counting relevant key texts.ResultsFourteen of 17 participants (82%) agreed to be interviewed, and 10 of 14 (71%) responded to the survey. Themes of what should be taught included diagnosing and managing skin diseases common in older adults, holistic treatment, cosmetic dermatology, benign skin aging, and the basic science of aging. Topics currently covered that could be expanded included communication, systems-based challenges, ethical issues, safe prescribing, quality improvement, and elder abuse. Cosmetic dermatology was the most commonly taught formal geriatrics curricular topic.ConclusionsThere were discrepancies among topics participants felt were important to teach about geriatric dermatology and curricular coverage of these areas. We identified challenges for expanding geriatrics curricula and potential solutions.
| S-EPMC6314366 | biostudies-literature