Assessing Residents' Competency at Baseline: How Much Does the Medical School Matter?
Ontology highlight
ABSTRACT:
SUBMITTER: Gollehon NS
PROVIDER: S-EPMC5646921 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundMedical schools in Sub-Saharan Africa have adopted competency based medical education (CBME) to improve the quality of graduates trained. In 2015, Makerere University College of Health Sciences (MaKCHS) implemented CBME for the Bachelor of Medicine and Bachelor of Surgery (MBChB) programme in order to produce doctors with the required attributes to address community health needs. However, no formal evaluation of the curriculum has been conducted to determine whether all established competencies are being assessed.ObjectiveTo evaluate whether assessment methods within the MBChB curriculum address the stated competencies.MethodsThe evaluation adopted a cross-sectional study design in which the MBChB curriculum was evaluated using an Essential Course Evidence Form (ECEF) that was developed to collect information about each assessment used for each course. Information was collected on: (1) Assessment title, (2) Description, (3) Competency domain (4) Sub-competency addressed, (5) Student instructions, and (6) Grading method/details. Data were entered into a structured Access data base. In addition, face-to-face interviews were conducted with faculty course coordinators.ResultsThe MBChB curriculum consisted of 62 courses over 5 years, focusing on preclinical skills in years 1-2 and clinical skills in years 3-5. Fifty-nine competencies were identified and aggregated into 9 domains. Fifty-eight competencies were assessed at least one time in the curriculum. Faculty cited limited training in assessment as well as large student numbers as hindrances to designing robust assessments for the competencies.ConclusionCBME was successfully implemented evidenced by all but one of the 59 competencies within the nine domains established being assessed within the MBChB curriculum at MaKCHS. Faculty interviewed were largely aware of it, however indicated the need for more training in competency-based assessment to improve the implementation of CBME.
| S-EPMC9569118 | biostudies-literature
Project description:BackgroundFor medical students, providing exposure to and education about the lesbian, gay, bisexual, and transgender (LGBT) patient population are effective methods to increase comfort, knowledge, and confidence in caring for LGBT people. However, specific recommendations on the number of patient exposures and educational hours that relate to high LGBT cultural competency are lacking.MethodsMedical students (N = 940) at three universities across the United States completed a survey consisting of demographics, experiential variables (i.e., number of LGBT patients and LGBT hours), and the 7-point Likert LGBT-Development of Clinical Skills Scale (LGBT-DOCSS). LGBT-DOCSS scores were stratified by 1-point increments, and experiential variable means were computed per each stratification to characterize the mean LGBT patients and hours of medical students with higher scores and those with lower scores.ResultsMedical students reported caring for some LGBT patients annually (M = 6.02, SD = 20.33) and receiving a low number of annual LGBT curricular hours (M = 2.22, SD = 2.85) and moderate number of annual LGBT extracurricular hours (M = 6.93, SD = 24.97). They also reported very high attitudinal awareness (M = 6.54, SD = 0.86), moderate knowledge (M = 5.73, SD = 1.01), and low clinical preparedness (M = 3.82, SD = 1.25). Medical students who cared for 35 or more LGBT patients and received 35 or more LGBT total hours reported significantly higher preparedness and knowledge.ConclusionsMedical students have shortcomings in LGBT cultural competency and limited LGBT patient exposure and education. To improve LGBT cultural competency, medical schools and accrediting bodies should consider providing medical students with at least a total of 35 LGBT patient contacts and 35 LGBT education hours (10 h of required curricular education and 25 h of supplemental education).
| S-EPMC7716501 | biostudies-literature
Project description:BackgroundSpaced education is a novel method that improves medical education through online repetition of core principles often paired with multiple-choice questions. This model is a proven teaching tool for medical students, but its effect on resident learning is less established. We hypothesized that repetition of key clinical concepts in a "Clinical Pearls" format would improve knowledge retention in medical residents.MethodsThis study investigated spaced education with particular emphasis on using a novel, email-based reinforcement program, and a randomized, self-matched design, in which residents were quizzed on medical knowledge that was either reinforced or not with electronically-administered spaced education. Both reinforced and non-reinforced knowledge was later tested with four quizzes.ResultsOverall, respondents incorrectly answered 395 of 1008 questions (0.39; 95% CI, 0.36-0.42). Incorrect response rates varied by quiz (range 0.34-0.49; p = 0.02), but not significantly by post-graduate year (PGY1 0.44, PGY2 0.33, PGY3 0.38; p = 0.08). Although there was no evidence of benefit among residents (RR = 1.01; 95% CI, 0.83-1.22; p = 0.95), we observed a significantly lower risk of incorrect responses to reinforced material among interns (RR = 0.83, 95% CI, 0.70-0.99, p = 0.04).ConclusionsOverall, repetition of Clinical Pearls did not statistically improve test scores amongst junior and senior residents. However, among interns, repetition of the Clinical Pearls was associated with significantly higher test scores, perhaps reflecting their greater attendance at didactic sessions and engagement with Clinical Pearls. Although the study was limited by a low response rate, we employed test and control questions within the same quiz, limiting the potential for selection bias. Further work is needed to determine the optimal spacing and content load of Clinical Pearls to maximize retention amongst medical residents. This particular protocol of spaced education, however, was unique and readily reproducible suggesting its potential efficacy for intern education within a large residency program.
| S-EPMC5536283 | biostudies-literature
Project description:A strong competency and milestone framework is imperative for medical schools adopting competency-based education and assessment. Milestones can be used to align what is taught and what students are asked to demonstrate from matriculation to graduation. We describe the creation and implementation of our milestone framework as an exemplar.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-022-01558-1.
| S-EPMC9055212 | biostudies-literature
Project description:BackgroundVaccination is the most cost-effective medical intervention known to prevent morbidity and mortality. However, data are limited on the effectiveness of residency programs in delivering immunization knowledge and skills to trainees. The authors sought to describe the immunization competency needs of medical residents at the University of Toronto (UT), and to develop and evaluate a pilot immunization curriculum.MethodsResidents at the University of Toronto across nine specialties were recruited to attend a pilot immunization workshop in November 2018. Participants completed a questionnaire before and after the workshop to assess immunization knowledge and compare baseline change. Feedback was also surveyed on the workshop content and process. Descriptive statistics were performed on the knowledge questionnaire and feedback survey. A paired sample T-test compared questionnaire answers before and after the workshop. Descriptive coding was used to identify themes from the feedback survey.ResultsTwenty residents from at least six residencies completed the pre-workshop knowledge questionnaire, seventeen attended the workshop, and thirteen completed the post-workshop questionnaire. Ninety-five percent (19/20) strongly agreed that vaccine knowledge was important to their career, and they preferred case-based teaching. The proportion of the thirty-four knowledge questions answered correctly increased from 49% before the workshop to 67% afterwards, with a mean of 2.24 (CI: 1.43, 3.04) more correct answers (P < 0.001). Sixteen residents completed the post-workshop feedback survey. Three themes emerged: first, they found the content specific and practical; second, they wanted more case-based learning and for the workshop to be longer; and third, they felt the content and presenters were of high quality.ConclusionsFindings from this study suggest current immunization training of UT residents does not meet their training competency requirements. The study's workshop improved participants' immunization knowledge. The information from this study could be used to develop residency immunization curriculum at UT and beyond.
| S-EPMC7671185 | biostudies-literature
Project description:IntroductionMedical students often do not value attending in-person large group sessions. It is also not clear from prior research whether attendance at large group sessions impact on performance in medical school. The goal of this study was to assess the relationship between voluntary attendance in large group sessions organized as a "flipped classroom" in a new innovative curriculum and students' mastery of clinical applications of basic science knowledge.MethodologyOur students' ability to apply basic science knowledge to clinical problems is assessed via progress testing using three methodologies: a locally developed multiple-choice examination, written examination developed through the National Board of Medical Examiners (NBME) Customized Assessment Services Program and post encounter questions included in a clinical skills examination. We analyzed the relationship between voluntary attendance at weekly large group "flipped classroom" sessions and the students' performance on examinations given at four intervals over the initial 24-week module of the medical school curriculum.ResultsComplete data were available for 167 students. A total of 82 students (49.1%) attended all large group sessions, 65 students (38.9%) missed one or two sessions and 20 students (12.0%) missed three or more sessions. There were no difference between the students in the groups on their medical admission (MCAT) examination scores. The growth in performance from each time point until the next was statistically significant. There was no statistically significant difference in growth between the students who had no absences and those who had one or two absences. Students who missed three or more sessions performed significantly lower than their peers over the 24 week module and were more likely to score one or more standard deviations below the class mean on the assessments.ConclusionsWe found no relationship between attendance and MCAT scores suggesting the differences in performance on the progress tests was not due to initial differences in knowledge or reasoning skills. While the study was not experimental, it suggests large group sessions using a "flipped classroom" approach to provide reinforcement, feedback and practice may be effective for increasing learning and retention in the application of basic science knowledge among first year medical students.
| S-EPMC6071618 | biostudies-literature
Project description:Contraception and abortion topics are variably, but often poorly, addressed in medical school curricula. Restrictions on contraceptive and abortion care at faith-based hospitals may hinder comprehensive family planning training for medical students during Ob/Gyn clerkships. Here we investigated whether medical students at faith-based and non-faith-based clerkships experienced different observations during their Ob/Gyn clerkship and/or differences in self-perceived competency in patient counseling, objective knowledge, and perceived adequacy of training in contraception and abortion topics post-clerkship. A survey was distributed to third- and fourth-year medical students at New York Institute of Technology, College of Osteopathic Medicine. Across all clerkship sites (n = 102 students), observations of, and competency in, contraceptive care was higher than in abortion care. Students at non-faith-based clerkship sites (n = 54) reported the highest levels of observation of contraceptive and abortion care (19.6-90.7%), while those at Catholic sites (n = 26) typically reported the lowest (7.7-34.6%). Students at non-faith-based sites reported significantly higher competency in contraceptive care and some aspects of abortion care, than those at Catholic, and some other faith-based sites (n = 48). Clerkship training at faith-based sites, specifically Catholic sites, resulted in poorer Ob/Gyn training, particularly in contraceptive care. Training outcomes in abortion care were poor at all Ob/Gyn clerkship sites.
| S-EPMC10864354 | biostudies-literature
Project description:BackgroundSystematic reviews on the effects of problem-based learning have been limited to knowledge competency either during medical school or postgraduate training. We conducted a systematic review of evidence of the effects that problem-based learning during medical school had on physician competencies after graduation.MethodsWe searched MEDLINE, EMBASE, CINAHL, PsycINFO, Cochrane Databases, and the tables of contents of 5 major medical education journals from earliest available date through Oct. 31, 2006. We included studies in our review if they met the following criteria: problem-based learning was a teaching method in medical school, physician competencies were assessed after graduation and a control group of graduates of traditional curricula was used. We developed a scoring system to assess the quality of the studies, categorized competencies into 8 thematic dimensions and used a second system to determine the level of evidence for each competency assessed.ResultsOur search yielded 102 articles, of which 15 met inclusion criteria after full text review. Only 13 studies entered final systematic analysis because 2 studies reported their findings in 2 articles. According to self-assessments, 8 of 37 competencies had strong evidence in support of problem-based learning. Observed assessments had 7 competencies with strong evidence. In both groups, most of these competencies were in the social and cognitive dimensions. Only 4 competencies had moderate to strong levels of evidence in support of problem-based learning for both self-and observed assessments: coping with uncertainty (strong), appreciation of legal and ethical aspects of health care (strong), communication skills (moderate and strong respectively) and self-directed continuing learning (moderate).InterpretationProblem-based learning during medical school has positive effects on physician competency after graduation, mainly in social and cognitive dimensions.
| S-EPMC2151117 | biostudies-literature
Project description:BackgroundWhile a variety of instruments have been developed to assess knowledge and skills in evidence based medicine (EBM), few assess all aspects of EBM - including knowledge, skills attitudes and behaviour - or have been psychometrically evaluated. The aim of this study was to develop and validate an instrument that evaluates medical trainees' competency in EBM across knowledge, skills and attitude.MethodsThe 'Assessing Competency in EBM' (ACE) tool was developed by the authors, with content and face validity assessed by expert opinion. A cross-sectional sample of 342 medical trainees representing 'novice', 'intermediate' and 'advanced' EBM trainees were recruited to complete the ACE tool. Construct validity, item difficulty, internal reliability and item discrimination were analysed.ResultsWe recruited 98 EBM-novice, 108 EBM-intermediate and 136 EBM-advanced participants. A statistically significant difference in the total ACE score was observed and corresponded to the level of training: on a 0-15-point test, the mean ACE scores were 8.6 for EBM-novice; 9.5 for EBM-intermediate; and 10.4 for EBM-advanced (p?<?0.0001). Individual item discrimination was excellent (Item Discrimination Index ranging from 0.37 to 0.84), with internal reliability consistent across all but three items (Item Total Correlations were all positive ranging from 0.14 to 0.20).ConclusionThe 15-item ACE tool is a reliable and valid instrument to assess medical trainees' competency in EBM. The ACE tool provides a novel assessment that measures user performance across the four main steps of EBM. To provide a complete suite of instruments to assess EBM competency across various patient scenarios, future refinement of the ACE instrument should include further scenarios across harm, diagnosis and prognosis.
| S-EPMC4062508 | biostudies-literature
Project description:Introduction:Research on disparities in health and health care has demonstrated that social, economic, and political factors are key drivers of poor health outcomes. Yet the role of such structural forces on health and health care has been incorporated unevenly into medical training. The framework of structural competency offers a paradigm for training health professionals to recognize and respond to the impact of upstream, structural factors on patient health and health care. Methods:We report on a brief, interprofessional structural competency curriculum implemented in 32 distinct instances between 2015 and 2017 throughout the San Francisco Bay Area. In consultation with medical and interprofessional education experts, we developed open-ended, written-response surveys to qualitatively evaluate this curriculum's impact on participants. Qualitative data from 15 iterations were analyzed via directed thematic analysis, coding language, and concepts to identify key themes. Results:Three core themes emerged from analysis of participants' comments. First, participants valued the curriculum's focus on the application of the structural competency framework in real-world clinical, community, and policy contexts. Second, participants with clinical experience (residents, fellows, and faculty) reported that the curriculum helped them reframe how they thought about patients. Third, participants reported feeling reconnected to their original motivations for entering the health professions. Discussion:This structural competency curriculum fills a gap in health professional education by equipping learners to understand and respond to the role that social, economic, and political structural factors play in patient and community health.
| S-EPMC7182045 | biostudies-literature