Dataset Information

Determining Expected Research Skills of Medical Students on Graduation: a Systematic Review.

ABSTRACT:

Background

Global interest in research skills in undergraduate medical education is growing. There is no consensus regarding expected research skills of medical students on graduation. We conducted a systematic review to determine the aims and intended learning outcomes (ILOs) of mandatory research components of undergraduate medical curricula incorporating the teaching, assessment, and evaluation methods of these programs.

Methods

Using the PRISMA protocol, MEDLINE and ERIC databases were searched with keywords related to "medical student research programs" for relevant articles published up until February 2020. Thematic analysis was conducted according to student experience/reactions, mentoring/career development, and knowledge/skill development.

Results

Of 4880 citations, 41 studies from 30 institutions met the inclusion criteria. Programs were project-based in 24 (80%) and coursework only-based in 6 (20%). Program aims/ILOs were stated in 24 programs (80%). Twenty-seven different aims/ILOs were identified: 19 focused on knowledge/skill development, 4 on experience/reactions, and 4 on mentoring/career development. Project-based programs aimed to provide an in-depth research experience, foster/increase research skills, and critically appraise scientific literature. Coursework-based programs aimed to foster/apply analytical skills for decision-making in healthcare and critically appraise scientific literature. Reporting of interventions was often incomplete, short term, and single institution. There was poor alignment between aims, teaching, assessment, and evaluation methods in most.

Conclusions

The diversity of teaching programs highlights challenges in defining core competencies in research skills for medical graduates. Incomplete reporting limits the evidence for effective research skills education; we recommend those designing and reporting educational interventions adopt recognized educational reporting criteria when describing their findings. Whether students learn by "doing", "proposing to do", or "critiquing", good curriculum design requires constructive alignment between teaching, assessment, and evaluation methods, aims, and outcomes. Peer-reviewed publications and presentations only evaluate one aspect of the student research experience.

SUBMITTER: Lee MGY

PROVIDER: S-EPMC8368133 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:PhenomenonResearch literacy remains important for equipping clinicians with the analytical skills to tackle an ever-evolving medical landscape and maintain an evidence-based approach when treating patients. While the role of research in medical education has been justified and established, the nuances involving modes of instruction and relevant outcomes for students have yet to be analyzed. Institutions acknowledge an increasing need to dedicate time and resources towards educating medical undergraduates on research but have individually implemented different pedagogies over differing lengths of time.ApproachWhile individual studies have evaluated the efficacy of these curricula, the evaluations of educational methods and curriculum design have not been reviewed systematically. This study thereby aims to perform a systematic review of studies incorporating research into the undergraduate medical curriculum, to provide insights on various pedagogies utilized to educate medical students on research.FindingsStudies predominantly described two major components of research curricula-(1) imparting basic research skills and the (2) longitudinal application of research skills. Studies were assessed according to the 4-level Kirkpatrick model for evaluation. Programs that spanned minimally an academic year had the greatest proportion of level 3 outcomes (50%). One study observed a level 4 outcome by assessing the post-intervention effects on participants. Studies primarily highlighted a shortage of time (53%), resulting in inadequate coverage of content.InsightsThis study highlighted the value in long-term programs that support students in acquiring research skills, by providing appropriate mentors, resources, and guidance to facilitate their learning. The Dreyfus model of skill acquisition underscored the importance of tailoring educational interventions to allow students with varying experience to develop their skills. There is still room for further investigation of multiple factors such as duration of intervention, student voluntariness, and participants' prior research experience. Nevertheless, it stands that mentoring is a crucial aspect of curricula that has allowed studies to achieve level 3 Kirkpatrick outcomes and engender enduring changes in students.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-020-01183-w.

Project description:BackgroundTeaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales.MethodsWe conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues.ResultsData of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate.DiscussionOur results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

Project description:BackgroundThe international migration of physicians is a global public health problem. Lebanon is a source country with the highest emigration factor in the Middle East and North Africa and the 7th highest in the World. Given that residency training abroad is a critical step in the migration of physicians, the objective of this study was to survey students of Lebanese medical schools about their intentions to train abroad and their post training plans.MethodsOur target population consisted of all students of Lebanese medical schools in the pre-final and final years of medical school. We developed the survey questionnaire based on the results of a qualitative study assessing the intentions and motives for students of Lebanese medical schools to train abroad. The questionnaire inquired about student's demographic and educational characteristics, intention to train abroad, the chosen country of abroad training, and post-training intention of returning to Lebanon.ResultsOf 576 eligible students, 425 participated (73.8% response rate). 406 (95.5%) respondents intended to travel abroad either for specialty training (330 (77.6%)) or subspecialty training (76 (17.9%)). Intention to train abroad was associated with being single compared with being married. The top 4 destination countries were the US (301(74.1%)), France (49 (12.1%)), the United Kingdom (31 (7.6%)) and Canada (17 (4.2%)). One hundred and two (25.1%) respondents intended to return to Lebanon directly after finishing training abroad; 259 (63.8%) intended to return to Lebanon after working abroad temporarily for a varying number or years; 43 (10.6%) intended to never return to Lebanon. The intention to stay indefinitely abroad was associated male sex and having a 2nd citizenship. It was inversely associated with being a student of one of the French affiliated medical schools and a plan to train in a surgical specialty.ConclusionAn alarming percentage of students of Lebanese medical schools intend to migrate for post graduate training, mainly to the US. A minority intends to return directly to Lebanon after finishing training abroad.

Project description:BackgroundPatient-clinician communication training is a core component of the undergraduate medical program. As with all areas of medicine, the best available evidence for teaching these skills should be incorporated into training programs. Examining the volume, type and design-quality of publications in this field can help to determine whether research is following a natural scientific progression to inform interactional skills training. This study aimed to review: (i) whether the proportion of publications examining teaching interactional skills to undergraduate medical students by study type, across three time-periods (2007-2008, 2011-2012, 2015-2016), changed over time (i.e. measurement, descriptive or interventions studies); and (ii) the proportion of intervention studies meeting Cochrane Effective Practice and Organisation of Care (EPOC) research design criteria.MethodsMedline, PubMed, PsycInfo and the Cochrane Database were searched for studies published in English from 2007 to 2016. Title and abstract reviews were performed for the included years. Articles were examined against the inclusion/exclusion criteria and those included were coded into descriptive, measurement or intervention categories.ResultsA total of 243 relevant publications were identified. Fifty-two were published from 2007 to 2008, 75 from 2011 to 2012 and 116 from 2015 to 2016. Most identified studies were descriptive (63%), followed by measurement studies (22%) and intervention studies (15%). The proportion of descriptive studies increased significantly over time. However, the proportion of intervention studies did not change and the proportion of measures studies significantly decreased. Of the 37 intervention studies identified within the three time-periods, only 16 (43%) met EPOC study design criteria.ConclusionsThe largest proportion of identified studies were descriptive, however, descriptive research is not sufficient to ensure communication skills training can effectively improve interactions between clinicians and patients. A more rigorous approach to research in this area is needed to inform education strategies.

Project description:BACKGROUND:Mentoring of medical students remains a core pillar of medical education, yet the changing landscape of medicine has called for new and innovative mentoring models to guide students in professional development, career placement, and overall student well-being. The objective of this review is to identify and describe models of mentorship for US medical students. METHODS:We searched PubMed, PsycINFO, Education Resources Information Center, and Cochrane Databases of Systematic Reviews following PRISMA guidelines. We included original, English-language studies of any research design including descriptive studies that described a mentorship program at a US medical school designed for medical students. RESULTS:Our search yielded 3743 unique citations. Thirty articles met our inclusion criteria. There was significant diversity of the identified programs with regard to program objectives and size. The traditional dyad model of mentorship was the most frequently cited model, with a combination of models (dyad and group mentorship) cited as the second most common. Outcome measures of the programs were largely survey based, with satisfaction being the most measured outcome. Overall, satisfaction was highly rated throughout all the measured mentoring programs. Seven programs provided objective outcomes measures, including improved residency match data and increased scholarly productivity. The programs with objective outcomes measures were smaller, and 6/7 of them focused on a specific clinical area. Five of these programs relied on the traditional dyad model of mentorship. Cost and faculty time were the most frequently cited barriers to these programs. DISCUSSION:Our review demonstrates that mentoring programs for medical students can positively improve medical school satisfaction and career development. These results underscore the need for continued innovative mentoring programs to foster optimal student development in the setting of the increasingly competitive residency match process, growing expectations about student research productivity, and the national focus for overall student wellness.