Dataset Information

A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education.

ABSTRACT: BACKGROUND:The importance of teaching the skills and practice of evidence-based medicine (EBM) for medical professionals has steadily grown in recent years. Alongside this growth is a need to evaluate the effectiveness of EBM curriculum as assessed by competency in the five 'A's': asking, acquiring, appraising, applying and assessing (impact and performance). EBM educators in medical education will benefit from a compendium of existing assessment tools for assessing EBM competencies in their settings. The purpose of this review is to provide a systematic review and taxonomy of validated tools that evaluate EBM teaching in medical education. METHODS:We searched MEDLINE, EMBASE, Cochrane library, Educational Resources Information Centre (ERIC), Best Evidence Medical Education (BEME) databases and references of retrieved articles published between January 2005 and March 2019. We have presented the identified tools along with their psychometric properties including validity, reliability and relevance to the five domains of EBM practice and dimensions of EBM learning. We also assessed the quality of the tools to identify high quality tools as those supported by established interrater reliability (if applicable), objective (non-self-reported) outcome measures and achieved ??3 types of established validity evidence. We have reported our study in accordance with the PRISMA guidelines. RESULTS:We identified 1719 potentially relevant articles of which 63 full text articles were assessed for eligibility against inclusion and exclusion criteria. Twelve articles each with a unique and newly identified tool were included in the final analysis. Of the twelve tools, all of them assessed the third step of EBM practice (appraise) and four assessed just that one step. None of the twelve tools assessed the last step of EBM practice (assess). Of the seven domains of EBM learning, ten tools assessed knowledge gain, nine assessed skills and-one assessed attitude. None addressed reaction to EBM teaching, self-efficacy, behaviours or patient benefit. Of the twelve tools identified, six were high quality. We have also provided a taxonomy of tools using the CREATE framework, for EBM teachers in medical education. CONCLUSIONS:Six tools of reasonable validity are available for evaluating most steps of EBM and some domains of EBM learning. Further development and validation of tools that evaluate all the steps in EBM and all educational outcome domains are needed. SYSTEMATIC REVIEW REGISTRATION:PROSPERO CRD42018116203.

SUBMITTER: Kumaravel B

PROVIDER: S-EPMC7183115 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education.

Kumaravel Bharathy B Hearn Jasmine Heath JH Jahangiri Leila L Pollard Rachel R Stocker Claire J CJ Stocker Claire J CJ Nunan David D

Systematic reviews 20200424 1

<h4>Background</h4>The importance of teaching the skills and practice of evidence-based medicine (EBM) for medical professionals has steadily grown in recent years. Alongside this growth is a need to evaluate the effectiveness of EBM curriculum as assessed by competency in the five 'A's': asking, acquiring, appraising, applying and assessing (impact and performance). EBM educators in medical education will benefit from a compendium of existing assessment tools for assessing EBM competencies in t ...[more]

PMID: 32331530

Similar Datasets

Project description:OBJECTIVE:Synthesise evidence about the impact of family medicine/general practice (FM) clerkships on undergraduate medical students, teaching general/family practitioners (FPs) and/or their patients. DATA SOURCES:Medline, ERIC, PsycINFO, EMBASE and Web of Knowledge searched from 21 November to 17 December 2013. Primary, empirical, quantitative or qualitative studies, since 1990, with abstracts included. No country restrictions. Full text languages: English, French, Spanish, German, Dutch or Italian. REVIEW METHODS:Independent selection and data extraction by two authors using predefined data extraction fields, including Kirkpatrick's levels for educational intervention outcomes, study quality indicators and Best Evidence Medical Education (BEME) strength of findings' grades. Descriptive narrative synthesis applied. RESULTS:Sixty-four included articles: impact on students (48), teaching FPs (12) and patients (8). Sample sizes: 16-1095 students, 3-146 FPs and 94-2550 patients. Twenty-six studies evaluated at Kirkpatrick level 1, 26 at level 2 and 6 at level 3. Only one study achieved BEME's grade 5. The majority was assessed as grade 4 (27) and 3 (33). Students reported satisfaction with content and process of teaching as well as learning in FM clerkships. They enhanced previous learning, and provided unique learning on dealing with common acute and chronic conditions, health maintenance, disease prevention, communication and problem-solving skills. Students' attitudes towards FM were improved, but new or enhanced interest in FM careers did not persist without change after graduation. Teaching FPs reported increased job satisfaction and stimulation for professional development, but also increased workload and less productivity, depending on the setting. Overall, student's presence and participation did not have a negative impact on patients. CONCLUSIONS:Research quality on the impact of FM clerkships is still limited, yet across different settings and countries, positive impact is reported on students, FPs and patients. Future studies should involve different stakeholders, medical schools and countries, and use standardised and validated evaluation tools.

Project description:IntroductionPain management is a major health care challenge in terms of the significant prevalence of pain and the negative consequences of poor management. Consequently, there have been international calls to improve pain medicine education for medical students. This systematic review examines the literature on pain medicine education at medical schools internationally, with a particular interest in studies that make reference to: a defined pain medicine curriculum, specific pain medicine learning objectives, dedicated pain education modules, core pain topics, medical specialties that teach pain medicine, elective study opportunities, hours allocated to teaching pain medicine during the curriculum, the status of pain medicine in the curriculum (compulsory or optional), as well as teaching, learning, and assessment methods.MethodsA systematic review was undertaken of relevant studies on pain medicine education for medical students published between January 1987 and May 2018 using PubMed, Medline, Excerpta Medica database (EMBASE), Education Resources Information Center (ERIC), and Google Scholar, and Best Evidence Medical Education (BEME) data bases.ResultsFourteen studies met the inclusion criteria. Evaluation of pain medicine curricula has been undertaken at 383 medical schools in Australia, New Zealand, the United States of America (USA), Canada, the United Kingdom (UK), and Europe. Pain medicine was mostly incorporated into medical courses such as anaesthesia or pharmacology, rather than presented as a dedicated pain medicine module. Ninety-six percent of medical schools in the UK and USA, and nearly 80% of medical schools in Europe had no compulsory dedicated teaching in pain medicine. On average, the median number of hours of pain content in the entire curriculum was 20 in Canada (2009), 20 in Australia and New Zealand (2018), 13 in the UK (2011), 12 in Europe (2012/2013), and 11 in the USA (2009). Neurophysiology and pharmacology pain topics were given priority by medical schools in all countries. Lectures, seminars, and case-based instruction were the teaching methods most commonly employed. When it was undertaken, medical schools mostly assessed student competency in pain medicine using written examinations rather than clinical assessments.ConclusionsThis systematic review has revealed that pain medicine education at medical schools internationally does not adequately respond to societal needs in terms of the prevalence and public health impact of inadequately managed pain.

Project description:PhenomenonResearch literacy remains important for equipping clinicians with the analytical skills to tackle an ever-evolving medical landscape and maintain an evidence-based approach when treating patients. While the role of research in medical education has been justified and established, the nuances involving modes of instruction and relevant outcomes for students have yet to be analyzed. Institutions acknowledge an increasing need to dedicate time and resources towards educating medical undergraduates on research but have individually implemented different pedagogies over differing lengths of time.ApproachWhile individual studies have evaluated the efficacy of these curricula, the evaluations of educational methods and curriculum design have not been reviewed systematically. This study thereby aims to perform a systematic review of studies incorporating research into the undergraduate medical curriculum, to provide insights on various pedagogies utilized to educate medical students on research.FindingsStudies predominantly described two major components of research curricula-(1) imparting basic research skills and the (2) longitudinal application of research skills. Studies were assessed according to the 4-level Kirkpatrick model for evaluation. Programs that spanned minimally an academic year had the greatest proportion of level 3 outcomes (50%). One study observed a level 4 outcome by assessing the post-intervention effects on participants. Studies primarily highlighted a shortage of time (53%), resulting in inadequate coverage of content.InsightsThis study highlighted the value in long-term programs that support students in acquiring research skills, by providing appropriate mentors, resources, and guidance to facilitate their learning. The Dreyfus model of skill acquisition underscored the importance of tailoring educational interventions to allow students with varying experience to develop their skills. There is still room for further investigation of multiple factors such as duration of intervention, student voluntariness, and participants' prior research experience. Nevertheless, it stands that mentoring is a crucial aspect of curricula that has allowed studies to achieve level 3 Kirkpatrick outcomes and engender enduring changes in students.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-020-01183-w.

Project description:PurposeThe world's population is ageing. Therefore, every doctor should receive geriatric medicine training during their undergraduate education. This review aims to summarise recent developments in geriatric medicine that will potentially inform developments and updating of undergraduate medical curricula for geriatric content.MethodsWe systematically searched the electronic databases Ovid Medline, Ovid Embase and Pubmed, from 1st January 2009 to 18th May 2021. We included studies related to (1) undergraduate medical students and (2) geriatric medicine or ageing or older adults and (3) curriculum or curriculum topics or learning objectives or competencies or teaching methods or students' attitudes and (4) published in a scientific journal. No language restrictions were applied.ResultsWe identified 2503 records and assessed the full texts of 393 records for eligibility with 367 records included in the thematic analysis. Six major themes emerged: curriculum, topics, teaching methods, teaching settings, medical students' skills and medical students' attitudes. New curricula focussed on minimum Geriatrics Competencies, Geriatric Psychiatry and Comprehensive Geriatric Assessment; vertical integration of Geriatric Medicine into the curriculum has been advocated. Emerging or evolving topics included delirium, pharmacotherapeutics, healthy ageing and health promotion, and Telemedicine. Teaching methods emphasised interprofessional education, senior mentor programmes and intergenerational contact, student journaling and reflective writing, simulation, clinical placements and e-learning. Nursing homes featured among new teaching settings. Communication skills, empathy and professionalism were highlighted as essential skills for interacting with older adults.ConclusionWe recommend that future undergraduate medical curricula in Geriatric Medicine should take into account recent developments described in this paper. In addition to including newly emerged topics and advances in existing topics, different teaching settings and methods should also be considered. Employing vertical integration throughout the undergraduate course can usefully supplement learning achieved in a dedicated Geriatric Medicine undergraduate course. Interprofessional education can improve understanding of the roles of other professionals and improve team-working skills. A focus on improving communication skills and empathy should particularly enable better interaction with older patients. Embedding expected levels of Geriatric competencies should ensure that medical students have acquired the skills necessary to effectively treat older patients.

Dataset Information

A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education.

Publications

A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets