Dataset Information

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

ABSTRACT: PURPOSE:Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. METHOD:The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. RESULTS:Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. CONCLUSIONS:These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development.

SUBMITTER: Carney PA

PROVIDER: S-EPMC4846480 | biostudies-literature | 2016 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

Carney Patricia A PA Palmer Ryan T RT Fuqua Miller Marissa M Thayer Erin K EK Estroff Sue E SE Litzelman Debra K DK Biagioli Frances E FE Teal Cayla R CR Lambros Ann A Hatt William J WJ Satterfield Jason M JM

Academic medicine : journal of the Association of American Medical Colleges 20160501 5

<h4>Purpose</h4>Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS co ...[more]

PMID: 26796091

Similar Datasets

Project description:BackgroundThe importance of teaching the skills and practice of evidence-based medicine (EBM) for medical professionals has steadily grown in recent years. Alongside this growth is a need to evaluate the effectiveness of EBM curriculum as assessed by competency in the five 'A's': asking, acquiring, appraising, applying and assessing (impact and performance). EBM educators in medical education will benefit from a compendium of existing assessment tools for assessing EBM competencies in their settings. The purpose of this review is to provide a systematic review and taxonomy of validated tools that evaluate EBM teaching in medical education.MethodsWe searched MEDLINE, EMBASE, Cochrane library, Educational Resources Information Centre (ERIC), Best Evidence Medical Education (BEME) databases and references of retrieved articles published between January 2005 and March 2019. We have presented the identified tools along with their psychometric properties including validity, reliability and relevance to the five domains of EBM practice and dimensions of EBM learning. We also assessed the quality of the tools to identify high quality tools as those supported by established interrater reliability (if applicable), objective (non-self-reported) outcome measures and achieved ≥ 3 types of established validity evidence. We have reported our study in accordance with the PRISMA guidelines.ResultsWe identified 1719 potentially relevant articles of which 63 full text articles were assessed for eligibility against inclusion and exclusion criteria. Twelve articles each with a unique and newly identified tool were included in the final analysis. Of the twelve tools, all of them assessed the third step of EBM practice (appraise) and four assessed just that one step. None of the twelve tools assessed the last step of EBM practice (assess). Of the seven domains of EBM learning, ten tools assessed knowledge gain, nine assessed skills and-one assessed attitude. None addressed reaction to EBM teaching, self-efficacy, behaviours or patient benefit. Of the twelve tools identified, six were high quality. We have also provided a taxonomy of tools using the CREATE framework, for EBM teachers in medical education.ConclusionsSix tools of reasonable validity are available for evaluating most steps of EBM and some domains of EBM learning. Further development and validation of tools that evaluate all the steps in EBM and all educational outcome domains are needed.Systematic review registrationPROSPERO CRD42018116203.

Project description:ObjectiveWith this article we want to support teachers and curriculum planners to be aware of and apply knowledge and recommendations of organisational (OD), curriculums (CD) and human resource development (HRD) ideas already in the planning phase of a project. Taking these into account can influence the process of change successfully and controlled during the introduction and establishment of curricula in the field of communication and social skills in medical education.Approach and resultsIn the context of a multi-stage developmental process, a recommendation on CD for "Communicative and social competencies" was developed. The basis for it was made during two workshops of the GMA-committee "Communicative and social competencies" and supplemented by the available literature and the experience of communication experts. The "Undeloher Recommendation" (see attachment ) includes a compilation of recommendations and guiding questions, which is geared to the various phases of CD. Additionally, general approaches and recommendations of organisational and human resource development were integrated, which turned out to be particularly relevant in the process of CD. Thus, the "Undeloher recommendation" includes an orientation for each phase of the curriculum development process, the organisation and the staff in order to successfully implement a longitudinal curriculum. In addition to theoretical models the long-term discussion process and the personal experiences of a variety of curriculum planners and teachers have been integrated.ConclusionThe "Undeloher recommendation" can support the implementation processes of curricula in communication and social skills during development and realisation. Its application was reviewed in the context of workshops based on concrete examples. The participating teachers and curriculum planners assessed it to be very helpful. The recommendation goes beyond of what has been described in terms of content models in the CD so fare. In particular, the organisational and human resource development related aspects such as the formation of a steering committee and recommendations for the phase of sustainability.

Dataset Information

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

Publications

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets