Dataset Information

Teaching and assessing communication skills in the postgraduate medical setting: a systematic scoping review.

ABSTRACT:

Background

Poor communication skills can potentially compromise patient care. However, as communication skills training (CST) programs are not seen as a priority to many clinical departments, there is a discernible absence of a standardised, recommended framework for these programs to be built upon. This systematic scoping review (SSR) aims to gather prevailing data on existing CSTs to identify key factors in teaching and assessing communication skills in the postgraduate medical setting.

Methods

Independent searches across seven bibliographic databases (PubMed, PsycINFO, EMBASE, ERIC, CINAHL, Scopus and Google Scholar) were carried out. Krishna's Systematic Evidence-Based Approach (SEBA) was used to guide concurrent thematic and content analysis of the data. The themes and categories identified were compared and combined where possible in keeping with this approach and then compared with the tabulated summaries of the included articles.

Results

Twenty-five thousand eight hundred ninety-four abstracts were identified, and 151 articles were included and analysed. The Split Approach revealed similar categories and themes: curriculum design, teaching methods, curriculum content, assessment methods, integration into curriculum, and facilitators and barriers to CST. Amidst a wide variety of curricula designs, efforts to develop the requisite knowledge, skills and attitudes set out by the ACGME current teaching and assessment methods in CST maybe categorised into didactic and interactive methods and assessed along Kirkpatrick's Four Levels of Learning Evaluation.

Conclusions

A major flaw in existing CSTs is a lack of curriculum structure, focus and standardisation. Based upon the findings and current design principles identified in this SSR in SEBA, we forward a stepwise approach to designing CST programs. These involve 1) defining goals and learning objectives, 2) identifying target population and ideal characteristics, 3) determining curriculum structure, 4) ensuring adequate resources and mitigating barriers, 5) determining curriculum content, and 6) assessing learners and adopting quality improvement processes.

SUBMITTER: Tan XH

PROVIDER: S-EPMC8431930 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundPatient-clinician communication training is a core component of the undergraduate medical program. As with all areas of medicine, the best available evidence for teaching these skills should be incorporated into training programs. Examining the volume, type and design-quality of publications in this field can help to determine whether research is following a natural scientific progression to inform interactional skills training. This study aimed to review: (i) whether the proportion of publications examining teaching interactional skills to undergraduate medical students by study type, across three time-periods (2007-2008, 2011-2012, 2015-2016), changed over time (i.e. measurement, descriptive or interventions studies); and (ii) the proportion of intervention studies meeting Cochrane Effective Practice and Organisation of Care (EPOC) research design criteria.MethodsMedline, PubMed, PsycInfo and the Cochrane Database were searched for studies published in English from 2007 to 2016. Title and abstract reviews were performed for the included years. Articles were examined against the inclusion/exclusion criteria and those included were coded into descriptive, measurement or intervention categories.ResultsA total of 243 relevant publications were identified. Fifty-two were published from 2007 to 2008, 75 from 2011 to 2012 and 116 from 2015 to 2016. Most identified studies were descriptive (63%), followed by measurement studies (22%) and intervention studies (15%). The proportion of descriptive studies increased significantly over time. However, the proportion of intervention studies did not change and the proportion of measures studies significantly decreased. Of the 37 intervention studies identified within the three time-periods, only 16 (43%) met EPOC study design criteria.ConclusionsThe largest proportion of identified studies were descriptive, however, descriptive research is not sufficient to ensure communication skills training can effectively improve interactions between clinicians and patients. A more rigorous approach to research in this area is needed to inform education strategies.

Project description:BackgroundTeaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales.MethodsWe conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues.ResultsData of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate.DiscussionOur results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

Project description:BackgroundMolding competent clinicians capable of applying ethics principles in their practice is a challenging task, compounded by wide variations in the teaching and assessment of ethics in the postgraduate setting. Despite these differences, ethics training programs should recognise that the transition from medical students to healthcare professionals entails a longitudinal process where ethics knowledge, skills and identity continue to build and deepen over time with clinical exposure. A systematic scoping review is proposed to analyse current postgraduate medical ethics training and assessment programs in peer-reviewed literature to guide the development of a local physician training curriculum.MethodsWith a constructivist perspective and relativist lens, this systematic scoping review on postgraduate medical ethics training and assessment will adopt the Systematic Evidence Based Approach (SEBA) to create a transparent and reproducible review.ResultsThe first search involving the teaching of ethics yielded 7669 abstracts with 573 full text articles evaluated and 66 articles included. The second search involving the assessment of ethics identified 9919 abstracts with 333 full text articles reviewed and 29 articles included. The themes identified from the two searches were the goals and objectives, content, pedagogy, enabling and limiting factors of teaching ethics and assessment modalities used. Despite inherent disparities in ethics training programs, they provide a platform for learners to apply knowledge, translating it to skill and eventually becoming part of the identity of the learner. Illustrating the longitudinal nature of ethics training, the spiral curriculum seamlessly integrates and fortifies prevailing ethical knowledge acquired in medical school with the layering of new specialty, clinical and research specific content in professional practice. Various assessment methods are employed with special mention of portfolios as a longitudinal assessment modality that showcase the impact of ethics training on the development of professional identity formation (PIF).ConclusionsOur systematic scoping review has elicited key learning points in the teaching and assessment of ethics in the postgraduate setting. However, more research needs to be done on establishing Entrustable Professional Activities (EPA)s in ethics, with further exploration of the use of portfolios and key factors influencing its design, implementation and assessment of PIF and micro-credentialling in ethics practice.

Project description:BackgroundResidents need to be trained across the boundaries of their own specialty to prepare them for collaborative practice. Intraprofessional learning (i.e. between individuals of different disciplines within the same profession) has received little attention in the postgraduate medical education literature, in contrast to the extensive literature on interprofessional learning between individuals of different professions. To address this gap, we performed a scoping review to investigate what and how residents learn from workplace-related intraprofessional activities, and what factors influence learning.MethodsThe PRISMA guidelines were used to conduct a scoping review of empirical studies on intraprofessional workplace learning in postgraduate medical education published between 1 January 2000 to 16 April 2020 in Pubmed, Embase, PsycINFO, ERIC and Web of Science. This study applied 'best fit' framework-based synthesis to map the existing evidence, using the presage-process-product (3P) model developed by Tynjälä (2013).ResultsFour thousand three hundred thirty records were screened, and 37 articles were included. This review identified influencing (presage) factors that derived from the sociocultural environment, learner and learning context. Studies described that complexity of care can both facilitate and hinder learning. Furthermore, intraprofessional learning is threatened by professional stereotyping and negative perceptions, and awareness of learning opportunities and explicit reflection are critical in intraprofessional workplace learning. Studies described a range of informal and formal intraprofessional activities (process) under the headings of collaboration in clinical practice, rotations or placements, formal educational sessions and simulated workplace training. In general, learners responded well and their attitudes and perceptions improved, learners reported increased knowledge and skills and positive behavioural changes (product). Learning outcomes were reported in the domains of patient-centred care, collaborative attitudes and respect, mutual knowledge and understanding, collaborative decision making, communication, leadership, teamwork and reflexivity.ConclusionsThis review gives insight into the high learning potential of intraprofessional activities. Many of the included studies relied on self-reported perceptions of change, therefore, future research should focus on generating more robust evidence including objectively examined outcome measures. This review offers a comprehensive overview of the factors that influence intraprofessional workplace learning in postgraduate medical education. Finally, we provide recommendations for enhancing intraprofessional learning in clinical practice.

Project description:BackgroundElectronic learning (e-learning) in postgraduate medical education has seen a rapid evolution; however, we tend to evaluate it only on its primary outcome or learning aim, whereas its effectiveness also depends on its instructional design. We believe it is important to have an overview of all the methods currently used to evaluate e-learning design so that the preferred method may be identified and the next steps needed to continue to evaluate postgraduate medical e-learning may be outlined.ObjectiveThis study aimed to identify and compare the outcomes and methods used to evaluate postgraduate medical e-learning.MethodsWe performed a systematic literature review using the Web of Science, PubMed, Education Resources Information Center, and Cumulative Index of Nursing and Allied Health Literature databases. Studies that used postgraduates as participants and evaluated any form of e-learning were included. Studies without any evaluation outcome (eg, just a description of e-learning) were excluded.ResultsThe initial search identified 5973 articles, of which we used 418 for our analysis. The types of studies were trials, prospective cohorts, case reports, and reviews. The primary outcomes of the included studies were knowledge, skills, and attitude. A total of 12 instruments were used to evaluate a specific primary outcome, such as laparoscopic skills or stress related to training. The secondary outcomes mainly evaluated satisfaction, motivation, efficiency, and usefulness. We found 13 e-learning design methods across 19 studies (4% 19/418). The methods evaluated usability, motivational characteristics, and the use of learning styles or were based on instructional design theories, such as Gagne's instructional design, the Heidelberg inventory, Kern's curriculum development steps, and a scale based on the cognitive load theory. Finally, 2 instruments attempted to evaluate several aspects of a design, based on the experience of creating e-learning.ConclusionsEvaluating the effect of e-learning design is complicated. Given the diversity of e-learning methods, there are many ways to carry out such an evaluation, and probably, many ways to do so correctly. However, the current literature shows us that we have yet to reach any form of consensus about which indicators to evaluate. There is a great need for an evaluation tool that is properly constructed, validated, and tested. This could be a more homogeneous way to compare the effects of e-learning and for the authors of e-learning to continue to improve their product.