Dataset Information

Ward rounds in internal medicine: Validation of an Entrustable Professional Activity (EPA) observation checklist.

ABSTRACT: Objectives: Ward rounds serve a crucial daily activity in hospitals. Building on the Entrustable Professional Activity "Conducting internal medicine ward rounds" consisting of ten competencies and 25 corresponding activities, this study aims at assessing content and external validity of an observation checklist for this EPA. Methods: A focus group aimed at content validation of the checklist. Five participants therefore evaluated it with respect to comprehensiveness and comprehensibility. To investigate external validity, 14 authentic ward rounds were video-taped and rated by two raters with the adapted observation checklist in terms of the appearance of certain activities in the videos. Results: After some adaptions, participants of the focus group agreed on a checklist consisting of nine competencies, 25 activities and 110 examples of observable behaviours supporting content validity. External validity was studied by using the observation checklist for ratings of ward round videos. The checklist was regarded as a valuable tool to structure observation. Along with the high frequencies of observed behaviour and interrater-reliability, external validity can be assumed. Conclusion: The first scientifically developed comprehensive observation checklist for the EPA conducting a ward round in internal medicine is presented. The checklist is a valuable tool for providing elaborated feedback in undergraduate and graduate medical education. Focussing on multi-institutional validation and the cut offs of the checklist to determine the levels of entrustment are recommended for future research.

SUBMITTER: Schmelter V

PROVIDER: S-EPMC6022584 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Ward rounds in internal medicine: Validation of an Entrustable Professional Activity (EPA) observation checklist.

Schmelter Valerie V März Esther E Adolf Christian C Wölfel Teresa L TL Lottspeich Christian C Fischer Martin R MR Schmidmaier Ralf R

GMS journal for medical education 20180515 2

<b>Objectives:</b> Ward rounds serve a crucial daily activity in hospitals. Building on the Entrustable Professional Activity "Conducting internal medicine ward rounds" consisting of ten competencies and 25 corresponding activities, this study aims at assessing content and external validity of an observation checklist for this EPA. <b>Methods:</b> A focus group aimed at content validation of the checklist. Five participants therefore evaluated it with respect to comprehensiveness and comprehensi ...[more]

PMID: 29963607

Similar Datasets

Project description:BackgroundWard rounds form an integral part of Internal Medicine teaching. This study aimed to determine the trainees' opinions regarding various aspects of their ward rounds, including how well they cover their learning needs, how they would like the rounds to be conducted, and differences of opinion between medical students and postgraduates.MethodsA cross-sectional study was conducted on a total of 134 trainees in Internal Medicine, comprising medical students, interns, residents and fellows, who were asked to fill in a structured, self-designed questionnaire. Most of the responses required a rating on a scale of 1-5 (1 being highly unsatisfactory and 5 being highly satisfactory).ResultsTeaching of clinical skills and bedside teaching received the lowest overall mean score (Mean +/- SD 2.48 +/- 1.02 and 2.49 +/- 1.12 respectively). They were rated much lower by postgraduates as compared to students (p < 0.001). All respondents felt that management of patients was the aspect best covered by the current ward rounds (Mean +/- SD 3.71 +/- 0.72). For their desired ward rounds, management of patients received the highest score (Mean +/- SD 4.64 +/- 0.55), followed by bedside examinations (Mean +/- SD 4.60 +/- 0.61) and clinical skills teaching (Mean +/- SD 4.50 +/- 0.68). The postgraduates desired a lot more focus on communication skills, counselling and medical ethics as compared to students, whose primary focus was teaching of bedside examination and management. A majority of the respondents (87%) preferred bedside rounds over conference room rounds. Even though the duration of rounds was found to be adequate, a majority of the trainees (68%) felt there was a lack of individual attention during ward rounds.ConclusionsThis study highlights important areas where ward rounds need improvement in order to maximize their benefit to the learners. There is a need to modify the current state of ward rounds in order to address the needs and expectations of trainees.

Project description:IntroductionMedical education is moving toward a competency-based framework with a focus on assessment using the Accreditation Council for Graduate Medical Education Milestones. Assessment of individual competencies through milestones can be challenging. While competencies describe characteristics of the person, the entrustable professional activities (EPAs) concept refers to work-related activities. EPAs would not replace the milestones but would be linked to them, integrating these frameworks. Many core specialties have already defined EPAs for resident trainees, but EPAs have not yet been created for emergency medicine (EM). This paper describes the development of milestone-linked EPAs for EM.MethodsTen EM educators from across North America formed a consensus working group to draft EM EPAs, using a modified Glaser state-of-the-art approach. A reactor panel with EPA experts from the United States, Canada and the Netherlands was created, and an iterative process with multiple revisions was performed based on reactor panel input. Following this, the EPAs were sent to the Council of Residency Directors for EM (CORD-EM) listserv for additional feedback.ResultsThe product was 11 core EPAs that every trainee from every EM program should be able to perform independently by the time of graduation. Each EPA has associated knowledge, skills, attitudes and behaviors (KSAB), which are either milestones themselves or KSABs linked to individual milestones. We recognize that individual programs may have additional focus areas or work-based activities they want their trainees to achieve by graduation; therefore, programs are also encouraged to create additional program-specific EPAs.ConclusionThis set of 11 core, EM-resident EPAs can be used as an assessment tool by EM residency programs, allowing supervising physicians to document the multiple entrustment decisions they are already making during clinical shifts with trainees. The KSAB list within each EPA could assist supervisors in giving specific, actionable feedback to trainees and allow trainees to use this list as an assessment-for-learning tool. Linking each KSAB to individual EM milestones allows EPAs to directly inform milestone assessment for clinical competency committees. These EPAs serve as another option for workplace-based assessment, and are linked to the milestones to create an integrated framework.

Project description:ObjectivesTo develop and validate European entrustable professional activities (EPAs) for sub-specialised hepatobiliary and gastrointestinal (HB/GI) diagnostic imaging.Materials and methodsBoth European Society of Radiology and national curricula in HB/GI diagnostic radiology were thoroughly reviewed, resulting in preliminary EPAs drafted by a pilot group of expert radiologists in 2 different countries. Each EPA was fully described with 7 components (Specification/limitations; Potential risks of failing; Relevant domains of competence; Required experience, knowledge, skills, attitude and behaviour; Assessment information sources to assess progress and ground a summative entrustment decision; Entrustment for which level of supervision is to be reached; and Expiration date). The modified Delphi method with 3 Delphi rounds was chosen for validation. Content validity index (CVI) and median values were used for validation.ResultsThere were 15 preliminary EPAs, some of them divided according to 2 levels: resident and fellow level. The 37 members of the Delphi group were based in 2 different European countries with a background experience of 10 represented countries. Subsequent to the first Delphi round, 6 EPAs were accepted (CVI ≥ 0.8, median ≥ 4), 6 needed major revisions (CVI 0.7-0.79, median ≥ 4), 3 were rejected (CVI < 0.7) and 1 was added. After the second Delphi round, both the 6 revised EPAs and the additional one met the validation criteria (CVI ≥ 0.8, median ≥ 4). Finally, 13 EPAs were validated during the 3rd Delphi round with an agreement percentage of 95-100%.ConclusionThis study creates and validates EPAs for sub-specialised HB/GI diagnostic imaging.Critical relevance statementThirteen EPAs for sub-specialised hepatobiliary and gastrointestinal diagnostic imaging were created with a strong methodology, and as a first example set in sub-specialised diagnostic imaging, they provide a template for others to be created.Key points• The competence-based teaching in medical studies has recently been reintroduced through EPAs. • Thirteen EPAs have been developed for hepatobiliary and gastrointestinal sub-specialised diagnostic imaging. • These EPAs were validated using a Delphi modified method and provide a template for other to be created.

Dataset Information

Ward rounds in internal medicine: Validation of an Entrustable Professional Activity (EPA) observation checklist.

Publications

Ward rounds in internal medicine: Validation of an Entrustable Professional Activity (EPA) observation checklist.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets