Can Teachers Distinguish Competencies From Entrustable Professional Activities?
Ontology highlight
ABSTRACT: Introduction
There has been a recent transition from the use of "competencies" to "entrustable professional activities" (EPAs) in medical education assessment paradigms. Although this transition proceeds apace, few studies have examined these concepts in a practical context. Our study sought to examine how distinct the concepts of competencies and EPAs were to front-line clinical educators.Methods
A 20-item survey tool was developed based on the University of Calgary Department of Family Medicine's publicly available lists of competencies and EPAs. This tool required participants to identify given items as either a competency or an EPA, after reading a description of each. The tool was administered to a convenience sample of consenting clinical educators at 5 of the 14 training sites at the University of Toronto Department of Family and Community Medicine in 2018. We also collected information on years in practice, hours spent supervising per week, and direct involvement in medical education.Results
We analyzed a total of 60 surveys. The mean rate of correct responses was 45.3% (+/- 21.8%). Subgroup analysis failed to reveal any correlation between any of the secondary characteristics and correct responses.Conclusion
Clinical educators in our study were not able to distinguish between competencies and EPAs. Further research is recommended prior to intensive curricular changes.
SUBMITTER: Broussenko M
PROVIDER: S-EPMC7205098 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundBedside teaching is an important modality for training medical students and postgraduate trainees in clinical settings. Despite its significance, the effective practice of Bedside teaching has been declining over the past few decades. The literature highlighted the need for structured training, assessment, and certification or in other words entrustment of bedside teachers. The current study aims to develop and validate the Entrustable Professional Activities (EPAs) for bedside clinical teachers.MethodsA multi-method study with clinical teachers, medical educationists, and postgraduate medical students was conducted from July 2021-22. First, a nominal group using the jigsaw puzzle technique was conducted with 16 participants to identify EPAs. Then these EPAs were mapped and validated by the skills/competencies identified in the literature. Next, the EPAs were evaluated using the EQual rubric by 3 medical educationists. This was followed by two-rounds of modified Delphi to develop consensus among 90 participants in round-one and 69 in round-two. For qualitative data, a thematic analysis was conducted. For quantitative data, means and standard deviations were calculated.ResultsThe study identified five EPAs for bedside clinical teachers: developing bedside teaching program, planning bedside teaching session, conducting bedside teaching, conducting bedside assessments and evaluating bedside teaching.ConclusionsThis study comprehensively developed and validated a full description of EPAs for bedside clinical teachers. The EPAs identified in the study can serve as a guiding framework for bedside clinical teachers' training, assessment, and entrustment.
| S-EPMC11331656 | biostudies-literature
Project description:PurposeAs global health education and training shift toward competency-based approaches, academic institutions and organizations must define appropriate assessment strategies for use across health professions. The authors aim to develop entrustable professional activities (EPAs) for global health to apply across academic and workplace settings.MethodIn 2019, the authors invited 55 global health experts from medicine, nursing, pharmacy, and public health to participate in a multiround, online Delphi process; 30 (55%) agreed. Experts averaged 17 years of global health experience, and 12 (40%) were from low- to middle-income countries. In round one, participants listed essential global health activities. The authors used in vivo coding for round one responses to develop initial EPA statements. In subsequent rounds, participants used 5-point Likert-type scales to evaluate EPA statements for importance and relevance to global health across health professions. The authors elevated statements that were rated 4 (important/relevant to most) or 5 (very important/relevant to all) by a minimum of 70% of participants (decided a priori) to the final round, during which participants evaluated whether each statement represented an observable unit of work that could be assigned to a trainee. Descriptive statistics were used for quantitative data analysis. The authors used participant comments to categorize EPA statements into role domains.ResultsTwenty-two EPA statements reached at least 70% consensus. The authors categorized these into 5 role domains: partnership developer, capacity builder, data analyzer, equity advocate, and health promoter. Statements in the equity advocate and partnership developer domains had the highest agreement for importance and relevance. Several statements achieved 100% agreement as a unit of work but achieved lower levels of agreement regarding their observability.ConclusionsEPAs for global health may be useful to academic institutions and other organizations to guide the assessment of trainees within education and training programs across health professions.
| S-EPMC7899746 | biostudies-literature
Project description:ObjectiveEntrustable professional activities (EPAs) is a newly emerging concept. This paper aims at analyzing the concept of "EPAs" to clarify the meaning and to identify its components for optimum understanding of the concept for use in nursing education and future research.MethodThree databases - ProQuest, Ovid, and PubMed- were retrieved, and Walker and Avant's concept analysis approach was used to analyze the concept of EPAs.ResultsBased on the analysis, three attributes of EPAs were defined, namely 1) EPAs should be restricted to a limited number of tasks; 2)reflect the experience curve; and 3) include acceptance of responsibility and accountability. The antecedent of EPAs is a holistic and integrated assessment approach. This will eventually lead to anticipated consequences such as a mastery of core competencies and an increase in the level of autonomy.ConclusionThe study may contribute to a reduction in the ambiguity of this concept to better apply it in nursing practice.
| S-EPMC7424159 | biostudies-literature
Project description:BACKGROUND: Entrustable professional activities (EPAs) can form the foundation of competency-based assessment in medical training, focused on performance of discipline-specific core clinical activities. OBJECTIVE: To identify EPAs for the Internal Medicine (IM) Educational Milestones to operationalize competency-based assessment of residents using EPAs. METHODS: We used a modified Delphi approach to conduct a 2-step cross-sectional survey of IM educators at a 3-hospital IM residency program; residents also completed a survey. Participants rated the importance and appropriate year of training to reach competence for 30 proposed IM EPAs. Content validity indices identified essential EPAs. We conducted independent sample t tests to determine IM educator-resident agreement and calculated effect sizes. Finally, we determined the effect of different physician roles on ratings. RESULTS: Thirty-six IM educators participated; 22 completed both surveys. Twelve residents participated. Seventeen EPAs had a content validity index of 100%; 10 additional EPAs exceeded 80%. Educators and residents rated the importance of 27 of 30 EPAs similarly. Residents felt that 10 EPAs could be met at least 1 year earlier than educators had specified. CONCLUSIONS: Internal medicine educators had a stable opinion of EPAs developed through this study, and residents generally agreed. Using this approach, programs could identify EPAs for resident evaluation, building on the initial list created via our study.
| S-EPMC3613318 | biostudies-other
Project description:BackgroundThe appropriate delivery of death pronouncements potentially affects bereaved families' wellbeing positively. Although younger physicians need to learn the competencies and entrustable professional activities (EPAs) to conduct death pronouncement independently, both of which have not been clarified. Therefore, this study aimed to develop a list of competencies and EPAs necessary for death pronouncement practice, which resident physicians need to acquire by the end of their residency training (postgraduate year 2).MethodsAn anonymous modified Delphi study was conducted with a panel of 31 experts. The experts were invited online from general wards in hospitals with resident physicians across Japan to participate in the study using the purposive and snowball sampling method. A non-anonymous web conference was held with three additional external evaluators to finalize the item list. The consensus criterion was defined as a mean response of at least 4 points on a 5-point Likert scale for each competency and EPA item and a rating of 4 or 5 points by at least 80% of the participants.ResultsConsensus was achieved, with consistently high levels of agreement across panel members, on 11 competencies and 9 EPA items. Additionally, a correspondence matrix table between competencies and EPAs was developed.ConclusionsThis study clarified the standardized educational outcomes as competencies in death pronouncement practice and the unit of professional practice of physicians who can perform this independently (EPAs), serving as a blueprint to aid the development of an educational model and evaluation method for clinical educational institutions and developers of medical school curriculums.
| S-EPMC8861606 | biostudies-literature
Project description:Importance:Entrustable professional activities (EPAs) are an emerging workplace-based, patient-oriented assessment approach with limited empirical evidence. Objective:To measure the development of pediatric trainees' clinical skills over time using EPA-based assessment data. Design, Setting, and Participants:Prospective cohort study of categorical pediatric residents over 3 academic years (2015-2016, 2016-2017, and 2017-2018) assessed on 17 American Board of Pediatrics EPAs. Residents in training at 23 pediatric residency programs in the Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network were included. Assessment was conducted by clinical competency committee members, who made summative assessment decisions regarding levels of supervision required for each resident and each EPA. Data were collected from May 2016 to November 2018 and analyzed from November to December 2018. Interventions:Longitudinal, prospective assessment using EPAs. Main Outcomes and Measures:Trajectories of supervision levels by EPA during residency training and how often graduating residents were deemed ready for unsupervised practice in each EPA. Results:Across the 5 data collection cycles, 1987 residents from all 3 postgraduate years in 23 residency programs were assigned 25 503 supervision level reports for the 17 general pediatrics EPAs. The 4 EPAs that required the most supervision across training were EPA 14 (quality improvement) on the 5-level scale (estimated mean level at graduation, 3.7; 95% CI, 3.6-3.7) and EPAs 8 (transition to adult care; mean, 7.0; 95% CI, 7.0-7.1), 9 (behavioral and mental health; mean, 6.6; 95% CI, 6.5-6.6), and 10 (resuscitate and stabilize; mean, 6.9; 95% CI, 6.8-7.0) on the expanded 5-level scale. At the time of graduation (36 months), the percentage of trainees who were rated at a supervision level corresponding to "unsupervised practice" varied by EPA from 53% to 98%. If performance standards were set to align with 90% of trainees achieving the level of unsupervised practice, this standard would be met for only 8 of the 17 EPAs (although 89% met this standard for EPA 17, performing the common procedures of the general pediatrician). Conclusions and Relevance:This study presents initial evidence for empirically derived practice readiness and sets the stage for identifying curricular gaps that contribute to discrepancy between observed practice readiness and standards needed to produce physicians able to meet the health needs of the patient populations they serve. Future work should compare these findings with postgraduation outcomes data as a means of seeking validity evidence.
| S-EPMC6991321 | biostudies-literature
Project description:PurposeThe authors established entrustable professional activities for psychiatry residents in China.MethodsThe authors conducted a literature research and two expert consultation rounds following the Delphi method in 2022 to screen and optimize entrustable professional activities for psychiatry residents.ResultsThe effective questionnaire recovery rate in the two consultation rounds was 100% (44/44). The expert authority coefficients of the first and second consultation rounds were 0.861 and 0.881, respectively. The Kendall harmony coefficients of the first and second expert consultation rounds were 0.279 (χ2 = 405.43, P < .001) and 0.389 (χ2 = 3456.83, P < .001), respectively. The arithmetic means of the various indicators' evaluation results in the two consultation rounds ranged between 3.61 and 4.93, and the full score rates were between 13.6% and 93.2%. The authors established 17 entrustable professional activities for psychiatry residents and their contents with phase-based modularization and formulated the entrustable level of each at various stages.ConclusionsCombined with standardized psychiatry training characteristics, the authors preliminarily established phase-specific and modular entrustable professional activities for psychiatry residents. The formulated entrustable professional activities are suitable for the practice and clinical environment of standardized psychiatry training in China. The devised system has good observability and measurability and provides a simple and feasible competency evaluation method for standardized psychiatry resident training.
| S-EPMC10474625 | biostudies-literature
Project description:ObjectiveConcerns over resident ability to practice effectively after graduation have led to the competency-based medical education movement. Entrustable professional activities (EPAs) may facilitate competency-based medical education in surgery, but implementation is challenging. This manuscript describes 1 strategy used to implement EPAs into an academic general surgery residency.Design, setting, participantsA mobile application was developed incorporating 5 EPAs developed by the American Board of Surgery; residents and faculty from the Departments of Surgery, Emergency Medicine, and Hospital Medicine at a single tertiary care center were trained in its use. Entrustment levels and free text feedback were collected. Self-assessment was paired with supervisor assessment, and faculty assessments were used to inform clinical competency committee entrustment decisions. Feedback was regularly solicited from app users and results distributed on a monthly basis.ResultsOne thousand seven hundred and twenty microassessments were collected over the first 16 months of implementation; 898 (47.8%) were performed by faculty with 569 (66.0%) matched pairs. Engagement was skewed with small numbers of high performers in both resident and faculty groups. Continued development of resident and faculty was required to sustain engagement with the program. Nonsurgical specialties contributed significantly to resident assessments (496, 28.8%).ConclusionsEPAs are being successfully integrated into the assessment framework at our institution. EPA implementation in surgery residency is a long-term process that requires investment, but may address limitations in the current assessment framework.
| S-EPMC7305986 | biostudies-literature
Project description:BackgroundA residency program's intern cohort is comprised of individuals from different medical schools that place varying levels of emphasis on Core Entrustable Professional Activities for Entering Residency (CEPAERs). Program directors have expressed concerns about the preparedness of medical school graduates. Though guiding principles for implementation of the CEPAERs have been published, studies using this framework to assess interns' baseline skills during orientation are limited.ObjectiveA CEPAER-based objective structured clinical examination (OSCE) was implemented with the aims to (1) assess each intern's baseline clinical skills and provide formative feedback; (2) determine an intern's readiness for resident responsibilities; (3) inform individualized education plans; and (4) address identified gaps through curricular change.MethodsDuring orientation, all 33 interns from internal medicine (categorical, preliminary, and medicine-psychiatry) participated in the OSCE. Six 20-minute stations evaluated 8 EPAs. Faculty completed a global assessment, and standardized patients completed a communications checklist and global assessment. All interns completed a self-assessment of baseline skills and a post-OSCE survey.ResultsStations assessing handoffs, informed consent, and subjective, objective, assessment, and plan (SOAP) note were the lowest-performing stations. Interns performed lower in skills for which they did not report previous training. Formal instruction was incorporated into didactic sessions for the lowest-performing stations. The majority of interns indicated that the assessment was useful, and immediate feedback was beneficial.ConclusionsThis OSCE during orientation offers just-in-time baseline information regarding interns' critical skills and may lead to individualized feedback as well as continuous curricular improvement.
| S-EPMC6476083 | biostudies-literature
Project description:ObjectivesTo develop and validate European entrustable professional activities (EPAs) for sub-specialised hepatobiliary and gastrointestinal (HB/GI) diagnostic imaging.Materials and methodsBoth European Society of Radiology and national curricula in HB/GI diagnostic radiology were thoroughly reviewed, resulting in preliminary EPAs drafted by a pilot group of expert radiologists in 2 different countries. Each EPA was fully described with 7 components (Specification/limitations; Potential risks of failing; Relevant domains of competence; Required experience, knowledge, skills, attitude and behaviour; Assessment information sources to assess progress and ground a summative entrustment decision; Entrustment for which level of supervision is to be reached; and Expiration date). The modified Delphi method with 3 Delphi rounds was chosen for validation. Content validity index (CVI) and median values were used for validation.ResultsThere were 15 preliminary EPAs, some of them divided according to 2 levels: resident and fellow level. The 37 members of the Delphi group were based in 2 different European countries with a background experience of 10 represented countries. Subsequent to the first Delphi round, 6 EPAs were accepted (CVI ≥ 0.8, median ≥ 4), 6 needed major revisions (CVI 0.7-0.79, median ≥ 4), 3 were rejected (CVI < 0.7) and 1 was added. After the second Delphi round, both the 6 revised EPAs and the additional one met the validation criteria (CVI ≥ 0.8, median ≥ 4). Finally, 13 EPAs were validated during the 3rd Delphi round with an agreement percentage of 95-100%.ConclusionThis study creates and validates EPAs for sub-specialised HB/GI diagnostic imaging.Critical relevance statementThirteen EPAs for sub-specialised hepatobiliary and gastrointestinal diagnostic imaging were created with a strong methodology, and as a first example set in sub-specialised diagnostic imaging, they provide a template for others to be created.Key points• The competence-based teaching in medical studies has recently been reintroduced through EPAs. • Thirteen EPAs have been developed for hepatobiliary and gastrointestinal sub-specialised diagnostic imaging. • These EPAs were validated using a Delphi modified method and provide a template for other to be created.
| S-EPMC10465426 | biostudies-literature