Developing and Implementing an Entrustable Professional Activity Assessment for Pharmacy Practice Experiences
Ontology highlight
ABSTRACT:
SUBMITTER: Smith C
PROVIDER: S-EPMC7523670 | biostudies-literature | 2020 Sep
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:IntroductionEntrustable professional activities (EPAs) are units of professional practice defined as tasks or responsibilities that trainees are entrusted to perform unsupervised. AAMC Core EPA 10 is defined as the ability to "recognize a patient who requires emergent care and initiate evaluation and management." We designed a simulation scenario to elicit EPA 10-related behaviors for learner assessment to guide entrustment decisions.MethodsThis case presents a 61-year-old male with a complaint of feeling ill. The students need to diagnose an ST segment elevation myocardial infarction that leads to a pulseless ventricular tachycardia arrest. A simulation manikin is used, and students are assessed using a checklist. The tool is a set of critical actions that were proposed by a group of content experts, based on the following EPA 10 functions: recognizing unstable vital signs, asking for help, and determining appropriate disposition. In addition to case-specific behavioral items, an overall entrustment item was added to inform the entrustment decision.ResultsThis case was implemented in a mandatory fourth-year clerkship for 7 years prior to its adaptation for entrustment on EPA 10. In recent experience from one institution, about 14% of students failed to meet entrustment. Students rated the experience as valuable (average 5.0, on a 5-point Likert scale) and thought that it would change their performance in a clinical setting (average 4.95, on a 5-point Likert scale).DiscussionFaculty raters noted challenges regarding entrustment based on a single simulation and the implications that team role (supporting role vs. leader role) has on entrustment.
| S-EPMC6440413 | biostudies-literature
Project description:Importance:Entrustable professional activities (EPAs) are an emerging workplace-based, patient-oriented assessment approach with limited empirical evidence. Objective:To measure the development of pediatric trainees' clinical skills over time using EPA-based assessment data. Design, Setting, and Participants:Prospective cohort study of categorical pediatric residents over 3 academic years (2015-2016, 2016-2017, and 2017-2018) assessed on 17 American Board of Pediatrics EPAs. Residents in training at 23 pediatric residency programs in the Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network were included. Assessment was conducted by clinical competency committee members, who made summative assessment decisions regarding levels of supervision required for each resident and each EPA. Data were collected from May 2016 to November 2018 and analyzed from November to December 2018. Interventions:Longitudinal, prospective assessment using EPAs. Main Outcomes and Measures:Trajectories of supervision levels by EPA during residency training and how often graduating residents were deemed ready for unsupervised practice in each EPA. Results:Across the 5 data collection cycles, 1987 residents from all 3 postgraduate years in 23 residency programs were assigned 25 503 supervision level reports for the 17 general pediatrics EPAs. The 4 EPAs that required the most supervision across training were EPA 14 (quality improvement) on the 5-level scale (estimated mean level at graduation, 3.7; 95% CI, 3.6-3.7) and EPAs 8 (transition to adult care; mean, 7.0; 95% CI, 7.0-7.1), 9 (behavioral and mental health; mean, 6.6; 95% CI, 6.5-6.6), and 10 (resuscitate and stabilize; mean, 6.9; 95% CI, 6.8-7.0) on the expanded 5-level scale. At the time of graduation (36 months), the percentage of trainees who were rated at a supervision level corresponding to "unsupervised practice" varied by EPA from 53% to 98%. If performance standards were set to align with 90% of trainees achieving the level of unsupervised practice, this standard would be met for only 8 of the 17 EPAs (although 89% met this standard for EPA 17, performing the common procedures of the general pediatrician). Conclusions and Relevance:This study presents initial evidence for empirically derived practice readiness and sets the stage for identifying curricular gaps that contribute to discrepancy between observed practice readiness and standards needed to produce physicians able to meet the health needs of the patient populations they serve. Future work should compare these findings with postgraduation outcomes data as a means of seeking validity evidence.
| S-EPMC6991321 | biostudies-literature
Project description:BackgroundGraduate medical education programs assess trainees' performance to determine readiness for unsupervised practice. Entrustable professional activities (EPAs) are a novel approach for assessing performance of core professional tasks.AimTo describe a pilot and feasibility evaluation of two EPAs for competency-based assessment in internal medicine (IM) residency.Setting/participantsPost-graduate year-1 interns (PGY-1s) and attendings at a large internal medicine (IM) residency program.Program descriptionTwo Entrustable professional activities (EPA) assessments (Discharge, Family Meeting) were piloted.Program feasibility evaluationTwenty-eight out of 43 (65.1 %) PGY-1 s and 32/43 (74.4 %) attendings completed surveys about the Discharge EPA experience. Most who completed the EPA assessment (10/12, 83.8 %, PGY-1s; 9/11, 83.3 %, attendings) agreed it facilitated useful feedback discussions. For the Family Meeting EPA, 16/26 (61.5 %) PGY-1s completed surveys, and most who participated (9/12 PGY1s, 75 %) reported it improved attention to family meeting education, although only half recommended continuing the EPA assessment.DiscussionFrom piloting two EPA assessments in a large IM residency, we recognized our reminder systems and time dedicated for completing EPA requirements as inadequate. Collaboration around patient safety and palliative care with relevant clinical services has enhanced implementation and buy-in. We will evaluate how well EPA-based assessment serves the intended purpose of capturing trainees' trustworthiness to conduct activities unsupervised.
| S-EPMC3710378 | biostudies-literature
Project description:BACKGROUND:This study was conducted to examine gaps and opportunities for involvement of librarians in medical education and patient care as well as improve the teaching and assessment of Entrustable Professional Activity 7 (EPA 7) -- the ability to form clinical questions and retrieve evidence to advance patient care. METHODS:The Association of Academic Health Sciences Libraries (AAHSL) Competency-Based Medical Education Task Force surveyed all AAHSL member libraries in October 2016 on health sciences librarian awareness and involvement in teaching and assessing EPA 7. RESULTS:The survey response rate was 54% (88/164 member libraries). While 90% (n?=?76) of respondents were regularly engaged in teaching or assessing aspects of EPA 7 only 34 (39%) were involved explicitly in a Core EPA 7 project, 44% (15/34) of these projects were librarian initiated. CONCLUSIONS:Involvement in teaching and assessment of EPA 7 is an untapped opportunity for librarians to collaborate in medical education and patient care. Although librarians are already deeply involved in teaching and assessment of EPA 7 related knowledge, skills, and behaviors, further librarian collaboration can help bolster the planning or updating of existing curricula and assessments of this entrustable professional activity.
| S-EPMC6724374 | biostudies-literature
Project description:Importance:Competency-based assessments of surgical resident performance require metrics of entrustable autonomy. Objectives:To designate entrustable professional activities (EPAs) in global performance and in specific operations, and to identify differences in perceived capability, autonomy, and expectations between surgical faculty and residents. Design, Setting, and Participants:This survey study was conducted from August 9, 2016, through August 24, 2016, in the Department of Surgery at the UCLA David Geffen School of Medicine. The survey instrument consisted of 5-point Likert scales for assessing perceptions of entrustability for 5 global and 5 operative EPAs. Faculty members were surveyed regarding resident capabilities and expected capabilities by postgraduate year. Residents were surveyed regarding their own capabilities, actual autonomy entrusted in the last EPA performed, and expected capabilities. Main Outcomes and Measures:Differences in mean ratings were assessed across 7 comparison domains. Results:Among 78 total faculty members, 31 (40%) participated in the survey. Among 49 residents, 39 (80%) participated in the survey. Residents generally rated their global EPA performance higher than the faculty did (mean, 3.7 vs 2.8; P?<?.01), but operative EPA performance ratings were equivalent (mean, 2.7 vs 2.4; P?<?.12). Faculty members perceived senior residents as underperforming expectations in operative EPAs. Most faculty members (80%) expected residents not to be independently capable of performing complex operations by graduation. Faculty members perceived residents in postgraduate years 4 and 5 to have greater operative capability than the level of autonomy entrusted to those residents (95% CI, 3.3-3.5 vs 1.9-2.2). Conclusions and Relevance:Global and operative EPAs are practical for developing competency-based curricula. Graduated autonomy should be granted to improve the operative experience for residents.
| S-EPMC5933400 | biostudies-other
Project description:BackgroundThe entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified.ObjectiveUsing an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills.MethodsAn initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure.ResultsInitial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure.ConclusionsThese EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.
| S-EPMC5398142 | biostudies-literature
Project description:BackgroundExtracorporeal membrane oxygenation supports severe cardiac or pulmonary failure. There are currently no competency-based standards for extracorporeal membrane oxygenation training.MethodsExtracorporeal membrane oxygenation experts were interviewed using a structured interview. Responses were audio recorded, transcribed, and validated by respondents. Interviews were coded using grounded theory with a constant comparison method. Themes were developed and used to construct the entrustable professional activity, which was reviewed by the extracorporeal membrane oxygenation experts.ResultsNine experts were interviewed; all had experience with trainees. Interview themes identified include patient selection, circuit and medical management, multidisciplinary communication, problem-based learning and simulation, and entrustment decisions. Essential functions of the entrustable professional activity were patient selection, circuit management, cannula selection, responding to circuit emergencies/complications, anticoagulation management, weaning, and family/team communication.ConclusionsEssential functions of an extracorporeal membrane oxygenation entrustable professional activity were defined using data from structured interviews. The resultant entrustable professional activity could be implemented by critical-care programs as a scaffolding for competency-based fellow training.
| S-EPMC8083009 | biostudies-literature
Project description:BackgroundThe new UCSF Bridges Curriculum aims to prepare students to succeed in today's health care system while simultaneously improving it. Curriculum redesign requires assessment strategies that ensure that graduates achieve competence in enduring and emerging skills for clinical practice.AimTo design entrustable professional activities (EPAs) for assessment in a new curriculum and gather evidence of content validity.SettingUniversity of California, San Francisco, School of Medicine.ParticipantsNineteen medical educators participated; 14 completed both rounds of a Delphi survey.Program descriptionAuthors describe 5 steps for defining EPAs that encompass a curricular vision including refining the vision, defining draft EPAs, developing EPAs and assessment strategies, defining competencies and milestones, and mapping milestones to EPAs. A Q-sort activity and Delphi survey involving local medical educators created consensus and prioritization for milestones for each EPA.Program evaluationFor 4 EPAs, most milestones had content validity indices (CVIs) of at least 78 %. For 2 EPAs, 2 to 4 milestones did not achieve CVIs of 78 %.DiscussionWe demonstrate a stepwise procedure for developing EPAs that capture essential physician work activities defined by a curricular vision. Structured procedures for soliciting faculty feedback and mapping milestones to EPAs provide content validity.
| S-EPMC4539334 | biostudies-literature
Project description:BackgroundThe adoption of competency-based medical education requires objective assessments of a learner's capability to carry out clinical tasks within workplace-based learning settings. This study involved an evaluation of the use of mobile technology to record entrustable professional activity assessments in an undergraduate clerkship curriculum.ApproachA paper-based form was adapted to a mobile platform called eClinic Card. Students documented workplace-based assessments throughout core clerkship and preceptors confirmed accuracy via mobile phones. Assessment scores for the 2017-2018 academic year were collated and analyzed for all core rotations, and preceptors and students were surveyed regarding the mobile assessment experience.EvaluationThe mobile system enabled 80 students and 624 preceptors to document 6850 assessment submissions across 47 clinical sites over a 48-week core clerkship curriculum. Students' scores demonstrated progressive improvement across all entrustable professional activities with stage-appropriate levels of independence reported by end of core clerkship. Preceptors and students were satisfied with ease of use and dependability of the mobile assessment platform; however, students felt quality of formative coaching feedback could be improved.ReflectionOur preliminary evaluation suggests the use of mobile technology to assess entrustable professional activity achievement across a core clerkship curriculum is a feasible and acceptable modality for workplace-based assessment. The use of mobile technology supported a programmatic assessment approach. However, meaningful coaching feedback, as well as faculty development and support, emerged as key factors influencing successful adoption and usage of entrustable professional activities within an undergraduate medical curriculum.
| S-EPMC8633342 | biostudies-literature
Project description:Entrustable professional activities are an intuitive form of workplace-based assessment that can support competency-based medical education. Many entrustable professional activities have been written and published, but few studies describe the feasibility or implementation of entrustable professional activities in graduate medical education. The frozen section entrustable professional activit was introduced into the pathology residency training at the University of Vermont for postgraduate year 1 at the start of their training in frozen section. The feasibility of the entrustable professional activit was evaluated based on 3 criteria: (a) utilization, (b) support of frozen section training, and (c) generating data to support entrustment decision about residents' readiness to take call. The entrustable professional activit was well utilized and satisfactory to residents, faculty, pathologists' assistants, and Clinical Competency Committee members. Most members of the Clinical Competency Committee agreed they had sufficient data and noted higher confidence in assessing resident readiness to take call with the addition of entrustable professional activit to the residents' assessment portfolio. Residents did not endorse it helped them prepare for call; however, the interruption to frozen section training due to the COVID-19 pandemic was a significant contributing factor. The frozen section entrustable professional activit is a feasible addition to pathology resident training based on utilization, support of training, and generation of data to support entrustment decisions for graduated responsibilities. The implementation and integration of the entrustable professional activit into pathology training at our institution is described with discussion of adjustments for future use.
| S-EPMC8411628 | biostudies-literature