Workplace-based Assessment Data in Emergency Medicine: A Scoping Review of the Literature.
Ontology highlight
ABSTRACT: Objective
In the era of competency-based medical education (CBME), the collection of more and more trainee data is being mandated by accrediting bodies such as the Accreditation Council for Graduate Medical Education and the Royal College of Physicians and Surgeons of Canada. However, few efforts have been made to synthesize the literature around the current issues surrounding workplace-based assessment (WBA) data. This scoping review seeks to synthesize the landscape of literature on the topic of data collection and utilization for trainees' WBAs in emergency medicine (EM).Methods
The authors conducted a scoping review in the style of Arksey and O'Malley, seeking to synthesize and map literature on collecting, aggregating, and reporting WBA data. The authors extracted, mapped, and synthesized literature that describes, supports, and substantiates effective data collection and utilization in the context of the CBME movement within EM.Results
Our literature search retrieved 189 potentially relevant references (after removing duplicates) that were screened to 29 abstracts and papers relevant to collecting, aggregating, and reporting WBAs. Our analysis shows that there is an increasing temporal trend toward contributions in these topics, with the majority of the papers (16/29) being published in the past 3 years alone.Conclusion
There is increasing interest in the areas around data collection and utilization in the age of CBME. The field, however, is only beginning to emerge, leaving more work that can and should be done in this area.
SUBMITTER: Chan TM
PROVIDER: S-EPMC8166307 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:IntroductionEmergency medicine (EM) throughout Africa exists in various stages of development. The number and types of scientific EM literature can serve as a proxy indicator of EM regional development and activity. The goal of this scoping review is a preliminary assessment of potential size and scope of available African EM literature published over 15 years.MethodsWe searched five indexed international databases as well as non-indexed grey literature from 1999-2014 using key search terms including "Africa", "emergency medicine", "emergency medical services", and "disaster." Two trained physician reviewers independently assessed whether each article met one or more of five inclusion criteria, and discordant results were adjudicated by a senior reviewer. Articles were categorised by subject and country of origin. Publication number per country was normalised by 1,000,000 population.ResultsOf 6091 identified articles, 633 (10.4%) were included. African publications increased 10-fold from 1999 to 2013 (9 to 94 articles, respectively). Western Africa had the highest number (212, 33.5%) per region. South Africa had the largest number of articles per country (171, 27.0%) followed by Nigeria, Kenya, and Ghana. 537 (84.8%) articles pertained to facility-based EM, 188 (29.7%) to out-of-hospital emergency medicine, and 109 (17.2%) to disaster medicine. Predominant content areas were epidemiology (374, 59.1%), EM systems (321, 50.7%) and clinical care (262, 41.4%). The most common study design was observational (479, 75.7%), with only 28 (4.4%) interventional studies. All-comers (382, 59.9%) and children (91, 14.1%) were the most commonly studied patient populations. Undifferentiated (313, 49.4%) and traumatic (180, 28.4%) complaints were most common.ConclusionOur review revealed a considerable increase in the growth of African EM literature from 1999 to 2014. Overwhelmingly, articles were observational, studied all-comers, and focused on undifferentiated complaints. The articles discovered in this scoping review are reflective of the relatively immature and growing state of African EM.
| S-EPMC6400014 | biostudies-literature
Project description:BackgroundGrowing literature within postgraduate medical education demonstrates that female resident physicians experience gender bias throughout their training and future careers. This scoping review aims to describe the current body of literature on gender differences in emergency medicine (EM) resident assessment.MethodsWe conducted a scoping review which adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. We included research involving resident physicians or fellows in EM (population and context), which focused on the impact of gender on assessments (concept). We searched seven databases from the databases' inception to April 4, 2022. Two reviewers independently screened citations, completed full-text review, and abstracted data. A third reviewer resolved any discrepancies.ResultsA total of 667 unique citations were identified; 10 studies were included, and all were conducted within the United States. Four studies reported differences in EM resident assessments attributable to gender within workplace-based assessments (qualitative comments and quantitative scores) by both attending physicians and nonphysicians. Six studies investigating clinical competency committee scores, procedural scores, and simulation-based assessments did not report any significant differences attributable to gender.ConclusionsThis scoping review found that gender bias exists within EM resident assessment most notably at the level of narrative comments typically received via workplace-based assessments. As female EM residents receive higher rates of negative or critical comments and discordant feedback documented on assessment, these findings raise concern about added barriers female EM residents may face while progressing through residency and the impact on their clinical and professional development.
| S-EPMC9513437 | biostudies-literature
Project description:IntroductionSocial emergency medicine (EM) is an emerging field that examines the intersection of emergency care and social factors that influence health outcomes. We conducted a scoping review to explore the breadth and content of existing research pertaining to social EM to identify potential areas where future social EM research efforts should be directed.MethodsWe conducted a comprehensive PubMed search using Medical Subject Heading terms and phrases pertaining to social EM topic areas (e.g., "homelessness," "housing instability") based on previously published expert consensus. For searches that yielded fewer than 100 total publications, we used the PubMed "similar publications" tool to expand the search and ensure no relevant publications were missed. Studies were independently abstracted by two investigators and classified as relevant if they were conducted in US or Canadian emergency departments (ED). We classified relevant publications by study design type (observational or interventional research, systematic review, or commentary), publication site, and year. Discrepancies in relevant publications or classification were reviewed by a third investigator.ResultsOur search strategy yielded 1,571 publications, of which 590 (38%) were relevant to social EM; among relevant publications, 58 (10%) were interventional studies, 410 (69%) were observational studies, 26 (4%) were systematic reviews, and 96 (16%) were commentaries. The majority (68%) of studies were published between 2010-2020. Firearm research and lesbian, gay, bisexual, transgender, and queer (LGBTQ) health research in particular grew rapidly over the last five years. The human trafficking topic area had the highest percentage (21%) of interventional studies. A significant portion of publications -- as high as 42% in the firearm violence topic area - included observational data or interventions related to children or the pediatric ED. Areas with more search results often included many publications describing disparities known to predispose ED patients to adverse outcomes (e.g., socioeconomic or racial disparities), or the influence of social determinants on ED utilization.ConclusionSocial emergency medicine research has been growing over the past 10 years, although areas such as firearm violence and LGBTQ health have had more research activity than other topics. The field would benefit from a consensus-driven research agenda.
| S-EPMC8597693 | biostudies-literature
Project description:Several studies have shown that workplace violence in the emergency department (ED) is common. Residents may be among the most vulnerable staff, as they have the least experience with these volatile encounters. The goal for this study was to quantify and describe acts of violence against emergency medicine (EM) residents by patients and visitors and to identify perceived barriers to safety.This cross-sectional survey study queried EM residents at multiple New York City hospitals. The primary outcome was the incidence of violence experienced by residents while working in the ED. The secondary outcomes were the subtypes of violence experienced by residents, as well as the perceived barriers to safety while at work.A majority of residents (66%, 78/119) reported experiencing at least one act of physical violence during an ED shift. Nearly all residents (97%, 115/119) experienced verbal harassment, 78% (93/119) had experienced verbal threats, and 52% (62/119) reported sexual harassment. Almost a quarter of residents felt safe "Occasionally," "Seldom" or "Never" while at work. Patient-based factors most commonly cited as contributory to violence included substance use and psychiatric disease.Self-reported violence against EM residents appears to be a significant problem. Incidence of violence and patient risk factors are similar to what has been found previously for other ED staff. Understanding the prevalence of workplace violence as well as the related systems, environmental, and patient-based factors is essential for future prevention efforts.
| S-EPMC5017841 | biostudies-other
Project description:INTRODUCTION:Interest is growing in specialty-specific assessments of student candidates based on clinical clerkship performance to assist in the selection process for postgraduate training. The most established and extensively used is the emergency medicine (EM) Standardized Letter of Evaluation (SLOE), serving as a substitute for the letter of recommendation. Typically developed by a program's leadership, the group SLOE strives to provide a unified institutional perspective on performance. The group SLOE lacks guidelines to direct its development raising questions regarding the assessments, processes, and standardization programs employ. This study surveys EM programs to gather validity evidence regarding the inputs and processes involved in developing group SLOEs. METHODS:A structured telephone interview was administered to assess the input data and processes employed by United States EM programs when generating group SLOEs. RESULTS:With 156/178 (87.6%) of Accreditation Council of Graduate Medical Education-approved programs responding, 146 (93.6%) reported developing group SLOEs. Issues identified in development include the following: (1) 84.9% (124/146) of programs limit the consensus process by not employing rigorous methodology; (2) several stakeholder groups (nurses, patients) do not participate in candidate assessment placing final decisions at risk for construct under-representation; and (3) clinical shift assessments don't reflect the task-specific expertise of each stakeholder group nor has the validity of each been assessed. CONCLUSION:Success of the group SLOE in its role as a summative workplace-based assessment is dependent upon valid input data and appropriate processes. This study of current program practices provides specific recommendations that would strengthen the validity arguments for the group SLOE.
| S-EPMC7234706 | biostudies-literature
Project description:BackgroundCompetency-based medical education is becoming the new standard for residency programs, including Emergency Medicine (EM). To inform programmatic restructuring, guide resources and identify gaps in publication, we reviewed the published literature on types and frequency of resident assessment.MethodsWe searched MEDLINE, EMBASE, PsycInfo and ERIC from Jan 2005 - June 2014. MeSH terms included "assessment," "residency," and "emergency medicine." We included studies on EM residents reporting either of two primary outcomes: 1) assessment type and 2) assessment frequency per resident. Two reviewers screened abstracts, reviewed full text studies, and abstracted data. Reporting of assessment-related costs was a secondary outcome.ResultsThe search returned 879 articles; 137 articles were full-text reviewed; 73 met inclusion criteria. Half of the studies (54.8%) were pilot projects and one-quarter (26.0%) described fully implemented assessment tools/programs. Assessment tools (n=111) comprised 12 categories, most commonly: simulation-based assessments (28.8%), written exams (28.8%), and direct observation (26.0%). Median assessment frequency (n=39 studies) was twice per month/rotation (range: daily to once in residency). No studies thoroughly reported costs.ConclusionEM resident assessment commonly uses simulation or direct observation, done once-per-rotation. Implemented assessment systems and assessment-associated costs are poorly reported. Moving forward, routine publication will facilitate transitioning to competency-based medical education.
| S-EPMC5344063 | biostudies-literature
Project description:BackgroundOver the past 2 decades, emergency ultrasound has become essential to patient care, and is a mandated competency for emergency medicine residency graduation. However, the best evidence regarding emergency ultrasound education in residency training is not known. We performed a scoping review to determine the (1) characteristics and (2) outcomes of published structured training methods, (3) the quality of publications, and (4) the implications for research and training.MethodsWe searched broadly on multiple electronic databases and screened studies from the United States and Canada describing structured emergency ultrasound training methods for emergency medicine residents. We evaluated methodological quality with the Medical Education Research Study Quality Instrument (MERSQI), and qualitatively summarized study and intervention characteristics.ResultsA total of 109 studies were selected from 6712 identified publications. Publications mainly reported 1 group pretest-posttest interventions (38%) conducted at a single institution (83%), training in image acquisition (82%) and interpretation (94%) domains with assessment of knowledge (44%) and skill (77%) outcomes, and training in cardiac (18%) or vascular access (15%) applications. Innovative strategies, such as gamification, cadaver models, and hand motion assessment are described. The MERSQI scores of 48 articles ranged from 0 to 15.5 (median, 11.5; interquartile range, 9.6-13.0) out of 18. Low scores reflected the absence of reported valid assessment tools (73%) and higher level outcomes (90%).ConclusionsAlthough innovative strategies are illustrated, the overall quality of research could be improved. The use of standardized planning and assessment tools, intentionally mapped to targeted domains and outcomes, might provide valuable formative and summative information to optimize emergency ultrasound research and training.
| S-EPMC8202829 | biostudies-literature
Project description:BACKGROUND:Clinical decision-making (CDM) is an important competency for young doctors especially under complex and uncertain conditions in geriatric emergency medicine (GEM). However, research in this field is characterized by vague conceptualizations of CDM. To evolve and evaluate evidence-based knowledge of CDM, it is important to identify different definitions and their operationalizations in studies on GEM. OBJECTIVE:A scoping review of empirical articles was conducted to provide an overview of the documented evidence of findings and conceptualizations of CDM in GEM. METHODS:A detailed search for empirical studies focusing on CDM in a GEM setting was conducted in PubMed, ProQuest, Scopus, EMBASE and Web of Science. In total, 52 publications were included in the analysis, utilizing a data extraction sheet, following the PRISMA guidelines. Reported outcomes were summarized. RESULTS:Four themes of operationalization of CDM emerged: CDM as dispositional decisions, CDM as cognition, CDM as a model, and CDM as clinical judgement. Study results and conclusions naturally differed according to how CDM was conceptualized. Thus, frailty-heuristics lead to biases in treatment of geriatric patients and the complexity of this patient group was seen as a challenge for young physicians engaging in CDM. CONCLUSIONS:This scoping review summarizes how different studies in GEM use the term CDM. It provides an analysis of findings in GEM and call for more stringent definitions of CDM in future research, so that it might lead to better clinical practice.
| S-EPMC7489001 | biostudies-literature
Project description:Using thematic analysis of existing literature, this scoping review aims to explore the narratives of people using herbal medicine (HM) in the United Kingdom. Understanding who is using HM and why will enable better ways of facilitating the use of HM, as well as assist in designing future research. Ethnic groups were found to be primary users of HM in the United Kingdom. A sense of heritage continues to be important for these participants as it allows tradition and culture to stay alive within communities, as well as the ritualistic purposes of these plants. For women, another key demographic, concepts surrounding the naturalness of HMs are associated with the idea of femineity and self-healing. A reoccurring theme in the literature focusing on both ethnic groups and women's perceptions is the judgement from healthcare practitioners/professionals (HCPs) when addressing the use of HM. However, studies that investigated the perceptions of HCPs on HM confirmed that they often were supportive of using HM where standard treatments had been unsuccessful, and if a patient had anecdotal evidence of a herb having been effective. Delving deeper into public narratives of HM usage will allow conventional healthcare systems to effectively integrate alternative approaches, as well as ensuring that future research into the benefits of HMs is relevant to how people use them.
| S-EPMC9452627 | biostudies-literature
Project description:Mental health problems are one of the leading contributors to the global burden of disease. Workplaces provide a valuable and accessible setting for interventions to improve worker health. However, little is known about mental health interventions on the African continent, particularly those based in the workplace. This review aimed to identify and report on the literature about workplace-based interventions for mental health in Africa. This review followed the JBI and PRISMA ScR guidelines for scoping reviews. We searched 11 databases for qualitative, quantitative and mixed-methods studies. The grey literature was included, and no language or date limits were applied. Title and abstract screening and full text review, were completed independently by two reviewers. A total of 15 514 titles were identified, of which, 26 titles were included. The most common study designs were qualitative studies (n = 7) and pre-experimental, single-group, pre-test, post-test studies (n = 6). Workers with depression, bipolar mood disorder, schizophrenia, intellectual disability, alcohol and substance abuse, stress and burnout were included in the studies. The participants were mostly skilled and professional workers. A wide variety of interventions were offered, of which, most were multi-modal. There is a need to develop multi-modal interventions in partnership with stakeholders, particularly for semi-skilled and unskilled workers.
| S-EPMC10218638 | biostudies-literature