Dataset Information

An assessment blueprint for the Advanced Medical Life Support two-day prehospital emergency medical services training program in the United States.

ABSTRACT:

Purpose

Traditional approaches to blueprint creation may focus on fine-grained detail at the expense of important foundational concepts. The purpose of this study was to develop a method for constructing an assessment blueprint to guide the creation of a new post-test for a two-day prehospital emergency medical services training program.

Methods

In order to create the blueprint, we first determined the proportions of the total classroom and home-study minutes associated with the lower- and higher-order cognitive objectives of each chapter of the textbook and the two-day classroom activities during training courses conducted from January to April 2015. These proportions were then applied to a 50-question test structure in order to calculate the number of desired questions by chapter and content type.

Results

Our blueprint called for the test to contain an almost even split of lower- and higher-order cognitive questions. One-best-answer multiple choice items and extended matching-type items were written to assess lower- and higher-order cognitive content, respectively.

Conclusion

We report the first known application of an assessment blueprint to a prehospital professional development education program. Our approach to blueprint creation is computationally straightforward and could be easily adopted by a group of instructors with a basic understanding of lower- and higher-order cognitive constructs. By blueprinting at the chapter level, as we have done, item-writers should be more inclined to construct questions that focus on important central themes or procedures.

SUBMITTER: Becker LR

PROVIDER: S-EPMC4536347 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An assessment blueprint for the Advanced Medical Life Support two-day prehospital emergency medical services training program in the United States.

Becker Les R LR Vassar Matt M

Journal of educational evaluation for health professions 20150807

<h4>Purpose</h4>Traditional approaches to blueprint creation may focus on fine-grained detail at the expense of important foundational concepts. The purpose of this study was to develop a method for constructing an assessment blueprint to guide the creation of a new post-test for a two-day prehospital emergency medical services training program.<h4>Methods</h4>In order to create the blueprint, we first determined the proportions of the total classroom and home-study minutes associated with the l ...[more]

PMID: 26268832

Similar Datasets

Project description:BackgroundPrehospital obstetric events encountered by emergency medical services (EMS) can be high-risk patient presentations for which suboptimal care can cause substantial morbidity and mortality. The frequency of prehospital obstetric events is unclear because existing descriptions have reported obstetric and gynecological conditions together, without delineating specific patient presentations. Our objective was to identify the types, frequency, and acuity of prehospital obstetric events treated by EMS personnel in the US.MethodsWe conducted a cross-sectional analysis of EMS patient care records in the 2018 National EMS Information System dataset (n=22,532,890). We focused on EMS activations (i.e., calls for service) for an emergency scene response for patients aged 12-50 years with evidence of an obstetric event. Type of obstetric event was determined by examining patient symptoms, the treating EMS provider's impression (i.e., field diagnosis), and procedures performed. High patient acuity was ascertained by EMS documentation of patient status and application of the modified early obstetric warning system (MEOWS) criteria, with concordance assessed using Cohen's kappa. Descriptive statistics were calculated to describe the primary symptoms, impressions, and frequency of each type of obstetric event among these activations.ResultsA total of 107,771 (0.6%) of EMS emergency activations were identified as involving an obstetric event. The most common presentation was early or threatened labor (15%). Abdominal complaints, including pain and other digestive/abdomen signs and symptoms, was the most common primary symptom (29%) and primary impression (18%). We identified 3,489 (3%) out-of-hospital deliveries, of which 1,504 were preterm. Overall, EMS providers documented 34% of patients as being high acuity, similar to the MEOWS criteria (35%); however, there were high rates of missing data for EMS documented acuity (19%), poor concordance between the two measures (Cohen's kappa=0.12), and acuity differences for specific conditions (e.g., high acuity of non-cephalic presentations, 77% in EMS documentation versus 53% identified by MEOWS).ConclusionPrehospital obstetric events were infrequently encountered by EMS personnel, and about one-third were high acuity. Additional work to understand the epidemiology and clinical care of these patients by EMS would help to optimize prehospital care and outcomes.

Project description:BACKGROUND: As the United States embraces electronic health records (EHRs), improved emergency medical services (EMS) information systems are also a priority; however, little is known about the experiences of EMS agencies as they adopt and implement electronic patient care report (e-PCR) systems. We sought to characterize motivations for adoption of e-PCR systems, challenges associated with adoption and implementation, and emerging implementation strategies. METHODS: We conducted a qualitative study using semi-structured in-depth interviews with EMS agency leaders. Participants were recruited through a web-based survey of National Association of EMS Physicians (NAEMSP) members, a didactic session at the 2010 NAEMSP Annual Meeting, and snowball sampling. Interviews lasted approximately 30 minutes, were recorded and professionally transcribed. Analysis was conducted by a five-person team, employing the constant comparative method to identify recurrent themes. RESULTS: Twenty-three interviewees represented 20 EMS agencies from the United States and Canada; 14 EMS agencies were currently using e-PCR systems. The primary reason for adoption was the potential for e-PCR systems to support quality assurance efforts. Challenges to e-PCR system adoption included those common to any health information technology project, as well as challenges unique to the prehospital setting, including: fear of increased ambulance run times leading to decreased ambulance availability, difficulty integrating with existing hospital information systems, and unfunded mandates requiring adoption of e-PCR systems. Three recurring strategies emerged to improve e-PCR system adoption and implementation: 1) identify creative funding sources; 2) leverage regional health information organizations; and 3) build internal information technology capacity. CONCLUSION: EMS agencies are highly motivated to adopt e-PCR systems to support quality assurance efforts; however, adoption and implementation of e-PCR systems has been challenging for many. Emerging strategies from EMS agencies and others that have successfully implemented EHRs may be useful in expanding e-PCR system use and facilitating this transition for other EMS agencies.

Project description:BackgroundEmergency Care has previously been identified as an area of significant concern regarding the prevalence of Adverse Events (AEs). However, the majority of this focus has been on the in-hospital setting, with little understanding of the identification and incidence of AEs in the prehospital environment.MethodThe early development and testing of Emergency Medical Services (EMS) specific triggers for the identification of AEs and Harm has been previously described. To operationalise the Emergency Medical Services Trigger Tool (EMSTT), the processes developed by the Institute for Healthcare Improvement for use with the Global Trigger Tool were adapted to a prehospital emergency care setting. These were then applied using a stepwise approach to the analysis of 36 consecutive samples of patient care records over an 18-month period (n =?710). Inter-rater reliability was measured for each trigger item and level of Harm classification. Total Triggers per 10,000 Patient Encounters, AEs per 10,000 Patient Encounters and Harm per 10,000 Patient Encounters were measured. All measures were plotted on Statistical Process Control Charts.ResultsThere was a high level of inter-rater agreement across all items (range: 85.6-100%). The EMSTT found an average rate of 8.20 Triggers per 10,000 Patient Encounters, 2.48 AEs per 10,000 Patient Encounters and 0.34 Harm events per 10,000 Patient Encounters. Three triggers: Change in Systolic Blood Pressure Greater Than 20%; Temp?>?38 °C without subsequent reduction; and SpO2 <?94% without supplemental Oxygen or SpO2 <?85% without assisted ventilation accounted for 93% (n =?180) of the triggers found throughout the longitudinal analysis.DiscussionWith sufficient focus on implementation and data collection, as well as the inclusion of a contextually relevant system for classifying AE/Harm, the EMSTT represents a potentially successful strategy towards identifying the rate of AEs within EMS across a large patient population with limited commitment of time and resources.

Project description:Increasing numbers of emergency calls, shortages of Emergency Medical Service (EMS), physicians, prolonged emergency response times and regionally different quality of treatment by EMS physicians require improvement of this system. Telemedical solutions have been shown to be beneficial in different emergency projects, focused on specific disease patterns. Our previous pilot studies have shown that the implementation of a holistic prehospital EMS teleconsultation system, between paramedics and experienced tele-EMS physicians, is safe and feasible in different emergency situations. We aim to extend the clinical indications for this teleconsultation system. We hypothesize that the use of a tele-EMS physician is noninferior regarding the occurrence of system-induced patient adverse events and superior regarding secondary outcome parameters, such as the quality of guideline-conforming treatment and documentation, when compared to conventional EMS-physician treatment.Three thousand and ten patients will be included in this single-center, open-label, randomized controlled, noninferiority trial with two parallel arms. According to the inclusion criteria, all emergency cases involving adult patients who require EMS-physician treatment, excluding life-threatening cases, will be randomly assigned by the EMS dispatching center into two groups. One thousand five hundred and five patients in the control group will be treated by a conventional EMS physician on scene, and 1505 patients in the intervention group will be treated by paramedics who are concurrently instructed by the tele-EMS physicians at the teleconsultation center. The primary outcome measure will include the rate of treatment-specific adverse events in relation to the kind of EMS physician used. The secondary outcome measures will record the specific treatment-associated quality indicators.The evidence underlines the better quality of service using telemedicine networks between medical personnel and medical experts in prehospital emergency care, as well as in other medical areas. The worldwide unique EMS teleconsultation system in Aachen has been optimized and evaluated in pilot studies and subsequently integrated into routine use for a broad spectrum of indications. It has enabled prompt, safe and efficient patient treatment with optimized use of the "resource" EMS physician. There is, however, a lack of evidence as to whether the advantages of the teleconsultation system can be replicated in wider-ranging EMS-physician indications (excluding life-threatening emergency calls).ClinicalTrials.gov, identifier: NCT02617875 . Registered on 24 November 2015.

Dataset Information

An assessment blueprint for the Advanced Medical Life Support two-day prehospital emergency medical services training program in the United States.

Purpose

Methods

Results

Conclusion

Publications

An assessment blueprint for the Advanced Medical Life Support two-day prehospital emergency medical services training program in the United States.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure