Dataset Information

An assessment blueprint for the Advanced Medical Life Support two-day prehospital emergency medical services training program in the United States.

ABSTRACT:

Purpose

Traditional approaches to blueprint creation may focus on fine-grained detail at the expense of important foundational concepts. The purpose of this study was to develop a method for constructing an assessment blueprint to guide the creation of a new post-test for a two-day prehospital emergency medical services training program.

Methods

In order to create the blueprint, we first determined the proportions of the total classroom and home-study minutes associated with the lower- and higher-order cognitive objectives of each chapter of the textbook and the two-day classroom activities during training courses conducted from January to April 2015. These proportions were then applied to a 50-question test structure in order to calculate the number of desired questions by chapter and content type.

Results

Our blueprint called for the test to contain an almost even split of lower- and higher-order cognitive questions. One-best-answer multiple choice items and extended matching-type items were written to assess lower- and higher-order cognitive content, respectively.

Conclusion

We report the first known application of an assessment blueprint to a prehospital professional development education program. Our approach to blueprint creation is computationally straightforward and could be easily adopted by a group of instructors with a basic understanding of lower- and higher-order cognitive constructs. By blueprinting at the chapter level, as we have done, item-writers should be more inclined to construct questions that focus on important central themes or procedures.

SUBMITTER: Becker LR

PROVIDER: S-EPMC4536347 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An assessment blueprint for the Advanced Medical Life Support two-day prehospital emergency medical services training program in the United States.

Becker Les R LR Vassar Matt M

Journal of educational evaluation for health professions 20150807

<h4>Purpose</h4>Traditional approaches to blueprint creation may focus on fine-grained detail at the expense of important foundational concepts. The purpose of this study was to develop a method for constructing an assessment blueprint to guide the creation of a new post-test for a two-day prehospital emergency medical services training program.<h4>Methods</h4>In order to create the blueprint, we first determined the proportions of the total classroom and home-study minutes associated with the l ...[more]

PMID: 26268832

Similar Datasets

Project description:Background and purposeAcute stroke treatment outcomes are predicated on reperfusion timeliness which can be improved by better prehospital stroke identification. We aimed to assess the effect of interactive emergency medical services (EMS) training on stroke recognition and prehospital care performance in a very high-risk cardiovascular risk population in Lithuania.MethodsWe conducted a single-center interrupted time-series study between March 1, 2019 and March 15, 2020. Two-hour small-group interactive stroke training sessions were organized for 166 paramedics serving our stroke network. We evaluated positive predictive value (PPV) and sensitivity for stroke including transient ischemic attack identification, onset-to-door time, and hospital-based outcomes during 6-months prior and 3.5 months after the training. The study outcomes were compared between EMS providers in urban and suburban areas.ResultsIn total, 677 suspected stroke cases and 239 stroke chameleons (median age 75 years, 54.8% women) were transported by EMS. After the training, we observed improved PPV for stroke recognition (79.8% vs. 71.8%, p = 0.017) and a trend of decreased in-hospital mortality (7.8% vs. 12.3, p = 0.070). Multivariable logistic regression models adjusted for age, gender, EMS location, and stroke subtype showed an association between EMS stroke training and improved odds of stroke identification (adjusted odds ratio [aOR] 1.6 [1.1-2.3]) and onset-to-door ≤ 90 min (aOR 1.6 [1.1-2.5]). The improvement of PPV was observed in urban EMS (84.9% vs. 71.2%, p = 0.003), but not in the suburban group (75.0% vs. 72.6%, p = 0.621).ConclusionsThe interactive EMS training was associated with a robust improvement of stroke recognition, onset to hospital transport time, and a trend of decreased in-hospital mortality. Adapted training strategies may be needed for EMS providers in suburban areas. Future studies should evaluate the long-term effects of the EMS training and identify optimal retraining intervals.

Project description:BackgroundPrehospital obstetric events encountered by emergency medical services (EMS) can be high-risk patient presentations for which suboptimal care can cause substantial morbidity and mortality. The frequency of prehospital obstetric events is unclear because existing descriptions have reported obstetric and gynecological conditions together, without delineating specific patient presentations. Our objective was to identify the types, frequency, and acuity of prehospital obstetric events treated by EMS personnel in the US.MethodsWe conducted a cross-sectional analysis of EMS patient care records in the 2018 National EMS Information System dataset (n=22,532,890). We focused on EMS activations (i.e., calls for service) for an emergency scene response for patients aged 12-50 years with evidence of an obstetric event. Type of obstetric event was determined by examining patient symptoms, the treating EMS provider's impression (i.e., field diagnosis), and procedures performed. High patient acuity was ascertained by EMS documentation of patient status and application of the modified early obstetric warning system (MEOWS) criteria, with concordance assessed using Cohen's kappa. Descriptive statistics were calculated to describe the primary symptoms, impressions, and frequency of each type of obstetric event among these activations.ResultsA total of 107,771 (0.6%) of EMS emergency activations were identified as involving an obstetric event. The most common presentation was early or threatened labor (15%). Abdominal complaints, including pain and other digestive/abdomen signs and symptoms, was the most common primary symptom (29%) and primary impression (18%). We identified 3,489 (3%) out-of-hospital deliveries, of which 1,504 were preterm. Overall, EMS providers documented 34% of patients as being high acuity, similar to the MEOWS criteria (35%); however, there were high rates of missing data for EMS documented acuity (19%), poor concordance between the two measures (Cohen's kappa=0.12), and acuity differences for specific conditions (e.g., high acuity of non-cephalic presentations, 77% in EMS documentation versus 53% identified by MEOWS).ConclusionPrehospital obstetric events were infrequently encountered by EMS personnel, and about one-third were high acuity. Additional work to understand the epidemiology and clinical care of these patients by EMS would help to optimize prehospital care and outcomes.

Project description:BACKGROUND: As the United States embraces electronic health records (EHRs), improved emergency medical services (EMS) information systems are also a priority; however, little is known about the experiences of EMS agencies as they adopt and implement electronic patient care report (e-PCR) systems. We sought to characterize motivations for adoption of e-PCR systems, challenges associated with adoption and implementation, and emerging implementation strategies. METHODS: We conducted a qualitative study using semi-structured in-depth interviews with EMS agency leaders. Participants were recruited through a web-based survey of National Association of EMS Physicians (NAEMSP) members, a didactic session at the 2010 NAEMSP Annual Meeting, and snowball sampling. Interviews lasted approximately 30 minutes, were recorded and professionally transcribed. Analysis was conducted by a five-person team, employing the constant comparative method to identify recurrent themes. RESULTS: Twenty-three interviewees represented 20 EMS agencies from the United States and Canada; 14 EMS agencies were currently using e-PCR systems. The primary reason for adoption was the potential for e-PCR systems to support quality assurance efforts. Challenges to e-PCR system adoption included those common to any health information technology project, as well as challenges unique to the prehospital setting, including: fear of increased ambulance run times leading to decreased ambulance availability, difficulty integrating with existing hospital information systems, and unfunded mandates requiring adoption of e-PCR systems. Three recurring strategies emerged to improve e-PCR system adoption and implementation: 1) identify creative funding sources; 2) leverage regional health information organizations; and 3) build internal information technology capacity. CONCLUSION: EMS agencies are highly motivated to adopt e-PCR systems to support quality assurance efforts; however, adoption and implementation of e-PCR systems has been challenging for many. Emerging strategies from EMS agencies and others that have successfully implemented EHRs may be useful in expanding e-PCR system use and facilitating this transition for other EMS agencies.

Project description:BackgroundTrauma guidelines on spinal motion restriction (SMR) have changed drastically in recent years. An international group of experts explored whether consensus could be reached and if guidelines on SMR performed by trained lifeguards and prehospital EMS following in-water traumatic spinal cord injury (TSCI) should also be changed.MethodsAn international three-round Delphi process was conducted from October 2022 to November 2023. In Delphi round one, brainstorming resulted in an exhaustive list of recommendations for handling patients with suspected in-water TSCI. The list was also used to construct a preliminary flowchart for in-water SMR. In Delphi round two, three levels of agreement for each recommendation and the flowchart were established. Recommendations with strong consensus (≥ 85% agreement) underwent minor revisions and entered round three; recommendations with moderate consensus (75-85% agreement) underwent major revisions in two consecutive phases; and recommendations with weak consensus (< 75% agreement) were excluded. In Delphi round 3, the level of consensus for each of the final recommendations and each of the routes in the flowchart was tested using the same procedure as in Delphi round 2.ResultsTwenty-four experts participated in Delphi round one. The response rates for Delphi rounds two and three were 92% and 88%, respectively. The study resulted in 25 recommendations and one flowchart with four flowchart paths; 24 recommendations received strong consensus (≥ 85%), and one recommendation received moderate consensus (81%). Each of the four paths in the flowchart received strong consensus (90-95%). The integral flowchart received strong consensus (93%).ConclusionsThis study produced expert consensus on 25 recommendations and a flowchart on handling patients with suspected in-water TSCI by trained lifeguards and prehospital EMS. These results provide clear and simple guidelines on SMR, which can standardise training and guidelines on SMR performed by trained lifeguards or prehospital EMS.

Project description:Aims and objectivesTo describe prehospital nursing students' experiences of patient safety culture in emergency medical services during their internship.BackgroundPatient safety culture in the emergency medical services is a complex phenomenon including more than organisational policies and practices and professionals' technical skills.DesignThe descriptive qualitative approach used the Sharing Learning from Practice to improve Patient Safety Learning Event Recording Tool, which includes both open-ended and structured questions.MethodsPurposeful sampling was used, and data were collected from graduating prehospital nursing students (n = 17) from three Finnish Universities of Applied Sciences. Open-ended questions were reviewed using thematic analysis, and frequencies and percentages were derived from structured questions. COREQ guidelines were used to guide this study.ResultsFour themes were identified during the thematic analysis: environmental and other unexpected factors in emergency medical services, working practices and professionalism in emergency medical services, teamwork in emergency medical services and feelings related to patient safety events in emergency medical services. Patient safety events described by students were seldom reported in the healthcare system or patient files. According to the students, such events were most likely related to communication, checking/verification and/or teamwork.ConclusionsThis study shows that prehospital nursing students can produce important information about patient safety events and the reasons that contributed to those events. Therefore, emergency medical services organisations and managers should use students' observations to develop a patient safety culture in emergency medical services.Relevance to clinical practiceUnderstanding how prehospital nursing students have experienced patient safety culture during their internships on ambulances can support educational institutions, together with emergency medical services organisations and managers, to improve policies for students to express patient safety concerns as well as patient safety successes.

Dataset Information

An assessment blueprint for the Advanced Medical Life Support two-day prehospital emergency medical services training program in the United States.

Purpose

Methods

Results

Conclusion

Publications

An assessment blueprint for the Advanced Medical Life Support two-day prehospital emergency medical services training program in the United States.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets