Dataset Information

A novel multimodal needs assessment to inform the longitudinal education program for an international interprofessional critical care team.

ABSTRACT:

Background

The current global pandemic has caused unprecedented strain on critical care resources, creating an urgency for global critical care education programs. Learning needs assessment is a core element of designing effective, targeted educational interventions. In theory, multimodal methods are preferred to assess both perceived and unperceived learning needs in diverse, interprofessional groups, but a robust design has rarely been reported. Little is known about the best approach to determine the learning needs of international critical care professionals.

Method

We conducted multimodal learning needs assessment in a pilot group of critical care professionals in China using combined quantitative and qualitative methods. The assessments consisted of three phases: 1) Twenty statements describing essential entrustable professional activities (EPAs) were generated by a panel of critical care education experts using a Delphi method. 2) Eleven Chinese critical care professionals participating in a planned education program were asked to rank-order the statements according to their perceived learning priority using Q methodology. By-person factor analysis was used to study the typology of the opinions, and post-ranking focus group interviews were employed to qualitatively explore participants' reasoning of their rankings. 3) To identify additional unperceived learning needs, daily practice habits were audited using information from medical and nursing records for 3 months.

Results

Factor analysis of the rank-ordered statements revealed three learning need patterns with consensual and divergent opinions. All participants expressed significant interest in further education on organ support and disease management, moderate interest in quality improvement topics, and relatively low interest in communication skills. Interest in learning procedure/resuscitation skills varied. The chart audit revealed suboptimal adherence to several evidence-based practices and under-perceived practice gaps in patient-centered communication, daily assessment of antimicrobial therapy discontinuation, spontaneous breathing trial, and device discontinuation.

Conclusions

We described an effective mixed-methods assessment to determine the learning needs of an international, interprofessional critical care team. The Q survey and focus group interviews prioritized and categorized perceived learning needs. The chart audit identified additional practice gaps that were not identified by the learners. Multimodal methods can be employed in cross-cultural scenarios to customize and better target medical education curricula.

SUBMITTER: Li H

PROVIDER: S-EPMC9281106 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundIn order to prepare current and future educators and clinicians to lead interprofessional education (IPE) and interprofessional collaborative practice (IPCP), faculty and staff need training in collaborative approaches to developing, implementing, assessing, and sustaining high quality IPE across the interprofessional learning continuum. The Train-the-Trainer Interprofessional Team Development Program (T3-ITDP) is a 3.5-day program designed to develop expert IPE teams through interactive workshops, coaching, and the development and implementation of an IPE or IPCP (IPECP) project for their home institutions.PurposeThe purpose of this research was to assess the impact of the T3-ITDP on the development and implementation of IPECP projects by participating teams.MethodsThe T3-ITDP impact survey was created and administered to collect data on the scope and impact of participant teams' projects, including learner and project outcomes, training methods, dissemination plans, assessment strategies, and teams' intentions to continue working together beyond the initial project. With human subject's approval, we invited 55 T3-ITDP participant teams to complete the impact survey. These teams were at least one year post-completion of the in-person portion of the program and thus had time to initiate their IPECP projects.ResultsForty-one (74.5%) teams responded to the survey. Of those teams, 31 (76%) used T3-ITDP content and/or approaches to develop their IPECP projects that targeted learners across the interprofessional learning continuum. Sustainability of IPECP projects was supported through several mechanisms, including institutional support or incorporating IPECP activities into existing courses. Almost half of the teams worked together on new projects, and 74% of teams planned to repeat a newly developed activity.Discussion & conclusionsResults of the T3-ITDP impact survey demonstrated that team-based, project-focused professional development catalyzed the development, implementation, and sustainment of new IPECP projects at academic and community institutions throughout the U.S.

Project description:BackgroundEffective screening of alcohol use and prevention of alcohol use disorder (AUD) requires the continuous preparation of educated and confident providers across all health professions who will ideally work in close collaboration in their future practices. As one mechanism for achieving this goal, the development and provision of interprofessional education (IPE) training modules for health care students may cultivate beneficial interactions among future health providers early in their formative education.MethodsIn the present study, we assessed attitudes about alcohol and confidence in screening and AUD prevention in 459 students at our health sciences center. Students represented ten different health professions (audiology, cardiovascular sonography, dental hygiene, dentistry, medicine, nursing, physical therapy, public health, respiratory therapy, and speech language pathology programs). For purposes of this exercise, students were divided into small, professionally diverse teams. Responses to ten survey questions (Likert scale) were collected via a web-based platform. These assessments were collected before and after a case-based exercise that provided information to students on the risks of excessive alcohol use as well as the effective screening and team-based management of individuals susceptible to AUD.ResultsWilcoxon signed-rank analyses revealed that the exercise led to significant decreases in stigma toward individuals engaging in at-risk alcohol use. We also discovered significant increases in self-reported knowledge and confidence in personal qualifications needed to initiate brief interventions to reduce alcohol use. Focused analyses of students from individual health programs uncovered unique improvements according to question theme and health profession.ConclusionOur findings demonstrate the utility and effectiveness of single, focused IPE-based exercises to impact personal attitudes and confidence in young health professions learners. While additional longitudinal cohort follow-up studies are needed, these results may translate into more effective and collaborative AUD treatment in future clinical settings.

Project description:To reduce the incidence of hypoxic brain injuries among newborns a national cardiotocography (CTG) education program was implemented in Denmark. A multiple-choice question test was integrated as part of the program. The aim of this article was to describe and discuss the test development process and to introduce a feasible method for written test development in general.The test development was based on the unitary approach to validity. The process involved national consensus on learning objectives, standardized item writing, pilot testing, sensitivity analyses, standard setting and evaluation of psychometric properties using Item Response Theory models. Test responses and feedback from midwives, specialists and residents in obstetrics and gynecology, and medical and midwifery students were used in the process (proofreaders n?=?6, pilot test participants n?=?118, CTG course participants n?=?1679).The final test included 30 items and the passing score was established at 25 correct answers. All items fitted a loglinear Rasch model and the test was able to discriminate levels of competence. Seven items revealed differential item functioning in relation to profession and geographical regions, which means the test is not suitable for measuring differences between midwives and physicians or differences across regions. In the setting of pilot testing Cronbach's alpha equaled 0.79, whereas Cronbach's alpha equaled 0.63 in the setting of the CTG education program. This indicates a need for more items and items with a higher degree of difficulty in the test, and illuminates the importance of context when discussing validity.Test development is a complex and time-consuming process. The unitary approach to validity was a useful and applicable tool for development of a CTG written assessment. The process and findings supported our proposed interpretation of the assessment as measuring CTG knowledge and interpretive skills. However, for the test to function as a high-stake assessment a higher reliability is required.

Project description:Background: There is a strong need to include training of research methods in training programs for physicians. International clinical research training programs (CRTP) that comprehensively introduce the methodology of clinical research and combined with practice should be a priority. However, few studies have reported a multimodal international CRTP that provides clinicians with an introduction to the quantitative and methodological principles of clinical research. Objective: This manuscript is intended to comprehensively describe the development process and the structure of this multimodal training program. Methods: The CRTP was comprised of three distinct, sequential learning components: part 1 - a six-week online eLearning self-study; part 2 - a series of three weekly interactive synchronous webinars conducted between Durham, North Carolina, USA and Beijing, China; and part 3 - a five-day in-person workshop held at Beijing Friendship Hospital, Capital Medical University (BFH-CMU). Self-assessment quiz scores and participation rates were used to evaluate effectiveness of the training program. Participants' demographic characteristics, research experience, satisfaction and feedback on the program were collected using questionnaires. Results: A total of 50 participants joined the CRTP. Forty-four participants (88%) completed the program satisfaction questionnaires. The average quiz score of the six eLearning units varied from 31% to 73%. Among the three components of the program, the online eLearning self-study was felt to be the most challenging. Thirty-nine (89%) of the surveyed respondents were satisfied with all components of the training program. Among the respondents, 43 (98%) felt the training was helpful in preparing them for future clinical research projects and expressed willingness to recommend the program to other colleagues. Conclusions: We established a multimodal international collaborative training program. The program demonstrated acceptable participation rates and high satisfaction among Chinese clinicians. It provides a model that may be used by others developing similar international clinical research training programs for physicians.