In pursuit of a valid Information Assessment Method for continuing education: a mixed methods study.
Ontology highlight
ABSTRACT: Background
The Information Assessment Method (IAM) is a popular tool for continuing education and knowledge translation. After a search for information, the IAM allows the health professional to report what was the search objective, its cognitive impact, as well as any use and patient health benefit associated with the retrieved health information. In continuing education programs, professionals read health information, rate it using the IAM, and earn continuing education credit for this brief individual reflective learning activity. IAM items have been iteratively developed using literature reviews and qualitative studies. Thus, our research question was: what is the content validity of IAM items from the users' perspective?Methods
A two-step content validation study was conducted. In Step 1, we followed a mixed methods research design, and assessed the relevance and representativeness of IAM items. In this step, data from a longitudinal quantitative study and a qualitative multiple case study involving 40 family physicians were analyzed. In Step 2, IAM items were analyzed and modified based on a set of guiding principles by a multi-disciplinary expert panel.Results
The content validity of 16 IAM items was supported, and these items were not changed. Nine other items were modified. Three new items were added, including two that were extensions of an existing item.Conclusion
A content validated version of the IAM (IAM 2011) is available for the continuing education of health professionals.
SUBMITTER: Bindiganavile Sridhar S
PROVIDER: S-EPMC3842783 | biostudies-literature | 2013 Oct
REPOSITORIES: biostudies-literature
Publications
In pursuit of a valid Information Assessment Method for continuing education: a mixed methods study.
Bindiganavile Sridhar Soumya S Pluye Pierre P Grad Roland R
BMC medical education 20131007
<h4>Background</h4>The Information Assessment Method (IAM) is a popular tool for continuing education and knowledge translation. After a search for information, the IAM allows the health professional to report what was the search objective, its cognitive impact, as well as any use and patient health benefit associated with the retrieved health information. In continuing education programs, professionals read health information, rate it using the IAM, and earn continuing education credit for this ...[more]
Similar Datasets
Project description:BACKGROUND:Feedback is essential for improving the skills of continuing medical education (CME) presenters. However, there has been little research on improving the quality of feedback to CME presenters. OBJECTIVES:To validate an instrument for generating balanced and behavior-specific feedback from a national cross-section of participants to presenters at a large internal medicine CME course. DESIGN, SETTING, AND PARTICIPANTS:A prospective, randomized validation study with qualitative data analysis that included all 317 participants at a Mayo Clinic internal medicine CME course in 2009. MEASUREMENTS:An 8-item (5-point Likert scales) CME faculty assessment enhanced study form (ESF) was designed based on literature and expert review. Course participants were randomized to a standard form, a generic study form (GSF), or the ESF. The dimensionality of instrument scores was determined using factor analysis to account for clustered data. Internal consistency and interrater reliabilities were calculated. Associations between overall feedback scores and presenter and presentation variables were identified using generalized estimating equations to account for multiple observations within talk and speaker combinations. Two raters reached consensus on qualitative themes and independently analyzed narrative entries for evidence of balanced and behavior-specific comments. RESULTS:Factor analysis of 5,241 evaluations revealed a uni-dimensional model for measuring CME presenter feedback. Overall internal consistency (Cronbach alpha?=?0.94) and internal consistency reliability (ICC range 0.88-0.95) were excellent. Feedback scores were associated with presenters' academic ranks (mean score): Instructor (4.12), Assistant Professor (4.38), Associate Professor (4.56), Professor (4.70) (p?=?0.046). Qualitative analysis revealed that the ESF generated the highest numbers of balanced comments (GSF?=?11, ESF?=?26; p?=?0.01) and behavior-specific comments (GSF?=?64, ESF?=?104; p?=?0.001). CONCLUSIONS:We describe a practical and validated method for generating balanced and behavior-specific feedback for CME presenters in internal medicine. Our simple method for prompting course participants to give balanced and behavior-specific comments may ultimately provide CME presenters with feedback for improving their presentations.
| S-EPMC3304027 | biostudies-literature
Project description:BackgroundThe Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products.ObjectiveOur general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email.MethodsA 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation).ResultsOf the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014).ConclusionsThis study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs.
| S-EPMC5373673 | biostudies-literature
Project description:IntroductionVaccination is a fundamental intervention in disease prevention; therefore, the advice and recommendations of health professionals have a major influence on the population's decision to be vaccinated or not. Professionals must have sufficient competencies to carry out their work and recommend vaccination with evidence-based knowledge. The aim is to design and validate a strategy to improve professional competencies in vaccination to positively influence adherence and increase vaccination rates in the population.Methods and analysisTraining will be designed based on evidence and previous studies and piloted with healthcare providers. To test changes in knowledge, a pretest and post-test will be conducted. To test feasibility, a think-aloud method will be used with participants and triangulated with focus groups using SWOT (strengths, weaknesses, opportunities and threats) analysis. Transfer will be measured using the questionnaire 'factors for the indirect evaluation of transfer' and an efficacy questionnaire 1½ months later; for satisfaction, an ad hoc questionnaire will be used. A summative approach will be used for the analysis of the focus groups and descriptive and bivariate statistics for the questionnaires.Ethics and disseminationThis study was approved by the Andalusian Research Ethics Committee, Spain (approval number: 0524-N-20). The results will be made available to the public at journal publications and scientific conferences.
| S-EPMC9196173 | biostudies-literature
Project description:BackgroundEffective provider-patient communication is crucial to the delivery of high-quality care. Communication roadblock such as righting reflex is widely observed among providers and can lead to relational disengagement. In previous work, nurses felt ill-equipped to communicate effectively with HIV-positive patients to support medication adherence. Providing nurses with continuing education opportunities to improve their relational skills is a major target for optimizing the quality of care. Virtual patient simulation is one promising strategy that needs to be evaluated among graduate nurses. This study aimed to assess the acceptability of a virtual patient simulation to improve nurses' relational skills in a continuing education context.MethodsWe conducted a convergent mixed methods study by combining a quantitative pre-experimental, one-group post-test design and a qualitative exploratory study. We used convenience and snowball sampling approaches to select registered nurses (n = 49) working in Quebec, Canada. Participants completed an online sociodemographic questionnaire, consulted the automated virtual patient simulation (informed by motivational interviewing), and filled out an online post-test survey. Descriptive statistics (mean, SD, median, interquartile range) were used to present quantitative findings. From the 27 participants who completed the simulation and post-test survey, five participated in a focus group to explore their learning experience. The discussion transcript was subjected to thematic analysis. At the final stage of the study, we used a comparison strategy for the purpose of integrating the quantitative and qualitative results.ResultsNurses perceived the simulation to be highly acceptable. They rated the global system quality and the technology acceptance with high scores. They reported having enjoyed the simulation and recommended other providers use it. Four qualitative themes were identified: motivations to engage in the simulation-based research; learning in a realistic, immersive, and non-judgmental environment; perceived utility of the simulation; and perceived difficulty in engaging in the simulation-based research.ConclusionsThe simulation contributed to knowledge and skills development on motivational interviewing and enhanced nurses' self-confidence in applying relational skills. Simulation holds the potential to change practice, as nurses become more self-reflective and aware of the impact of their relational skills on patient care.Trial registrationISRCTN18243005 , retrospectively registered on July 3 2020.
| S-EPMC8725454 | biostudies-literature
Project description:IntroductionHealth professionals in rural settings encounter a wide range of medical conditions requiring broad knowledge for their clinical practice. This creates the need for ongoing continuing professional development (CPD). In this study, we explored the barriers that health professionals in a rural healthcare context faced participating in CPD activities and their preferences regarding educational strategies to overcome these challenges.MethodsThis mixed-methods (exploratory sequential) study in a community hospital in rural Mexico includes 22 interviews, 3 focus groups, 40 observational hours, and a questionnaire of healthcare staff.ResultsDespite low engagement with CPD activities (67% not motivated), all participants expressed interest and acknowledged the importance of learning for their practice. Barriers to participating include a disparity between strategies used (lecture-based) and their desire for practical learning, institutional barriers (poor leadership engagement, procedural flaws, and lack of resources), and collaboration barriers (adverse interprofessional education environment, ineffective teamwork, and poor communication). Additional barriers identified were inconvenient scheduling of sessions (75%), inadequate classrooms (65%), high workload (60%), ineffective speakers (60%), and boring sessions (55%). Participants' preferred learning strategies highlighted activities relevant to their daily clinical activities (practical workshops, simulations, and case analysis). The questionnaire had an 18% response rate.DiscussionThe barriers to CPD in this rural setting are multifactorial and diverse. A strong interest to engage in context-specific active learning strategies highlighted the need for leadership to prioritize interprofessional education, teamwork, and communication to enhance CPD and patient care. These results could inform efforts to strengthen CPD in other rural contexts.
| S-EPMC9360663 | biostudies-literature
Project description:Introduction: Patients awaiting lung transplantation must learn new information to successfully navigate the transplant process. A supplemental video series was piloted to patients at home during the Covid-19 pandemic to improve pre-transplant education. Methods: A mixed methods study was undertaken to assess patient experiences with this method of education, confirm the ideal timing of the education, and identify gaps that require further attention. Semi-structured interviews were conducted with 17 one-on-one or dyadic (patients and caregivers) who viewed the video series at home. A third-party researcher (not involved in creation of the educational materials) conducted the interviews by phone, which were audio recorded and then transcribed verbatim. NVivo 12 Pro for Windows software was used to code the data and identify emerging themes. Results: Participants indicated that home-based videos were applicable, and informative and helpful (4.7 on 5-point Likert scale) and appreciated the advice and experiences of real patients. They were satisfied with their transplant education (4.2/5). While there were few aspects that the participants disliked about the videos, the interviews elicited outstanding questions about the transplant process (eg, logistical aspects of travel) and transplant concerns (eg, medications, expenses, and precautions in daily life). Conclusion: Patients being assessed or listed for lung transplant valued the novel electronic video education, and we will implement the home-based process into standard of care after the patient's initial visit with the transplant respirologist. Pre-transplant education will be tailored to help address the outstanding gaps identified in this program evaluation.
| S-EPMC9297341 | biostudies-literature
Project description:BackgroundPatients with chronic diseases have seen unprecedented changes to healthcare practices since the emergence of COVID-19. Traditional 'on-site' clinics have had to innovate to continue services. Whether these changes are acceptable to patients and are effective for care continuation are largely unreported.MethodsWe evaluated the effectiveness of care provision at a re-structured chronic care clinic and elicited the patient experiences of care and self-management. We conducted a convergent, parallel, mixed-methods study. Adult patients attending a chronic care clinic were included. We extracted data from 4,849 clinic visits before and during the COVID-19 pandemic, including operational metrics and attendee profile. We also conducted fifteen interviews with patients from the same clinic using a semi-structured interview guide.ResultsRe-structuring the chronic clinic, including the introduction of teleconsultations, home-delivery of prescriptions and use of community-based phlebotomy services, served to maintain continuity of care while adhering to COVID-19 containment measures. Qualitatively, five themes emerged. Patients were able to adjust to healthcare practice changes and adapt their own lifestyles, although poor self-management practices were adopted. While most were apprehensive about attending the clinic, they valued ongoing care access and were reassured by the on-site containment measures.ConclusionsContinuation of routine services is desired by patients and can be achieved through the adoption of containment measures, by greater collaboration with community partners, and the use of technology. Patients adapted to service changes, but poor self-management was evident. To prevent chronic disease relapse, services must strive to innovate rather than suspend services during pandemics.
| S-EPMC9358920 | biostudies-literature
Project description:BACKGROUND:The Mobile Continuing Medical Education Project (mCME V.2.0) was a randomized controlled trial designed to test the efficacy of a text messaging (short message service [SMS])-based distance learning program in Vietnam that included daily quiz questions, links to readings and online courses, and performance feedback. The trial resulted in significant increases in self-study behaviors and higher examination scores for intervention versus control participants. OBJECTIVE:The objective of this mixed-methods study was to conduct qualitative and quantitative investigations to understand participants' views of the intervention. We also developed an explanatory framework for future trial replication. METHODS:At the endline examination, all intervention participants completed a survey on their perspectives of mCME and self-study behaviors. We convened focus group discussions to assess their experiences with the intervention and attitudes toward continuing medical education. RESULTS:A total of 48 HIV specialists in the intervention group completed the endline survey, and 30 participated in the focus group discussions. Survey and focus group data suggested that most clinicians liked the daily quizzes, citing them as convenient mechanisms to convey information in a relevant manner. A total of 43 of the 48 (90%) participants reported that the daily quizzes provided motivation to study for continuing medical education purposes. Additionally, 83% (40/48) of intervention participants expressed that they were better prepared to care for patients with HIV in their communities, compared with 67% (32/48) at baseline. Participation in the online coursework component was low (only 32/48, 67% of intervention participants ever accessed the courses), but most of those who did participate thought the lectures were engaging (26/32, 81%) and relevant (29/32, 91%). Focus group discussions revealed that various factors influenced the clinicians' decision to engage in higher learning, or "lateral learning," including the participant's availability to study, professional relevance of the topic area, and feedback. These variables serve as modifying factors that fit within an adapted version of the health belief model, which can explain behavior change in this context. CONCLUSIONS:Qualitative and quantitative endline data suggested that mCME V.2.0 was highly acceptable. Participant behaviors during the trial fit within the health belief model and can explain the intervention's impact on improving self-study behaviors. The mCME platform is an evidence-based approach with the potential for adoption at a national scale as a method for promoting continuing medical education. TRIAL REGISTRATION:ClinicalTrials.gov NCT02381743; https://clinicaltrials.gov/ct2/show/NCT02381743.
| S-EPMC6495296 | biostudies-literature
Project description:The website Sexe Joves is a website on sexuality of the Department of Health of the Government of Catalonia (Spain). This study aims to understand the experiences and opinions of people aged 14 to 25 regarding this website, taking into account sex, gender identity, sexual orientation, socioeconomic status and location within Catalonia (urban, semiurban and rural areas). With the objective of improving the website and adpating the resources allocated to it, this study evaluates whether this population is familiar with it and uses it, as well as the website's usability and accessibility (digital equity), usefulness and the relevance of its content. A parallel convergent triangulation design is used: a qualitative study using a social constructivist perspective, and an observational, descriptive and cross-sectional quantitative study. We conduct a discourse analysis of participants and use an "ad hoc" questionnaire to collect quantitative data. A descriptive analysis of all variables is carried out. Affective-sexual education aimed at young people must stem from their participation and the whole range of sexual and gender diversity in order to reach the entire population equally. This analysis will contribute to the design of new strategies for the wesbite Sexe Joves, a public health resource, in order to improve affective-sexual education for young people.
| S-EPMC9778971 | biostudies-literature
Project description:BackgroundTherapeutic patient education (TPE) improves quality of life and reduces health care utilization among patients with chronic obstructive pulmonary disease (COPD). However, benefits from TPE might depend on the performance of the educators and training is needed to ensure the effective delivery of TPE interventions. Based on the framework by Moore et al. (J Contin Educ Health Prof 29:1-15, 2009), we will compare the impact of two continuing education (CE) activities on TPE in regard to the following educational outcomes: (1) learning, (2) self-report of competence, (3) performance of the educators, and (4) outcomes of COPD patients who will meet the newly trained educators for TPE.MethodsWe will conduct a non-randomized controlled study using mixed methods. Educators will first participate in a CE activity on TPE that will include a role-playing simulation (experimental group) or in a lecture on TPE (comparison group) and then will perform TPE in COPD patients. Among educators, we will assess: (1) learning, by measuring knowledge about TPE, and (2) self-report of competence using self-administered questionnaires before and after the activity. Then, after the CE activity, we will assess (3) educators' performance levels in delivering TPE by rating a videotaped TPE intervention. In COPD patients who will meet the newly trained educators for TPE after either CE activity, we will assess (4) quality of life and resource utilization using interviewer-administered questionnaires, before and after TPE. Statistical analyses will compare the experimental group against the comparison group using multivariate models. Using a semi-structured interview guide, we will conduct interviews with educators and perform content analysis. Results will be integrated in order that qualitative results further explain the quantitative ones.DiscussionTo the best of our knowledge, this is the first controlled mixed methods study to compare the impact of two CE activities on TPE in regard to four educational outcomes. We believe this study will serve as a model for evaluating CE activities on TPE. Results from this study could increase educators' performance levels in delivering effective TPE interventions, and, in turn, COPD patient outcomes.Trial registrationThe study was registered on https://clinicaltrials.gov/ ( NCT02870998 ) on March 15, 2016.
| S-EPMC6006567 | biostudies-literature