Dataset Information

A guide for evaluation of online learning in medical education: a qualitative reflective analysis.

ABSTRACT:

Background

With the strike of Covid-19, an unprecedented rapid shift to remote learning happened worldwide with a paradigm shift to online learning from an institutional adjuvant luxury package and learner choice into a forced solo choice. This raises the question of quality assurance. While some groups have already established standards for online courses, teaching and programs yet very little information is included on methodology of their development and very little emphasis is placed on the online learning experience. Nevertheless, no work has been done specifically for medical education institutions.

Aim

To develop a set of descriptors for best practice in online learning in medical education utilizing existing expertise and needs.

Methods

This work utilizes a qualitative multistage approach to identify the descriptors of best practice in online learning starting with a question guided focus group, thematic analysis, Delphi technique and an expert consensus session done simultaneously for triangulation. This was done involving 32 institution in 19 countries.

Results

This materialized into the development of a set of standards, indicators, and development of a checklist for each standard area. The standard areas identified were organizational capacity, educational effectiveness, and human resources each of which listed a number of standards. Expert consensus sessions identified the need for qualification of data and thus the development of indicators for best practice.

Conclusion

Standards are needed for online learning experience and their development and redesign is situational and needs to be enhanced methodologically in axes that are pertaining to the needs of the education community. Taking such axes into consideration by educators and institutions will lead to planning and implementing successful online learning activities, while taking them into consideration by the evaluators will help them conduct comprehensive audits and provide stakeholders with highly informative evaluation reports.

SUBMITTER: Wasfy NF

PROVIDER: S-EPMC8190722 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:We sought to determine whether the Reflective Practice Questionnaire (RPQ) is a reliable measure of reflective capacity and related characteristics in medical students. We also planned to learn how the RPQ could be used in medical education. METHODS:The RPQ is a 40 item self-report questionnaire that includes a multi-faceted approach to measuring reflective capacity. It also includes sub-scales on several other theoretically relevant constructs such as desire for improvement, confidence, stress, and job satisfaction. The reliabilities of reflective capacity and other sub-scales were determined by calculating their Cronbach alpha reliability values. In the present study, the RPQ was answered by 98 graduating fourth-year medical students from an American University, and these RPQ scores were compared with general public and mental health practitioner samples from a prior study using ANOVA and Bonferroni adjusted comparisons. RESULTS:Medical students reported a higher reflective capacity than the general public sample, but students were statistically indistinguishable from the mental health practitioner sample. For medical students, reflective capacity was associated with features of confidence, stress, and desire for improvement. Job satisfaction was positively associated with confidence in communication with patients, and negatively associated with stress when interacting with patients. A cluster analysis revealed that around 19% of the medical students exhibited a relatively high level of anxiety interacting with patients, 23% were less engaged, 5% were dissatisfied, and 7% expressed a level of over-confidence in their knowledge and skills that was concerning. CONCLUSIONS:The RPQ is a reliable measure of reflective capacity (Chronbach's alpha value?=?0.84) and related characteristics (Cronbach's alpha values from 0.75 to 0.83) in medical students. The RPQ can be used as part of pre-post evaluations of medical education initiatives, to complement student self-reflection activities in the curriculum, and to identify students who might benefit from targeted intervention.

Project description:BackgroundThe aim of this study is to review the literature on known barriers and solutions that face educators when developing and implementing online learning programs for medical students and postgraduate trainees.MethodsAn integrative review was conducted over a three-month period by an inter-institutional research team. The search included ScienceDirect, Scopus, BioMedical, PubMed, Medline (EBSCO & Ovid), ERIC, LISA, EBSCO, Google Scholar, ProQuest A&I, ProQuest UK & Ireland, UL Institutional Repository (IR), UCDIR and the All Aboard Report. Search terms included online learning, medical educators, development, barriers, solutions and digital literacy. The search was carried out by two reviewers. Titles and abstracts were screened independently and reviewed with inclusion/exclusion criteria. A consensus was drawn on which articles were included. Data appraisal was performed using the Critical Appraisal Skills Programme (CASP) Qualitative Research Checklist and NHMRC Appraisal Evidence Matrix. Data extraction was completed using the Cochrane Data Extraction Form and a modified extraction tool.ResultsOf the 3101 abstracts identified from the search, ten full-text papers met the inclusion criteria. Data extraction was completed on seven papers of high methodological quality and on three lower quality papers. Findings suggest that the key barriers which affect the development and implementation of online learning in medical education include time constraints, poor technical skills, inadequate infrastructure, absence of institutional strategies and support and negative attitudes of all involved. Solutions to these include improved educator skills, incentives and reward for the time involved with development and delivery of online content, improved institutional strategies and support and positive attitude amongst all those involved in the development and delivery of online content.ConclusionThis review has identified barriers and solutions amongst medical educators to the implementation of online learning in medical education. Results can be used to inform institutional and educator practice in the development of further online learning.

Project description:BackgroundThe coronavirus disease 2019 (COVID-19) pandemic led to far-reaching restrictions of social and professional life, affecting societies all over the world. To contain the virus, medical schools had to restructure their curriculum by switching to online learning. However, only few medical schools had implemented such novel learning concepts. We aimed to evaluate students' attitudes to online learning to provide a broad scientific basis to guide future development of medical education.MethodsOverall, 3286 medical students from 12 different countries participated in this cross-sectional, web-based study investigating various aspects of online learning in medical education. On a 7-point Likert scale, participants rated the online learning situation during the pandemic at their medical schools, technical and social aspects, and the current and future role of online learning in medical education.ResultsThe majority of medical schools managed the rapid switch to online learning (78%) and most students were satisfied with the quantity (67%) and quality (62%) of the courses. Online learning provided greater flexibility (84%) and led to unchanged or even higher attendance of courses (70%). Possible downsides included motivational problems (42%), insufficient possibilities for interaction with fellow students (67%) and thus the risk of social isolation (64%). The vast majority felt comfortable using the software solutions (80%). Most were convinced that medical education lags behind current capabilities regarding online learning (78%) and estimated the proportion of online learning before the pandemic at only 14%. In order to improve the current curriculum, they wish for a more balanced ratio with at least 40% of online teaching compared to on-site teaching.ConclusionThis study demonstrates the positive attitude of medical students towards online learning. Furthermore, it reveals a considerable discrepancy between what students demand and what the curriculum offers. Thus, the COVID-19 pandemic might be the long-awaited catalyst for a new "online era" in medical education.