RE-AIMing COVID-19 online learning for medical students: a massive open online course evaluation.
Ontology highlight
ABSTRACT: Background
Clinical training during the COVID-19 pandemic is high risk for medical students. Medical schools in low- and middle-income countries (LMIC) have limited capacity to develop resources in the face of rapidly developing health emergencies. Here, a free Massive Open Online Course (MOOC) was developed as a COVID-19 resource for medical students working in these settings, and its effectiveness was evaluated.Methods
The RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework was utilized to evaluate the effectiveness of MOOC in teaching medical students about COVID-19. The data sources included the student registration forms, metrics quantifying their interactions within the modules, students' course feedback, and free-text responses. The data were collected from the Moodle learning management system and Google analytics from May 9 to September 15, 2020. The research team analyzed the quantitative data descriptively and the qualitative data thematically.Results
Among the 16,237 unique visitors who accessed the course, only 6031 medical students from 71 medical schools registered, and about 4993 (83% of registrants) completed the course, indicating high levels of satisfaction (M = 8.17, SD = 1.49) on a 10-point scale. The mean scores of each assessment modules were > 90%. The free-text responses from 987 unique students revealed a total of 17 themes (e.g., knowing the general information on COVID-19, process management of the pandemic in public health, online platform use, and instructional design) across the elements of the RE-AIM framework. Mainly, the students characterized the MOOC as well-organized and effective.Conclusions
Medical students learned about COVID-19 using a self-paced and unmonitored MOOC. MOOCs could play a vital role in the dissemination of accurate information to medical students in LMIC in future public health emergencies. The students were interested in using similar MOOCs in the future.
SUBMITTER: Yilmaz Y
PROVIDER: S-EPMC8154107 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BACKGROUND:Massive open online courses (MOOCs) have the potential to make a broader educational impact because many learners undertake these courses. Despite their reach, there is a lack of knowledge about which methods are used for evaluating these courses. OBJECTIVE:The aim of this review was to identify current MOOC evaluation methods to inform future study designs. METHODS:We systematically searched the following databases for studies published from January 2008 to October 2018: (1) Scopus, (2) Education Resources Information Center, (3) IEEE (Institute of Electrical and Electronic Engineers) Xplore, (4) PubMed, (5) Web of Science, (6) British Education Index, and (7) Google Scholar search engine. Two reviewers independently screened the abstracts and titles of the studies. Published studies in the English language that evaluated MOOCs were included. The study design of the evaluations, the underlying motivation for the evaluation studies, data collection, and data analysis methods were quantitatively and qualitatively analyzed. The quality of the included studies was appraised using the Cochrane Collaboration Risk of Bias Tool for randomized controlled trials (RCTs) and the National Institutes of Health-National Heart, Lung, and Blood Institute quality assessment tool for cohort observational studies and for before-after (pre-post) studies with no control group. RESULTS:The initial search resulted in 3275 studies, and 33 eligible studies were included in this review. In total, 16 studies used a quantitative study design, 11 used a qualitative design, and 6 used a mixed methods study design. In all, 16 studies evaluated learner characteristics and behavior, and 20 studies evaluated learning outcomes and experiences. A total of 12 studies used 1 data source, 11 used 2 data sources, 7 used 3 data sources, 4 used 2 data sources, and 1 used 5 data sources. Overall, 3 studies used more than 3 data sources in their evaluation. In terms of the data analysis methods, quantitative methods were most prominent with descriptive and inferential statistics, which were the top 2 preferred methods. In all, 26 studies with a cross-sectional design had a low-quality assessment, whereas RCTs and quasi-experimental studies received a high-quality assessment. CONCLUSIONS:The MOOC evaluation data collection and data analysis methods should be determined carefully on the basis of the aim of the evaluation. The MOOC evaluations are subject to bias, which could be reduced using pre-MOOC measures for comparison or by controlling for confounding variables. Future MOOC evaluations should consider using more diverse data sources and data analysis methods. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID):RR2-10.2196/12087.
| S-EPMC7215503 | biostudies-literature
Project description:INTRODUCTION:The educational technology of massive open online courses (MOOCs) has been successfully applied in a wide variety of disciplines and are an intense focus of educational research at this time. Educators are now looking to MOOC technology as a means to improve professional medical education, but very little is known about how medical MOOCs compare with traditional content delivery. METHODS:A retrospective analysis of the course evaluations for the Medicine as a Business elective by fourth-year medical students at Southern Illinois University School of Medicine (SIU-SOM) for the 2012-2015 academic years was conducted. This course was delivered by small group flipped classroom discussions for 2012-2014 and delivered via MOOC technology in 2015. Learner ratings were compared between the two course delivery methods using routinely collected course evaluations. RESULTS:Course enrollment has ranged from 6-19 students per year in the 2012-2015 academic years. Student evaluations of the course are favorable in the areas of effective teaching, accurate course objectives, meeting personal learning objectives, recommending the course to other students, and overall when rated on a 5-point Likert scale. The majority of all student ratings (76-95%) of this elective course are for the highest possible choice (Strongly agree or Excellent) for any criteria, regardless if the course was delivered via a traditional or MOOC format. Statistical analysis of these ratings suggests that the Effective Teacher and Overall Evaluations did not statistically differ between the two delivery formats. DISCUSSION:Student ratings of this elective course were highly similar when delivered in a flipped classroom format or by using MOOC technology. The primary advantage of this new course format is flexibility of time and place for learners, allowing them to complete the course objectives when convenient for them. The course evaluations suggest this is a change that is acceptable to the target audience. CONCLUSIONS:This study suggests that learner evaluations of a fourth-year medical school elective course do not significantly differ when delivered by flipped classroom group discussions or via MOOC technology in a very small single center observational study. Further investigation is required to determine if this delivery method is an acceptable and effective means of teaching in the medical school environment.
| S-EPMC4991885 | biostudies-literature
Project description:It is possible to focus medical genetics education by using a model that integrates the skills of end-user searching of the medical literature into the traditional course content. Since 1988, 313 first-year medical students were studied as they accessed MEDLINE to retrieve information about biochemical genetic disorders. Their search behavior was studied by analyzing data from the National Library of Medicine's traffic files. The skills that they initially learned were reinforced as they searched clinical genetics problem cases in the second-year pathology course, and these skills were consolidated in the third year when the students addressed specific patient-care questions in pediatrics. The students' perception of the value of this model was studied by analyzing questionnaires completed during the exercise. It was demonstrated that when students were taught the skills of accessing MEDLINE by computer, they could formulate a question, retrieve current information, critically review relevant articles, communicate effectively, and use these skills to contribute to patient care.
| S-EPMC1682177 | biostudies-other
Project description:In this study, we examined students' natural studying behaviors in massive, open, online course (MOOC) on introductory psychology. We found that, overall, distributing study across multiple sessions-increasing spacing-was related to increased performance on end-of-unit quizzes, even when comparing the same student across different time-points in the course. Moreover, we found important variation on who is more likely to engage in spaced study and benefit from it. Students with higher ability and students who were more likely to complete course activities were more likely to space their study. Spacing benefits, however, were largest for the lower-ability students and for those students who were less likely to complete activities. These results suggest that spaced study might work as a buffer, improving performance for low ability students and those who do not engage in active practices. This study highlights the positive impact of spacing in real-world learning situations, but more importantly, the role of self-regulated learning decisions in shaping the impact of spaced practice.
| S-EPMC7076029 | biostudies-literature
Project description:Massive Open Online Course (MOOC) platforms incorporate large course catalogs from which individual students may register multiple courses. We performed a network-based analysis of student achievement, considering how course-course interactions may positively or negatively affect student success. Our data set included 378,000 users and 1,000,000 unique registration events in France Université Numérique (FUN), a national MOOC platform. We adapt reliability theory to model certificate completion rates with a Weibull survival function, following the intuition that students "survive" in a course for a certain time before stochastically dropping out. Course-course interactions are found to be well described by a single parameter for user engagement that can be estimated from a user's registration profile. User engagement, in turn, correlates with certificate rates in all courses regardless of specific content. The reliability approach is shown to capture several certificate rate patterns that are overlooked by conventional regression models. User engagement emerges as a natural metric for tracking student progress across demographics and over time.
| S-EPMC7822273 | biostudies-literature
Project description:IntroductionNewly graduated medical doctors in their internships are positioned to strengthen the front line in combating COVID-19. We developed a Massive Open Online Course (MOOC) to equip them with adequate knowledge for COVID-19 management. This paper aims to analyze the MOOC and evaluate participant satisfaction and increase in knowledge after completing the course.MethodsAn observational study was conducted. Quantitative data were obtained from questionnaires and pre- and post-tests. Responses to open-ended questions of the questionnaires were collected. Analysis using the Quality Reference Framework was also completed.ResultsThe MOOC consisted of fundamental knowledge of COVID-19 (Part A) and further enrichment (Part B), and the content was written in the Indonesian language. A total of 3,424 and 2,462 participants completed the course in August and November 2020, respectively. Most participants agreed that the platform was easy to navigate, the design was interesting, and the content was aligned with their needs. Pre- and post-test scores in Part A's subjects increased significantly. Factors contributing to and inhibiting usability and areas for improvement were further highlighted.DiscussionThe use of a specific quality framework facilitated a comprehensive evaluation of the MOOC's strengths, weaknesses, and areas for future improvements. The participants' satisfaction and pre- and post-test results showed that the current MOOC holds great potential benefit for continuing education for medical interns joining the frontliners during the pandemic. Future implementation should consider increasing the quality of learning resources, scaling up the platform and its technical supports, and enhancing organizational supports.
| S-EPMC8432880 | biostudies-literature
Project description:The nutrition education landscape is changing due to advances in technology. Massive Open Online Courses (MOOCs) are an example of new education opportunities, made possible by advances in online learning environments. This research aimed to evaluate a nutrition-focused MOOC, applying Kirkpatrick's theoretical model of learning, to comprehensively describe learners' reactions, knowledge and behaviours. A mixed-methods approach explored learners' experiences of participating in a global nutrition MOOC. Quantitative survey data, using descriptive statistics, measured pre-course nutrition knowledge, post-course satisfaction and learning, and changes to fruit/vegetable intake. Qualitative data from discussion forums and semi-structured interviews were thematically analysed and explored participant experiences and perceived impacts on dietary behaviours and nutrition knowledge. All results were mapped to Kirkpatrick's model. Surveys measuring perceived knowledge, satisfaction, and fruit and vegetable intake were completed by 4941, 1003 and 1090 participants, respectively. Overall reactions to the course were positive. Perceived vegetable intake increased for 62% of participants. Twelve interviews and six hundred and forty-seven forum comments were analysed, identifying eight themes highlighting changes to knowledge and dietary behaviours, and the importance of peer-to-peer learning. All results mapped to Levels 1-3 of Kirkpatrick's model. MOOCs can be an effective platform to communicate evidence-based nutrition information to large, global audiences.
| S-EPMC9500789 | biostudies-literature
Project description:IntroductionIncreasing number of Massive Open Online Courses (MOOCs) are being used to train learners at scale in various healthcare-related skills. However, many challenges in course delivery require further understanding, for example, factors exploring the reasons for high MOOC dropout rates, recorded low social interaction between learners and the lack of understanding of the impact of a course facilitators' presence in course engagement. There is a need to generate further evidence to explore these detriments to MOOC course delivery to enable enhanced course learning design. The proposed mixed-methods evaluation of the MOOC was determined based on the MOOC's aims and objectives and the methodological approaches used to evaluate this type of a course. The MOOC evaluation will help appraise the effectiveness of the MOOC in delivering its intended objectives. This protocol aims to describe the design of a study evaluating learners knowledge, skills and attitudes in a MOOCs about data science for healthcare.Methods and analysisStudy participants will be recruited from learners who have registered for the MOOC. On registration, learners will be given an opportunity to opt into the study and complete informed consent. Following completion of the course, study participants will be contacted to complete semistructured interviews. Interviews will be transcribed and coded using thematic analysis, with data analysed using two evaluation models: (1) the reach, effectiveness, adoption, implementation, maintenance framework and the (2) Kirkpatrick model drawing data from pre and post-course surveys and post-MOOC semi-structured interviews. The primary goal of the evaluation is to appraise participants' knowledge, skills and attitude after taking the MOOC.Ethics and disseminationEthics approval for this study was obtained from Imperial College London through the Education Ethics Review Process (EERP) (EERP1617-030). A summary of the research findings will be reported through a peer-reviewed journal and will be presented at an international conference.
| S-EPMC6091905 | biostudies-literature
Project description:BACKGROUND:The digital revolution has led to a boom in the number of available online health care resources. To navigate these resources successfully, digital literacy education is required. Learners who can evaluate the reliability and validity of online health care information are likely to be more effective at avoiding potentially dangerous misinformation. In addition to providing health care education, massive open online courses (MOOCs) are well positioned to play a role in providing digital literacy education in this context. OBJECTIVE:This study focused on learners enrolled in a MOOC on cancer genomics. The aim of this study was to evaluate the efficacy of a series of digital literacy-related activities within this course. This was an iterative study, with changes made to digital literacy-related activities in 4 of the 8 runs of the course. METHODS:This mixed methods study focused on learner engagement with the digital literacy-related activities, including the final course written assignment. Quantitative data including the number of references listed in each written assignment were compared between successive runs. Qualitative data in the form of learner comments on discussion forums for digital literacy-related tasks were evaluated to determine the impact of these educational activities. RESULTS:Using the number of references included for each final course assignment as an indicator of digital literacy skills, the digital literacy-related activities in the final 2 runs were judged to be the most successful. We found a statistically significant increase in the number of references cited by learners in their final written assignments. The average number of references cited in Run 8 was significantly higher (3.5) than in Run 1 (1.8) of the MOOC (P=.001). Learner comments in Runs 7 and 8 showed that a poll in which learners were asked to select which of 4 online resources was reliable was effective in stimulating learner discussion about how to evaluate resource reliability. CONCLUSIONS:Similar to many health care MOOCs, the course studied here had a heterogeneous group of learners, including patients (and their families), the public, health care students, and practitioners. Carefully designing a range of digital literacy-related activities that would be beneficial to this heterogenous group of learners enabled learners to become more effective at evaluating and citing appropriate online resources within their written assignments.
| S-EPMC7066506 | biostudies-literature
Project description:ObjectivesTo assess the prevalence of awareness and use of massive open online courses (MOOCs) among medical undergraduates in Egypt as a developing country, as well as identifying the limitations and satisfaction of using these courses.DesignA multicentre, cross-sectional study using a web-based, pilot-tested and self-administered questionnaire.SettingsTen out of 19 randomly selected medical schools in Egypt.Participants2700 undergraduate medical students were randomly selected, with an equal allocation of participants in each university and each study year.Primary and secondary outcome measuresPrimary outcome measures were the percentages of students who knew about MOOCs, students who enrolled and students who obtained a certificate. Secondary outcome measures included the limitations and satisfaction of using MOOCs through five-point Likert scale questions.ResultsOf 2527 eligible students, 2106 completed the questionnaire (response rate 83.3%). Of these students, 456 (21.7%) knew the term MOOCs or websites providing these courses. Out of the latter, 136 (29.8%) students had enrolled in at least one course, but only 25 (18.4%) had completed courses earning certificates. Clinical year students showed significantly higher rates of knowledge (p=0.009) and enrolment (p<0.001) than academic year students. The primary reasons for the failure of completion of courses included lack of time (105; 77.2%) and slow Internet speed (73; 53.7%). Regarding the 25 students who completed courses, 21 (84%) were satisfied with the overall experience. However, there was less satisfaction regarding student-instructor (8; 32%) and student-student (5; 20%) interactions.ConclusionsAbout one-fifth of Egyptian medical undergraduates have heard about MOOCs with only about 6.5% actively enrolled in courses. Students who actively participated showed a positive attitude towards the experience, but better time-management skills and faster Internet connection speeds are required. Further studies are needed to survey the enrolled students for a better understanding of their experience.
| S-EPMC4289712 | biostudies-literature