Dataset Information

Barriers to obtaining reliable results from evaluations of teaching quality in undergraduate medical education

ABSTRACT: Background Medical education is characterized by numerous features that are different from other higher education programmes, and evaluations of teaching quality are an integral part of medical education. Although scholars have made extensive efforts to enhance the quality of teaching, various issues unrelated to teaching that interfere with the accuracy of evaluation results remain. The purpose of this study is to identify the barriers that prevent objective and reliable results from being obtained during the evaluation process. Methods This study used mixed methods (3 data sources) to collect opinions from different stakeholders. Based on purposive sampling, 16 experts familiar with teaching management and 12?s- and third-year students were invited to participate in interviews and discussions, respectively. Additionally, based on systematic random sampling, 74 teachers were invited to complete a questionnaire survey. All qualitative data were imported into NVivo software and analysed using thematic analysis in chronological order and based on grounded theory. Statistical analyses of the questionnaire results were conducted using SPSS software. Results Sixty-nine valid questionnaires (93.24%) were recovered. A total of 29 open codes were extracted, and 14 axial codes were summarized and divided into four selective codes: evaluation preparation, the index system, the operation process, and the consequences of evaluation. The main barriers to obtaining reliable evaluation results included inadequate attention, unreasonable weighting, poor teaching facilities, an index without pertinence and appropriate descriptions, bad time-points, incomplete information on the system, lagged feedback, and disappointing result application. Almost all participants suggested lowering the weight of students as subjects, with a weight of 50–60% being appropriate. Students showed dissatisfaction with evaluation software, and the participants disagreed over the definition of good teaching and the management of student attendance. Conclusions This study reveals the difficulties and problems in current evaluations of teaching in medical education. Collecting data from multiple stakeholders helps in better understanding the evaluation process. Educators need to be aware of various issues that may affect the final results when designing the evaluation system and interpreting the results. More research on solutions to these problems and the development of a reasonable evaluation system is warranted.

SUBMITTER: Zhang Z

PROVIDER: S-EPMC7523339 | biostudies-literature | 2020 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundTo provide optimal care, medical students should understand that the social determinants of health (SDH) impact their patients' well-being. Those charged with teaching SDH to future physicians, however, face a paucity of curricular guidance.ObjectiveThis review's objective is to map key characteristics from publications about teaching SDH to students in undergraduate medical education (UME).MethodsIn 2016, the authors searched PubMed, Embase, Web of Science, the Cochrane and ERIC databases, bibliographies, and MedEdPORTAL for articles published between January 2010 and November 2016. Four reviewers screened articles for eligibility then extracted and analyzed data descriptively. Scoping review methodology was used to map key concepts and curricular logistics as well as educator and student characteristics.ResultsThe authors screened 3571 unique articles of which 22 were included in the final review. Many articles focused on community engagement (15). Experiential learning was a common instructional strategy (17) and typically took the form of community or clinic-based learning. Nearly half (10) of the manuscripts described school-wide curricula, of which only three spanned a full year. The majority of assessment was self-reported (20) and often related to affective change. Few studies objectively assessed learner outcomes (2).ConclusionsThe abundance of initial articles screened highlights the growing interest in SDH in medical education. The small number of selected articles with sufficient detail for abstraction demonstrates limited SDH curricular dissemination. A lack of accepted tools or practices that limit development of robust learner or program evaluation was noted. Future research should focus on identifying and evaluating effective instructional and assessment methodologies to address this gap, exploring additional innovative teaching frameworks, and examining the specific contexts and characteristics of marginalized and underserved populations and their coverage in medical education.

Project description:BackgroundPatient-clinician communication training is a core component of the undergraduate medical program. As with all areas of medicine, the best available evidence for teaching these skills should be incorporated into training programs. Examining the volume, type and design-quality of publications in this field can help to determine whether research is following a natural scientific progression to inform interactional skills training. This study aimed to review: (i) whether the proportion of publications examining teaching interactional skills to undergraduate medical students by study type, across three time-periods (2007-2008, 2011-2012, 2015-2016), changed over time (i.e. measurement, descriptive or interventions studies); and (ii) the proportion of intervention studies meeting Cochrane Effective Practice and Organisation of Care (EPOC) research design criteria.MethodsMedline, PubMed, PsycInfo and the Cochrane Database were searched for studies published in English from 2007 to 2016. Title and abstract reviews were performed for the included years. Articles were examined against the inclusion/exclusion criteria and those included were coded into descriptive, measurement or intervention categories.ResultsA total of 243 relevant publications were identified. Fifty-two were published from 2007 to 2008, 75 from 2011 to 2012 and 116 from 2015 to 2016. Most identified studies were descriptive (63%), followed by measurement studies (22%) and intervention studies (15%). The proportion of descriptive studies increased significantly over time. However, the proportion of intervention studies did not change and the proportion of measures studies significantly decreased. Of the 37 intervention studies identified within the three time-periods, only 16 (43%) met EPOC study design criteria.ConclusionsThe largest proportion of identified studies were descriptive, however, descriptive research is not sufficient to ensure communication skills training can effectively improve interactions between clinicians and patients. A more rigorous approach to research in this area is needed to inform education strategies.

Project description:BackgroundAlthough progress has been made in evolution education, many educators face significant barriers in their efforts to teach evolution specifically, and science in general. The purpose of this study was to identify faculty-perceived barriers to teaching evolution, specifically in religiously affiliated institutions or institutions with a highly religious student body, as well as resources faculty feel would help promote discourse around faith, evolution and science. To do this, we held a workshop with teams consisting of a science professor, a theologian and a pastor (of the predominant on-campus faith tradition) from 17 different institutions of higher education with highly religious student bodies for the purpose of helping them to create a curriculum to address perceived conflicts between science and faith. During the workshop, participants created posters identifying barriers they face and resources they perceive as helpful. These posters were analyzed for prevalent themes and framed within an ecological model of behavior.ResultsThese teams identified prevalent barriers at each level of the ecological model. Intrapersonal factors included a fear of rocking the boat and a fear of student conflict. Interpersonal factors included perceived student lack of knowledge, student ideology, and student apathy. Institutional factors included work politics, a lack of relevant discourse surrounding the conflict, and mixed messaging to students. Community factors included social norms associated with various student demographics. And public policy factors included local and state government attempts to limit the teaching of evolution. Additionally, participants identified resources that they felt would facilitate overcoming conflict including colleagues as change agents, various assets, and tools to negate conflict.ConclusionsWe determined that many of the concerns are addressable, and many resources are attainable. We urge the community to work toward these solutions. Additionally, we compare our findings to what the literature has shown and discuss the implications of faculty perceptions as compared to the published literature.Supplementary informationThe online version contains supplementary material available at 10.1186/s12052-021-00151-1.

Dataset Information

Barriers to obtaining reliable results from evaluations of teaching quality in undergraduate medical education

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets