Dataset Information

Exploration of examinees' traits that affect the score of Korean Medical Licensing Examination.

ABSTRACT: PURPOSE: It aims to identify the effect of five variables to score of the Korean Medical Licensing Examinations (KMLE) for three consecutive years from 2011 to 2013. METHODS: The number of examinees for each examination was 3,364 in 2011 3,177 in 2012, and 3,287 in 2013. Five characteristics of examinees were set as variables: gender, age, graduation status, written test result (pass or fail), and city of medical school. A regression model was established, with the score of a written test as a dependent variable and with examinees' traits as variables. RESULTS: The regression coefficients in all variables, except the city of medical school, were statistically significant. The variable's effect in three examinations appeared in the following order: result of written test, graduation status, age, gender, and city of medical school. CONCLUSION: written test scores of the KMLE revealed that female students, younger examinees, and first-time examinees had higher performances.

SUBMITTER: Yim MK

PROVIDER: S-EPMC4397840 | biostudies-other | 2015

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Exploration of examinees' traits that affect the score of Korean Medical Licensing Examination.

Yim Mi Kyoung MK

Journal of educational evaluation for health professions 20150316

<h4>Purpose</h4>It aims to identify the effect of five variables to score of the Korean Medical Licensing Examinations (KMLE) for three consecutive years from 2011 to 2013.<h4>Methods</h4>The number of examinees for each examination was 3,364 in 2011 3,177 in 2012, and 3,287 in 2013. Five characteristics of examinees were set as variables: gender, age, graduation status, written test result (pass or fail), and city of medical school. A regression model was established, with the score of a writte ...[more]

PMID: 25773516

Similar Datasets

Project description:Traditional Korean medicine (TKM) emphasizes individualized diagnosis and treatment. This uniqueness makes AI modeling difficult due to limited data and implicit processes. Large language models (LLMs) have demonstrated impressive medical inference, even without advanced training in medical texts. This study assessed the capabilities of GPT-4 in TKM, using the Korean National Licensing Examination for Korean Medicine Doctors (K-NLEKMD) as a benchmark. The K-NLEKMD, administered by a national organization, encompasses 12 major subjects in TKM. GPT-4 answered 340 questions from the 2022 K-NLEKMD. We optimized prompts with Chinese-term annotation, English translation for questions and instruction, exam-optimized instruction, and self-consistency. GPT-4 with optimized prompts achieved 66.18% accuracy, surpassing both the examination's average pass mark of 60% and the 40% minimum for each subject. The gradual introduction of language-related prompts and prompting techniques enhanced the accuracy from 51.82% to its maximum accuracy. GPT-4 showed low accuracy in subjects including public health & medicine-related law, internal medicine (2), and acupuncture medicine which are highly localized in Korea and TKM. The model's accuracy was lower for questions requiring TKM-specialized knowledge than those that did not. It exhibited higher accuracy in diagnosis-based and recall-based questions than in intervention-based questions. A significant positive correlation was observed between the consistency and accuracy of GPT-4's responses. This study unveils both the potential and challenges of applying LLMs to TKM. These findings underline the potential of LLMs like GPT-4 in culturally adapted medicine, especially TKM, for tasks such as clinical assistance, medical education, and research. But they also point towards the necessity for the development of methods to mitigate cultural bias inherent in large language models and validate their efficacy in real-world clinical settings.

Dataset Information

Exploration of examinees' traits that affect the score of Korean Medical Licensing Examination.

Publications

Exploration of examinees' traits that affect the score of Korean Medical Licensing Examination.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets