Presidential address: Demonstration of the international leadership of the Korea Health Personnel Licensing Examination Institute, introduction of a clinical skills test to the Korean Dental Licensing Examination, and strengthening of ethics items on licensing examinations.
Ontology highlight
ABSTRACT:
SUBMITTER: Lee YS
PROVIDER: S-EPMC6609292 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
Publications
Presidential address: Demonstration of the international leadership of the Korea Health Personnel Licensing Examination Institute, introduction of a clinical skills test to the Korean Dental Licensing Examination, and strengthening of ethics items on licensing examinations.
Journal of educational evaluation for health professions 20190604
Similar Datasets
Project description:PurposeThis study aimed to evaluate the level of professional ethics awareness and medical ethics competency in order to assess the potential need for ethics items to be included on the Korean Dental Hygienist Licensing Examination.MethodsIn total, 358 clinical dental hygienists and dental hygiene students completed a structured questionnaire to evaluate their level of ethical awareness and medical ethics competency. The sub-factors of medical ethics were classified into relationships with patients, medical and social relations, and individual specialized fields.ResultsOnly 32.1% of participants indicated that they had taken a course on professional ethics in the university curriculum, but 95.2% of respondents considered professional ethics to be important. The overall score for medical ethics competency was average (3.37 out of 5). The score for relationships with patients was 3.75 points, followed by medical and social relations (3.19 points) and individual specialized fields (3.16 points). The level of professional ethics awareness was higher among participants who had taken a course on professional ethics than among those who had not done so or who did not remember whether they had done so.ConclusionDental hygienists were aware of the importance of professional ethics, but their medical ethics competency was moderate. Therefore, medical ethics should be treated as a required subject in the university curriculum, and medical ethics competency evaluations should be strengthened by adding ethics items to the Korean Dental Hygienist Licensing Examination.
| S-EPMC7758182 | biostudies-literature
Project description:Before and after the 2016 US Presidential Election, this research examined Trump and Clinton supporters' attributions about behavior of each leader, both of whose ethicality had been publicly questioned. American voters (N = 268) attributed significantly more dispositional factors to the outgroup leader than to the ingroup leader. Moreover, when the ingroup candidate won the election (i.e., among Trump supporters), unethical leadership subsequently became more acceptable and there was less desire to tighten the election process when dealing with unethical candidates. The opposite pattern was found among voters whose ingroup candidate lost the election (Clinton supporters). The results and implications are discussed.
| S-EPMC6987078 | biostudies-literature
Project description:PurposeThe purpose of this study was to improve the quality of items on the Korean Nursing Licensing Examination by developing and evaluating case-based items that reflect integrated nursing knowledge.MethodsWe conducted a cross-sectional observational study to develop new case-based items. The methods for developing test items included expert workshops, brainstorming, and verification of content validity. After a mock examination of undergraduate nursing students using the newly developed case-based items, we evaluated the appropriateness of the items through classical test theory and item response theory.ResultsA total of 50 case-based items were developed for the mock examination, and content validity was evaluated. The question items integrated 34 discrete elements of integrated nursing knowledge. The mock examination was taken by 741 baccalaureate students in their fourth year of study at 13 universities. Their average score on the mock examination was 57.4, and the examination showed a reliability of 0.40. According to classical test theory, the average level of item difficulty of the items was 57.4% (80%-100% for 12 items; 60%-80% for 13 items; and less than 60% for 25 items). The mean discrimination index was 0.19, and was above 0.30 for 11 items and 0.20 to 0.29 for 15 items. According to item response theory, the item discrimination parameter (in the logistic model) was none for 10 items (0.00), very low for 20 items (0.01 to 0.34), low for 12 items (0.35 to 0.64), moderate for 6 items (0.65 to 1.34), high for 1 item (1.35 to 1.69), and very high for 1 item (above 1.70). The item difficulty was very easy for 24 items (below -2.0), easy for 8 items (-2.0 to -0.5), medium for 6 items (-0.5 to 0.5), hard for 3 items (0.5 to 2.0), and very hard for 9 items (2.0 or above). The goodness-of-fit test in terms of the 2-parameter item response model between the range of 2.0 to 0.5 revealed that 12 items had an ideal correct answer rate.ConclusionWe surmised that the low reliability of the mock examination was influenced by the timing of the test for the examinees and the inappropriate difficulty of the items. Our study suggested a methodology for the development of future case-based items for the Korean Nursing Licensing Examination.
| S-EPMC5729210 | biostudies-literature
Project description:PurposeThe goal of this study was to characterize the difficulty index of the items in the skills test components of the class I and II Korean emergency medical technician licensing examination (KEMTLE), which requires examinees to select items randomly.MethodsThe results of 1,309 class I KEMTLE examinations and 1,801 class II KEMTLE examinations in 2013 were subjected to analysis. Items from the basic and advanced skills test sections of the KEMTLE were compared to determine whether some were significantly more difficult than others.ResultsIn the class I KEMTLE, all 4 of the items on the basic skills test showed significant variation in difficulty index (P<0.01), as well as 4 of the 5 items on the advanced skills test (P<0.05). In the class II KEMTLE, 4 of the 5 items on the basic skills test showed significantly different difficulty index (P<0.01), as well as all 3 of the advanced skills test items (P<0.01).ConclusionIn the skills test components of the class I and II KEMTLE, the procedure in which examinees randomly select questions should be revised to require examinees to respond to a set of fixed items in order to improve the reliability of the national licensing examination.
| S-EPMC4751291 | biostudies-literature
Project description:PurposeTo determine the agreement among the items of the Korean physical therapist licensing examination, learning objectives of class subjects, and physical therapists' job descriptions.MethodsThe main tasks of physical therapists were classified, and university courses related to the main tasks were also classified. Frequency analysis was used to determine the proportions of credits for the classified courses out of the total credits of major subjects, exam items related to the classified courses out of the total number of exam items, and universities that offer courses related to the Korean physical therapist licensing examination among the surveyed universities.ResultsThe proportions of credits for clinical decision making and physical therapy diagnosis-related courses out of the total number credits for major subjects at universities were relatively low (2.06% and 2.58%, respectively). Although the main tasks of physical therapists are related to diagnosis and evaluation, the proportion of physiotherapy intervention-related items (35%) was higher than that of examination and evaluation-related items (25%) on the Korean physical therapist licensing examination. The percentages of universities that offer physical therapy diagnosis and clinical decision making-related courses were 58.62% and 68.97%, respectively.ConclusionBoth the proportion of physiotherapy diagnosis and evaluation-related items on the Korean physical therapist licensing examination, and the number of subjects related to clinical decision making and physical therapy diagnosis in the physical therapy curriculum, should be increased to ensure that the examination items and physical therapy curriculum reflect the practical tasks of physical therapists.
| S-EPMC4751292 | biostudies-literature
Project description:Introduction and aimsThis study systematically reviews and conducts a meta-analysis to evaluate the performance of various large language models (LLMs) in dental licensing examinations worldwide. The aim is to assess the accuracy of these models in different linguistic and geographical contexts. This will inform their potential application in dental education and diagnostics.MethodsFollowing Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, we conducted a comprehensive search across PubMed, Web of Science, and Scopus for studies published from 1 January 2022 to 1 May 2024. Two authors independently reviewed the literature based on the inclusion and exclusion criteria, extracted data, and evaluated the quality of the studies in accordance with the Quality Assessment of Diagnostic Accuracy Studies-2. We conducted qualitative and quantitative analyses to evaluate the performance of LLMs.ResultsEleven studies met the inclusion criteria, encompassing dental licensing examinations from eight countries. GPT-3.5, GPT-4, and Bard achieved integrated accuracy rates of 54%, 72%, and 56%, respectively. GPT-4 outperformed GPT-3.5 and Bard, passing more than half of the dental licensing examinations. Subgroup analyses and meta-regression showed that GPT-3.5 performed significantly better in English-speaking countries. GPT-4's performance, however, remained consistent across different regions.ConclusionLLMs, particularly GPT-4, show potential in dental education and diagnostics, yet their accuracy remains below the threshold required for clinical application. The lack of sufficient training data in dentistry has affected LLMs' accuracy. The reliance on image-based diagnostics also presents challenges. As a result, their accuracy in dental exams is lower compared to medical licensing exams. Additionally, LLMs even provide more detailed explanation for incorrect answer than correct one. Overall, the current LLMs are not yet suitable for use in dental education and clinical diagnosis.
| S-EPMC11806300 | biostudies-literature
Project description:Computerized adaptive testing (CAT) has been implemented in high-stakes examinations such as the National Council Licensure Examination-Registered Nurses in the United States since 1994. Subsequently, the National Registry of Emergency Medical Technicians in the United States adopted CAT for certifying emergency medical technicians in 2007. This was done with the goal of introducing the implementation of CAT for medical health licensing examinations. Most implementations of CAT are based on item response theory, which hypothesizes that both the examinee and items have their own characteristics that do not change. There are 5 steps for implementing CAT: first, determining whether the CAT approach is feasible for a given testing program; second, establishing an item bank; third, pretesting, calibrating, and linking item parameters via statistical analysis; fourth, determining the specification for the final CAT related to the 5 components of the CAT algorithm; and finally, deploying the final CAT after specifying all the necessary components. The 5 components of the CAT algorithm are as follows: item bank, starting item, item selection rule, scoring procedure, and termination criterion. CAT management includes content balancing, item analysis, item scoring, standard setting, practice analysis, and item bank updates. Remaining issues include the cost of constructing CAT platforms and deploying the computer technology required to build an item bank. In conclusion, in order to ensure more accurate estimations of examinees' ability, CAT may be a good option for national licensing examinations. Measurement theory can support its implementation for high-stakes examinations.
| S-EPMC5676016 | biostudies-literature
Project description:As nation-state leaders age they increasingly engage in inter-state militarized disputes yet in industrialized societies a steady decrease in testosterone associated with aging is observed--which suggests a decrease in dominance behavior. The current paper points out that from modern societies to Old World monkeys increasing both in age and social status encourages dominant strategies to maintain acquired rank. Moreover, it is argued this consistency has shaped an implicit prototype causing followers to associate older age with dominance leadership. It is shown that (i) faces of older leaders are preferred during intergroup conflict and (ii) morphing U.S. Presidential candidates to appear older or younger has an overriding effect on actual election outcomes. This indicates that democratic voting can be systematically adjusted by activating innate biases. These findings appear to create a new line of research regarding the biology of leadership and contextual cues of age.
| S-EPMC3359335 | biostudies-literature
Project description:Low priority of disease prevention and health promotion in medical education may contribute to lack of lifestyle-counseling in clinical practice. Pharmacology-related knowledge is valued 5 times higher compared to lifestyle-related knowledge in examinations on noncommunicable diseases (NCDs) in undergraduate medical education in Sweden. This study aims to establish (i) whether medical licensing examinations are biased to favor pharmacology- over lifestyle-related knowledge and (ii) whether such a bias is present in both Sweden and the US. We identified 204 NCD-related questions from previous Swedish licensing examinations, and 77 cases from a U.S. question bank commonly used to prepare for the United States Medical Licensing Examination® (USMLE®) Step 3. With the help of expected correct answers, we determined distribution of points attainable for knowledge in the respective category (lifestyle / pharmacology / other) for 5 major NCDs: coronary heart disease (CHD), chronic obstructive pulmonary disease (COPD), diabetes, hypertension, and stroke. The percentage of points attainable for lifestyle-related knowledge was 6.7 (95% CI 4.1-9.3) in Sweden and 4.6 (95%CI 0.0-9.1) in the U.S. The respective percentages for pharmacology-related knowledge were 32.6 (95% CI 26.3-38.8) and 44.5 (95% CI 33.2-55.8) percent. The pharmacology vs. lifestyle-quotas were 4.9 in Sweden and 9.8 in the U.S. Likelihoods of equal emphasis on lifestyle and pharmacology in NCDs was < 0.001 in both countries. There is a marked preference for pharmacology over lifestyle in medical licensing examinations in both Sweden and the U.S. Newly qualified doctors may be inadequately prepared to address preventable causes of NCDs.
| S-EPMC8227799 | biostudies-literature
Project description:BackgroundNational licensing examinations (NLEs) are large-scale examinations usually taken by medical doctors close to the point of graduation from medical school. Where NLEs are used, success is usually required to obtain a license for full practice. Approaches to national licensing, and the evidence that supports their use, varies significantly across the globe. This paper aims to develop a typology of NLEs, based on candidacy, to explore the implications of different examination types for workforce planning.MethodsA systematic review of the published literature and medical licensing body websites, an electronic survey of all medical licensing bodies in highly developed nations, and a survey of medical regulators.ResultsThe evidence gleaned through this systematic review highlights four approaches to NLEs: where graduating medical students wishing to practice in their national jurisdiction must pass a national licensing exam before they are granted a license to practice; where all prospective doctors, whether from the national jurisdiction or international medical graduates, are required to pass a national licensing exam in order to practice within that jurisdiction; where international medical graduates are required to pass a licensing exam if their qualifications are not acknowledged to be comparable with those students from the national jurisdiction; and where there are no NLEs in operation. This typology facilitates comparison across systems and highlights the implications of different licensing systems for workforce planning.ConclusionThe issue of national licensing cannot be viewed in isolation from workforce planning; future research on the efficacy of national licensing systems to drive up standards should be integrated with research on the implications of such systems for the mobility of doctors to cross borders.
| S-EPMC6186476 | biostudies-literature