Dataset Information

Experiences from Two Ways of Integrating Pre- and Post-course Multiple-choice Assessment Questions in Educational Events for Surgeons.

ABSTRACT: To examine how to optimise the integration of multiple-choice questions (MCQs) for learning in continuing professional development (CPD) events in surgery, we implemented and evaluated two methods in two subspecialities over multiple years. The same 12 MCQs were administered pre- and post-event in 66 facial trauma courses. Two different sets of 10 MCQs were administered pre- and post-event in 21 small animal fracture courses. We performed standard psychometric tests on responses from participants who completed both the pre- and post-event assessment. The average difficulty index pre-course was 57% with a discrimination index of 0.20 for small animal fractures and 53% with a discrimination index of 0.15 for facial trauma. For the majority of the individual MCQs, the scores were between 30%-70% and the discrimination index was >0.10. The difficulty index post-course increased in both groups (to 75% and 62%). The pre-course MCQs resulted in an average score in the expected range for both formats suggesting they were appropriate for the intended level of difficulty and an appropriate pre-course learning activity. Post-course completion resulted in increased scores with both formats. Both delivery methods worked well in all regions and overall quality depends on applying a solid item development and validation process.

SUBMITTER: Ghidinelli M

PROVIDER: S-EPMC8128219 | biostudies-literature | 2021 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Experiences from Two Ways of Integrating Pre- and Post-course Multiple-choice Assessment Questions in Educational Events for Surgeons.

Ghidinelli Monica M Cunningham Michael M Monotti Isobel C IC Hindocha Nishma N Rickli Alain A McVicar Iain I Glyde Mark M

Journal of European CME 20210513 1

To examine how to optimise the integration of multiple-choice questions (MCQs) for learning in continuing professional development (CPD) events in surgery, we implemented and evaluated two methods in two subspecialities over multiple years. The same 12 MCQs were administered pre- and post-event in 66 facial trauma courses. Two different sets of 10 MCQs were administered pre- and post-event in 21 small animal fracture courses. We performed standard psychometric tests on responses from participant ...[more]

PMID: 34026323

Similar Datasets

Project description:BackgroundIn Australia, the profession of pharmacy has undergone many changes to adapt to the needs of the community. In recent years, concerns have been raised with evidence emerging of workforce saturation in traditional pharmacy practice sectors. It is not known how current final year pharmacy students' perceive the different pharmacy career paths in this changing environment. Hence investigating students' current experiences with their pharmacy course, interaction with the profession and developing an understanding of their career intentions would be an important step, as these students would make up a large proportion of future pharmacy workforce.ObjectiveThe objective of this study was thus to investigate final year students' career perspectives and the reasons for choosing pharmacy, satisfaction with this choice of pharmacy as a tertiary course and a possible future career, factors affecting satisfaction and intention of future career paths.MethodsA quantitative cross sectional survey of final year students from 3 Australian universities followed by a qualitative semi-structured interview of a convenience sample of final year students from the University of Sydney.Results'Interest in health and medicine' was the most important reason for choosing pharmacy (n=238). The majority of students were 'somewhat satisfied' with the choice of pharmacy (35.7%) as a course and possible future career. Positive associations were found between satisfaction and reasons for joining pharmacy such as 'felt pharmacy is a good profession' (p=0.003) while negative associations included 'joined pharmacy as a gateway to medicine or dentistry' (p=0.001). Quantitate and qualitative results showed the most frequent perception of community pharmacy was 'changing' while hospital and pharmaceutical industry was described as 'competitive' and 'research' respectively. The highest career intention was community followed by hospital pharmacy.ConclusionComplex factors including university experiences are involved in shaping students' satisfaction and perception of career. This may relate to challenges in the community pharmacy sector, job opportunities in hospital and limited understanding of the pharmaceutical industry. The results offer insight for the profession in terms of entry into various roles and also to pharmacy educators for their roles in shaping curricula and placement experiences that attract future graduates to defined career pathways in pharmacy.

Project description:The homeostasis between mature neurotrophin NGF and its precursor proNGF is thought to be crucial in physiology and in pathological states. Therefore, the measurement of the relative amounts of NGF and proNGF could serve as a footprint for the identification of disease states, for diagnostic purposes. Since NGF is part of proNGF, their selective identification with anti-NGF antibodies is not straightforward. Currently, many immunoassays for NGF measurement are available, while the proNGF assays are few and not validated by published information. The question arises, as to whether the commercially available assays are able to distinguish between the two forms. Also, since in biological samples the two forms coexist, are the measurements of one species affected by the presence of the other? We describe experiments addressing these questions. For the first time, NGF and proNGF were measured together and tested in different immunoassays. Unexpectedly, NGF and proNGF were found to reciprocally interfere with the experimental outcome. The interference also calls into question the widely used NGF ELISA methods, applied to biological samples where NGF and proNGF coexist. Therefore, an immunoassay, able to distinguish between the two forms is needed. We propose possible ways forward, toward the development of a selective assay. In particular, the use of the well validated anti-NGF αD11 antibody in an alphaLISA assay with optimized incubation times would be a solution to avoid the interference in the measurement of a mixed sample containing NGF and proNGF. Furthermore, we explored the possibility of measuring proNGF in a biological sample. But the available commercial kit for the detection of proNGF does not allow the measurement of proNGF in mouse brain tissues. Therefore, we validated an SPR approach for the measurement of proNGF in a biological sample. Our experiments help in understanding the technical limits in the measurement of the NGF/proNGF ratio in biological samples, and propose concrete solutions toward the solution of this problem.

Project description:ImportanceGender differences in interprofessional conflict may exist and precipitate differential achievement, wellness, and attrition in medicine.ObjectiveAlthough substantial attention and research has been directed toward improving gender equity in surgery and addressing overall physician wellness, research on the role of interprofessional conflict has been limited. The objective of this study was to understand scenarios driving interprofessional conflict involving women surgeons, the implications of the conflict on personal, professional, and patient outcomes, and how women surgeons navigate conflict adjudication.Design, setting, and participantsA qualitative approach was used to explore the nature, implications, and ways of navigating interprofessional workplace conflict experienced by women surgeons. The setting was a national sample of US women surgeons. Purposive and snowball sampling were used to recruit women surgeons in training or practice from annual surgical society meetings. Participants were eligible if they were currently in a surgical training program or surgical practice. Nearly all participants had experienced at least 1 workplace conflict with a nonphysician staff member resulting in a formal write-up.ExposuresA workplace conflict was defined as any conflict resulting in the nonphysician staff member taking action such as confronting the woman surgeon, reporting the event to supervisors, or filing a formal report.Main outcomes and measuresInterviews were conducted between February 19, 2019, and June 21, 2019. Recordings were transcribed and deidentified. Inductive thematic analysis was used to examine data in relation to the research questions.ResultsThirty US women surgeons (8 [27%] age 25-34 years, 16 [53%] age 35-44 years, 5 [17%] age 45-54 years, and 1 [3%] age 55-64 years) of varying surgical specialties were interviewed. Conflicts were often reported as due to a breakdown in communication or from performance-related disputes. Participants perceived personal and professional implications including self-doubt, depression, frustration, anxiety, loss of sleep, reputational harms, and delays to advancement. Participants also described potential patient safety implications primarily due to decreased communication resulting from some surgeons being hesitant to engage in subsequent interactions. Participants described a variety of navigation strategies including relationship management, rapport building, and social capital. The success of these processes tended to vary by individual circumstances, including the details of the conflict, practice setting, level of support of leadership, and individual personality of the surgeon.Conclusions and relevanceThis qualitative study highlights women surgeons' experiences with interprofessional workplace conflict. Interprofessional culture building, broader dissemination of implicit bias training, and transparent and equitable adjudication systems are potential strategies for avoiding or mitigating the implications of these conflicts.

Project description:Understanding immune reactivity against SARS-CoV-2 is essential for coping with the COVID-19 pandemic. Herein, we discuss experiences and open questions about the complex immune responses to SARS-CoV-2. Some people react excellently without experiencing any clinical symptoms, they do not get sick, and they do not pass the virus on to anyone else ("sterilizing" immunity). Others produce antibodies and do not get COVID-19 but transmit the virus to others ("protective" immunity). Some people get sick but recover. A varying percentage develops respiratory failure, systemic symptoms, clotting disorders, cytokine storms, or multi-organ failure; they subsequently decease. Some develop long COVID, a new pathologic entity similar to fatigue syndrome or autoimmunity. In reality, COVID-19 is considered more of a systemic immune-vascular disease than a pulmonic disease, involving many tissues and the central nervous system. To fully comprehend the complex clinical manifestations, a profound understanding of the immune responses to SARS-CoV-2 is a good way to improve clinical management of COVID-19. Although neutralizing antibodies are an established approach to recognize an immune status, cellular immunity plays at least an equivalent or an even more important role. However, reliable methods to estimate the SARS-CoV-2-specific T cell capacity are not available for clinical routines. This deficit is important because an unknown percentage of people may exist with good memory T cell responsibility but a low number of or completely lacking peripheral antibodies against SARS-CoV-2. Apart from natural immune responses, vaccination against SARS-CoV-2 turned out to be very effective and much safer than naturally acquired immunity. Nevertheless, besides unwanted side effects of the currently available vector and mRNA preparations, concerns remain whether these vaccines will be strong enough to defeat the pandemic. Altogether, herein we discuss important questions, and try to give answers based on the current knowledge and preliminary data from our laboratories.

Project description:BackgroundChatGPT (OpenAI), a state-of-the-art large language model, has exhibited remarkable performance in various specialized applications. Despite the growing popularity and efficacy of artificial intelligence, there is a scarcity of studies that assess ChatGPT's competence in addressing multiple-choice questions (MCQs) using KIDMAP of Rasch analysis-a website tool used to evaluate ChatGPT's performance in MCQ answering.ObjectiveThis study aims to (1) showcase the utility of the website (Rasch analysis, specifically RaschOnline), and (2) determine the grade achieved by ChatGPT when compared to a normal sample.MethodsThe capability of ChatGPT was evaluated using 10 items from the English tests conducted for Taiwan college entrance examinations in 2023. Under a Rasch model, 300 simulated students with normal distributions were simulated to compete with ChatGPT's responses. RaschOnline was used to generate 5 visual presentations, including item difficulties, differential item functioning, item characteristic curve, Wright map, and KIDMAP, to address the research objectives.ResultsThe findings revealed the following: (1) the difficulty of the 10 items increased in a monotonous pattern from easier to harder, represented by logits (-2.43, -1.78, -1.48, -0.64, -0.1, 0.33, 0.59, 1.34, 1.7, and 2.47); (2) evidence of differential item functioning was observed between gender groups for item 5 (P=.04); (3) item 5 displayed a good fit to the Rasch model (P=.61); (4) all items demonstrated a satisfactory fit to the Rasch model, indicated by Infit mean square errors below the threshold of 1.5; (5) no significant difference was found in the measures obtained between gender groups (P=.83); (6) a significant difference was observed among ability grades (P<.001); and (7) ChatGPT's capability was graded as A, surpassing grades B to E.ConclusionsBy using RaschOnline, this study provides evidence that ChatGPT possesses the ability to achieve a grade A when compared to a normal sample. It exhibits excellent proficiency in answering MCQs from the English tests conducted in 2023 for the Taiwan college entrance examinations.

Dataset Information

Experiences from Two Ways of Integrating Pre- and Post-course Multiple-choice Assessment Questions in Educational Events for Surgeons.

Publications

Experiences from Two Ways of Integrating Pre- and Post-course Multiple-choice Assessment Questions in Educational Events for Surgeons.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets