Dataset Information

Cognitive levels in testing knowledge in evidence-based medicine: a cross sectional study.

ABSTRACT:

Background

Knowledge assessment in evidence-based medicine (EBM) is usually performed by the measurement of memorised facts, understanding of EBM concepts and application of learned knowledge in familiar situations, all of which are considered lower-level educational objectives. The aim of this study was to assess EBM knowledge both on higher and lower cognitive levels across EBM topics.

Methods

In order to assess knowledge on different EBM topics across learning levels, we created a knowledge test (Six Progressive Levels in Testing - SPLIT instrument), which consists of 36 multiple choice items and measures knowledge in EBM at six cognitive levels (Remembering, Understanding, Applying, Analysing, Evaluating and Creating) and addresses six EBM topics (Evidence-based practice, Internal validity, Clinical importance, Study design, Sources of evidence, Diagnostic studies). Three independent assessors defined the minimum passing score (MPS) for the overall test, based on the first-year course content and educational objectives. The instrument was assessed in a sample of first- (n?=?119) and third-year medical students (n?=?70) and EBM experts (n?=?14).

Results

The MPS was 16 correct answers out of total 36 questions, and was achieved by 21 out of 119 first-year students, 14 out of 70 third-year students and 9 out of 14 EBM experts (?²?=?13.3; P?ConclusionEBM knowledge of students and experts differ according to the specificities of their education/expertise, but neither group had excellent knowledge in all areas. It may be difficult to develop a knowledge test that includes different EBM topics at different cognitive levels to follow the development of specific and general aspects of EBM knowledge.

SUBMITTER: Buljan I

PROVIDER: S-EPMC7791849 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Evidence-based medicine (EBM) aims to assist physicians in making medical decisions based on the integration of the current best evidence, clinical expertise, and patients' values. Extensive research has been conducted regarding physicians' awareness, attitudes, barriers, and knowledge about EBM. In Croatia, there is a lack of research on this topic, especially among family physicians (FP). The aim of this study was to assess the awareness, attitudes, barriers, and knowledge about EBM among FPs in Croatia after six years of educational activities organized and provided by Cochrane Croatia. METHODS:In a cross-sectional study, conducted in 2016, we offered to FPs in Croatia a printed or online validated questionnaire to assess attitudes toward and barriers when considering the use of EBM, awareness about sources of evidence, and their level of understanding of evidence-based medicine terminology. The physicians were approached during mandatory continuing medical education courses and through their professional associations. We compared results from two groups of physicians, one with family medicine specialization and the other without. RESULTS:295 (14%) of all officially registered FPs responded to the questionnaire. Respondents were very positive toward the promotion and usage of EBM. 160 (67%) indicated that they did not have access to the Cochrane Library. The majority reported lack of time available for finding evidence (80%), and patients' unrealistic expectations that influence doctors' choice of treatment (72%). Between the two groups of physicians, more family medicine specialists reported time restrictions for finding evidence. The highest level of EBM terminology understanding was reported for study design terms, and the lowest for statistical terms. CONCLUSIONS:This study demonstrated that FPs in Croatia had very positive attitudes toward the use of EBM, they agreed that EBM improves patient care, and they estimated that more than two thirds of their practice is EBM-based. Compared to the results of the first assessment of physicians in 2010, there was some increase in the level of EBM awareness among FPs. However, to further increase the quality of EBM practice in Croatia better access to EBM sources and further educational activities are needed.

Project description:Introduction:Evidence-based healthcare is a core competency for practicing healthcare practitioners and those in speciality training. In sub-Saharan Africa, little is known about the teaching of evidence-based medicine (EBM) in residency program. This survey evaluated the experiences and knowledge of Cochrane, EBM and associated factors among Ethiopian specialists in training. Methods:A convenient sample of trainee specialists completed a pretested self-administered survey. The majority (93%) were ≤30 years old, males (63%) and 41% in paediatrics speciality. The associations of categorical variables with EBM knowledge was assessed by Fisher's exact or Chi-Square tests. Covariates contributing to EBM knowledge were identified using multivariate logistic regression analysis. Results:Eighty-three trainees participated in the survey (response rate 88.2%). About 75% have heard about Cochrane but no one recognized Cochrane South Africa. Only 25% of the trainees knew the Cochrane Library but none used it in clinical practice. Most (78%) have heard of EBM, 15% had attended EBM course, 96% wanted to attend EBM course and 81% had positive attitudes to EBM. Trainees EBM knowledge was associated with awareness of Cochrane [Adjusted odds ratio (AOR) = 8.5, 95% Confidence interval (CI) 1.3-54.6, P = 0.02], EBM (AOR = 51.2, 95% CI 2.7-960.8, P = 0.009), and being in third year training (AOR = 28.4, 95% CI 1.9-427.2, P = 0.02). The promotion of EBM in residency hospital (AOR = 22.2, 95% CI 2.2-223.8, P = 0.008) and being aware of Cochrane (AOR = 4.8, 95% CI 1.1-21.7, P = 0.04) were predictors of positive attitude. Familiarity with Cochrane Library was influenced by EBM knowledge (AOR = 6.6, 95% CI 1.4-31.5, P = 0.02) and perceived organization barrier to accessing the resource (AOR = 3.2, 95% CI 1.03-10.1, P = 0.04). Conclusion:Ethiopian trainee specialists lacked formal EBM training, awareness and use of the Cochrane Library. To improve the healthcare quality and patient outcomes, EBM education should be integrated into residency curricula.

Project description:BACKGROUND:In Brazil, as in most countries nowadays, there is a pursuit for healthcare quality improvement and sustainability in public and private systems. Healthcare professionals' perceptions, knowledge and attitudes determine evidence-based practice (EBP), which remain uncertain among Brazilian practitioners. A standardised national instrument whose wide use will identify gaps and flaws in establishing an EBP could contribute to an effective resources allocation from health professionals willing to use an EBP. OBJECTIVES:To present a study protocol on the development and validation of an instrument to measure Brazilian healthcare professionals' behaviour, skills, self-efficacy, knowledge and attitudes towards EBP. METHODS:This is a validation study with Brazilian healthcare professionals to develop a valid and reliable questionnaire, including selection of domains and formulation of questions. Construct and content validity will be assess by a panel of experts, with data collection and analysis following a Delphi-like methodology. Further, a pilot survey will be accomplished with a representative sample of different healthcare professionals from all main Brazilian regions. An exploratory factor analysis and a confirmatory factor analysis will be conducted afterwards. The ratio of ?2 and df (?2/df), comparative fit index, goodness of fit index and root mean square error of approximation will be used for assessing the model fit. In addition, the reliability of the instrument will be estimated by test-retest reproducibility and Cronbach's alpha coefficient (?). ETHICS AND DISSEMINATION:This study has received ethical approval from the Pharmaceutical Sciences Faculty of the São Paulo State University (1.425.808). The use among a wide national sample is expected to promote an extensive view of evidence-based decision-making, identifying the knowledge gaps in this area. Study findings will be circulated to healthcare professionals and scientists in the field through the publication in peer-reviewed journals and conference presentations.