Dataset Information

Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine.

ABSTRACT:

Objective

To develop and validate an instrument for measuring knowledge and skills in evidence based medicine and to investigate whether short courses in evidence based medicine lead to a meaningful increase in knowledge and skills.

Design

Development and validation of an assessment instrument and before and after study.

Setting

Various postgraduate short courses in evidence based medicine in Germany.

Participants

The instrument was validated with experts in evidence based medicine, postgraduate doctors, and medical students. The effect of courses was assessed by postgraduate doctors from medical and surgical backgrounds.

Intervention

Intensive 3 day courses in evidence based medicine delivered through tutor facilitated small groups.

Main outcome measure

Increase in knowledge and skills.

Results

The questionnaire distinguished reliably between groups with different expertise in evidence based medicine. Experts attained a threefold higher average score than students. Postgraduates who had not attended a course performed better than students but significantly worse than experts. Knowledge and skills in evidence based medicine increased after the course by 57% (mean score before course 6.3 (SD 2.9) v 9.9 (SD 2.8), P<0.001). No difference was found among experts or students in absence of an intervention.

Conclusions

The instrument reliably assessed knowledge and skills in evidence based medicine. An intensive 3 day course in evidence based medicine led to a significant increase in knowledge and skills.

SUBMITTER: Fritsche L

PROVIDER: S-EPMC137813 | biostudies-literature | 2002 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine.

Fritsche L L Greenhalgh T T Falck-Ytter Y Y Neumayer H-H HH Kunz R R

BMJ (Clinical research ed.) 20021201 7376

<h4>Objective</h4>To develop and validate an instrument for measuring knowledge and skills in evidence based medicine and to investigate whether short courses in evidence based medicine lead to a meaningful increase in knowledge and skills.<h4>Design</h4>Development and validation of an assessment instrument and before and after study.<h4>Setting</h4>Various postgraduate short courses in evidence based medicine in Germany.<h4>Participants</h4>The instrument was validated with experts in evidence ...[more]

PMID: 12468485

Similar Datasets

Project description:BackgroundEvidence-Based Medicine (EBM) integrates best available evidence from literature and patients' values, which then informs clinical decision making. However, there is a lack of validated instruments to assess the knowledge, practice and barriers of primary care physicians in the implementation of EBM. This study aimed to develop and validate an Evidence-Based Medicine Questionnaire (EBMQ) in Malaysia.MethodsThe EBMQ was developed based on a qualitative study, literature review and an expert panel. Face and content validity was verified by the expert panel and piloted among 10 participants. Primary care physicians with or without EBM training who could understand English were recruited from December 2015 to January 2016. The EBMQ was administered at baseline and two weeks later. A higher score indicates better knowledge, better practice of EBM and less barriers towards the implementation of EBM. We hypothesized that the EBMQ would have three domains: knowledge, practice and barriers.ResultsThe final version of the EBMQ consists of 80 items: 62 items were measured on a nominal scale, 22 items were measured on a 5 point Likert-scale. Flesch reading ease was 61.2. A total of 343 participants were approached; of whom 320 agreed to participate (response rate = 93.2%). Factor analysis revealed that the EBMQ had eight domains after 13 items were removed: "EBM websites", "evidence-based journals", "types of studies", "terms related to EBM", "practice", "access", "patient preferences" and "support". Cronbach alpha for the overall EBMQ was 0.909, whilst the Cronbach alpha for the individual domain ranged from 0.657-0.940. The EBMQ was able to discriminate between doctors with and without EBM training for 24 out of 42 items. At test-retest, kappa values ranged from 0.155 to 0.620.ConclusionsThe EBMQ was found to be a valid and reliable instrument to assess the knowledge, practice and barriers towards the implementation of EBM among primary care physicians in Malaysia.

Project description:BackgroundEvidence-based medicine (EBM) was introduced as a concept in the early 1990s as an integration of the best available evidence with clinical expertise and patient values.ObjectiveTo evaluate the current status of EBM training and EBM perception, attitudes, and self-perceived skills among European urology residents.Design setting and participantsOur online open survey comprised 28 multiple-choice items, including ten questions with responses on a five-point Likert scale ranging from 1 = strongly disagree to 5 = strongly agree. The survey was distributed via the mailing lists and social media accounts of the European Society of Residents in Urology, German Society of Residents in Urology, French Society of Urologists in Training, Spanish Urology Residents Working Group, Italian Society of Residents in Urology, and the Urology Social Media Working Group in two rounds (May-July 2019 and July 2020). We excluded responses from non-European countries.Outcome measurements and statistical analysisThe online open survey comprised 28 multiple-choice items. These included ten questions with answers on a five-point Likert scale with response items ranging from strongly disagree (score of 1) to strongly agree (score of 5).Results and limitationsWe received 210 responses, of which 181 from 23 European countries were eligible. Approximately three-quarters (73.7%) of the respondents were male, with a mean age of 31 yr. Only 28.2% reported EBM training as part of their urology curriculum and 19.3% felt that the training they received was sufficient to guide their daily practice. An overwhelming majority (91.5%) stated that they would be interested in more formalized EBM training or additional training. There was a strong level of agreement (median score 5, interquartile range 4-5) that EBM is important for daily medical and surgical practice and that it improves patient care. Overall, the mean self-perceived understanding of basic EBM concepts was good. Limitations include concerns about generalizability given its internet-based format, the inability to calculate a response rate, poor representation from some European regions, and limited sample size.ConclusionsOur survey suggests that European urology residents receive a limited amount of EBM training despite considerable appreciation, interest, and self-perceived deficits for more advanced concepts. Formal integration of EBM teaching in all European residency programs should be considered.Patient summaryWe performed an online survey of urology residents in Europe. We found that residents have positive perceptions of and attitudes to evidence-based medicine but most programs lack formal training in this area.

Project description:In order to map attitudes, knowledge and skills related to evidence-based medicine (EBM) in students of medical and health sciences faculties, we performed an online survey during the spring semester 2019 in all medical and health sciences faculties in Hungary. In total, 1080 students of medicine and 911 students of health sciences completed the online questionnaire. The attitude towards EBM was generally positive; however, only a small minority of students rated their EBM-related skills as advanced. There were large differences in the understanding of different EBM-related terms, with 'sample size' as the term with the highest (65%) and 'intention-to-treat analysis' with the lowest (7%) proportion of medical students being able to properly explain the meaning of the expression. Medical students who already participated in some EBM training rated their skills in searching and evaluating medical literature and their knowledge of EBM-related terms significantly better and had a more positive attitude towards using EBM in the practice than students without previous EBM training. EBM trained medical students were more likely to choose online journals (17.5% compared to 23.9%, p<0.05) and professional guidelines (15.4% compared to 6.1%, p<0.001) instead of printed books (33.6% compared to 52.6, p<0.001) as the main source of healthcare information retrieval and used Pubmed/Medline, Medscape and the Cochrane Library to a significant higher rate than students without any previous EBM training. Healthcare work experience (OR = 1.59; 95% CI = 1.01-2.52), conducting student research (OR = 2.02; 95% CI = 1.45-2.82) and upper year university students (OR = 1.65; 95% CI = 1.37-1.98) were other factors significantly influencing EBM-related knowledge. We conclude that the majority of students of medical and health sciences faculties are keen to acquire EBM-related knowledge and skills during their university studies. Significantly higher EBM-related knowledge and skills among EBM trained students underline the importance of targeted EBM education, while parallel increase of knowledge and skills with increasing number of education years highlight the importance of integrating EBM terminology and concepts also into the thematic of other courses.

Project description:BackgroundValid and reliable instruments are required to measure the effect of educational interventions to improve evidence-based practice (EBP) knowledge and skills in occupational therapy. The aims of this paper are to: 1) describe amendments to the Adapted Fresno Test of Competence in EBP (AFT), and 2) report the psychometric properties of the modified instrument when used with South African occupational therapists.MethodsThe clinical utility of the AFT was evaluated for use with South African occupational therapists and modifications made. The modified AFT was used in two studies to assess its reliability and validity. In Study 1 a convenience sample of 26 occupational therapists in private practice or government-funded health facilities in a South African province were recruited to complete the modified AFT on two occasions 1 week apart. Completed questionnaires were scored independently by two raters. Inter-rater, test-retest reliability and internal consistency were determined. Study 2 was a pragmatic randomised controlled trial involving occupational therapists in four Western Cape Department of Health district municipalities (n = 58). Therapists were randomised in matched pairs to one of two educational interventions (interactive or didactic), and completed the modified AFT at baseline and 12 weeks after the intervention. An intention-to-treat analysis was performed. Data were not normally distributed, thus non-parametric statistics were used.ResultsIn Study 1, 21 of 26 participants completed the questionnaire twice. Test-retest (ICC = 0.95, 95 % CI = 0.88-0.98) and inter-rater reliability (Time 1: ICC = 0.995, 95 % CI = 0.99-0.998; Time 2: ICC = 0.99, 95 % CI = 0.97-0.995) were excellent for total scores. Internal consistency based on time 1 scores was satisfactory (α = 0.70). In Study 2, 28 participants received an interactive educational intervention and completed the modified AFT at baseline and 12 weeks later. Median total SAFT scores increased significantly from baseline to 12-weeks (Z = -4.078, p < 0.001) with a moderate effect size (r = 0.55).ConclusionThe modified AFT has demonstrated validity for detecting differences in EBP knowledge between two groups. It also has excellent test-retest and inter-rater reliability. The instrument is recommended for contexts where EBP is an emerging approach and time is at a premium.Trial registrationPan African Controlled Trials Register PACTR201201000346141 . Registered 31 January 2012. Clinical Trials NCT01512823 . Registered 1 February 2012. South African National Clinical Trial Register DOH2710093067 . Registered 27 October 2009.

Dataset Information

Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine.

Objective

Design

Setting

Participants

Intervention

Main outcome measure

Results

Conclusions

Publications

Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets