Dataset Information

Development and validation of the ACE tool: assessing medical trainees' competency in evidence based medicine.

ABSTRACT:

Background

While a variety of instruments have been developed to assess knowledge and skills in evidence based medicine (EBM), few assess all aspects of EBM - including knowledge, skills attitudes and behaviour - or have been psychometrically evaluated. The aim of this study was to develop and validate an instrument that evaluates medical trainees' competency in EBM across knowledge, skills and attitude.

Methods

The 'Assessing Competency in EBM' (ACE) tool was developed by the authors, with content and face validity assessed by expert opinion. A cross-sectional sample of 342 medical trainees representing 'novice', 'intermediate' and 'advanced' EBM trainees were recruited to complete the ACE tool. Construct validity, item difficulty, internal reliability and item discrimination were analysed.

Results

We recruited 98 EBM-novice, 108 EBM-intermediate and 136 EBM-advanced participants. A statistically significant difference in the total ACE score was observed and corresponded to the level of training: on a 0-15-point test, the mean ACE scores were 8.6 for EBM-novice; 9.5 for EBM-intermediate; and 10.4 for EBM-advanced (p?ConclusionThe 15-item ACE tool is a reliable and valid instrument to assess medical trainees' competency in EBM. The ACE tool provides a novel assessment that measures user performance across the four main steps of EBM. To provide a complete suite of instruments to assess EBM competency across various patient scenarios, future refinement of the ACE instrument should include further scenarios across harm, diagnosis and prognosis.

SUBMITTER: Ilic D

PROVIDER: S-EPMC4062508 | biostudies-literature | 2014 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of the ACE tool: assessing medical trainees' competency in evidence based medicine.

Ilic Dragan D Nordin Rusli Bin RB Glasziou Paul P Tilson Julie K JK Villanueva Elmer E

BMC medical education 20140609

<h4>Background</h4>While a variety of instruments have been developed to assess knowledge and skills in evidence based medicine (EBM), few assess all aspects of EBM - including knowledge, skills attitudes and behaviour - or have been psychometrically evaluated. The aim of this study was to develop and validate an instrument that evaluates medical trainees' competency in EBM across knowledge, skills and attitude.<h4>Methods</h4>The 'Assessing Competency in EBM' (ACE) tool was developed by the aut ...[more]

PMID: 24909434

Similar Datasets

Project description:BackgroundHuman papillomavirus (HPV) infection is the most common sexually transmitted infection in the United States. High-risk HPV strains are associated with cancer of the cervix, oropharynx, anus, rectum, penis, vagina, and vulva. To combat increasing HPV-related cancers, the 9-valent HPV vaccine Gardasil was developed. Recommendation of the HPV vaccine by a health care provider has been cited as the number one factor affecting vaccine uptake among adolescents and young adults. Physician assistants, nurse practitioners, and pharmacists have been enlisted to bridge the gap.ObjectiveThe specific aim of this research study was to develop a reliable and valid HPV vaccine communication scale that can be used to measure the competency of primary care providers when recommending the need for vaccination to parents and patients.MethodsUsing a descriptive study, we collected data via a literature review, focus groups, and an expert panel to inform the scale domains and blueprint design. Pretesting (cognitive interviews) was used to inform item revision decisions. An item analysis was also conducted for the responses provided in the cognitive interviews. Item statistics (means and SDs), interitem correlations, and reliability were examined. Data were analyzed using SPSS (IBM Corp) software.ResultsA valid and reliable 42-item HPV vaccine communication competency scale was developed. The scale included 6 domains of interest. Scale items were moderately to strongly correlated with one another, and Cronbach α indicated good internal consistency with each scale. Scale items included were related to provider introduction or rapport (α=.796), patient respect or empathy (α=.737), provider interview or intake (α=.9), patient counseling or education (α=.935), provider communication closure (α=.896), and provider knowledge (α=.824).ConclusionsPharmacists, nurse practitioners, and physician assistants should be trained to be competent in HPV vaccine communication and recommendation due to their expanded roles. Interdisciplinary collaboration is important to account for the trainee's individual differences and ensure the best health care outcomes for patients. A standardized HPV communication scale can be used to ensure effective and consistent recommendation by health care providers, thus affecting immunization rates.

Project description:IntroductionIn a competency-based approach to resident education, a component of training should focus on skills needed for the transition from residency to independent practice. The ability to run an outpatient clinic represents one such skill. Resident-run clinics (RRC) have been implemented in family medicine programs to allow residents to practice this skill, and have enhanced learning while providing excellent patient satisfaction. To date, there has been little experience with RRCs in surgical residency programs. We describe a urology RRC and report assessments of both resident performance and patient satisfaction.MethodsThe RRC was run independently by a senior urology resident. All cases were reviewed with faculty at the end of the day, and an evaluation form assessing resident performance was completed. Residents also completed a brief self-assessment. All patients completed an anonymous survey to assess aspects of patient satisfaction.ResultsOverall, resident performance was excellent, with changes to the management plan in 6% (3/47) of cases after faculty review. All clinics finished within 30 minutes of planned end time. Residents reported confidence in their ability to manage the clinic (8.25/10). Forty-three patient surveys were completed. On a five-point scale, patient ratings of wait time, clinic environment, and appointment duration were 3.91, 4.23, and 4.12, respectively. Patient ratings of resident skills (communication, sensitivity, treatment options, and answering questions) were 4.30, 4.35, 4.40, and 4.42, respectively. Overall, confidence in residents was 9.07/10 and 100% of patients would recommend the RRC.ConclusionsBased on our ongoing experience, RRCs provide well-received, safe patient care and serve as a learning tool for residents as they prepare for independent practice. Given these results, residency programs could consider inclusion of a RRC as a component of the transition- to-practice training within a competency-based curriculum.

Dataset Information

Development and validation of the ACE tool: assessing medical trainees' competency in evidence based medicine.

Background

Methods

Results

Publications

Development and validation of the ACE tool: assessing medical trainees' competency in evidence based medicine.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets