Unknown

Dataset Information

0

Validity and Feasibility of the Minicard Direct Observation Tool in 1 Training Program.


ABSTRACT:

Background

Availability of reliable, valid, and feasible workplace-based assessment (WBA) tools is important to allow faculty to make important and complex judgments about resident competence. The Minicard is a WBA direct observation tool designed to provide formative feedback while supporting critical competency decisions.

Objective

The purpose of this study was to collect validity and feasibility evidence for use of the Minicard for formative assessment of internal medicine residents.

Methods

We conducted a retrospective cohort analysis of Minicard observations from 2005-2011 in 1 institution to obtain validity evidence, including content (settings, observation rates, independent raters); response process (rating distributions across the scale and ratings by month in the program); consequences (qualitative assessment of action plans); and feasibility (time to collect observations).

Results

Eighty faculty observers recorded 3715 observations of 73 residents in the inpatient ward (43%), clinic (39%), intensive care (15%), and emergency department (3%) settings. Internal medicine residents averaged 28 (SD=8.4) observations per year from 9 (SD=4.1) independent observers. Minicards had an average of 5 (SD=5.1) discrete recorded observations per card. Rating distributions covered the entire rating scale, and increased significantly over the time in training. Half of the observations included action plans with action-oriented feedback, 11% had observational feedback, 9% had minimal feedback, and 30% had no recorded plan. Observations averaged 15.6 (SD=9.5) minutes.

Conclusions

Validity evidence for the Minicard direct observation tool demonstrates its ability to facilitate identification of "struggling" residents and provide feedback, supporting its use for the formative assessment of internal medicine residents.

SUBMITTER: Donato AA 

PROVIDER: S-EPMC4512794 | biostudies-literature | 2015 Jun

REPOSITORIES: biostudies-literature

altmetric image

Publications

Validity and Feasibility of the Minicard Direct Observation Tool in 1 Training Program.

Donato Anthony A AA   Park Yoon Soo YS   George David L DL   Schwartz Alan A   Yudkowsky Rachel R  

Journal of graduate medical education 20150601 2


<h4>Background</h4>Availability of reliable, valid, and feasible workplace-based assessment (WBA) tools is important to allow faculty to make important and complex judgments about resident competence. The Minicard is a WBA direct observation tool designed to provide formative feedback while supporting critical competency decisions.<h4>Objective</h4>The purpose of this study was to collect validity and feasibility evidence for use of the Minicard for formative assessment of internal medicine resi  ...[more]

Similar Datasets

| S-EPMC6946748 | biostudies-literature
| S-EPMC10371357 | biostudies-literature
| S-EPMC6338150 | biostudies-literature
| S-EPMC8069591 | biostudies-literature
| S-EPMC5319609 | biostudies-literature
| S-EPMC8019151 | biostudies-literature
| S-EPMC7304120 | biostudies-literature
| S-EPMC5559254 | biostudies-literature
| S-EPMC8319975 | biostudies-literature
| S-EPMC6208190 | biostudies-literature