Unknown

Dataset Information

0

Comparative reliability of structured versus unstructured interviews in the admission process of a residency program.


ABSTRACT: BACKGROUND: Although never directly compared, structured interviews are reported as being more reliable than unstructured interviews. This study compared the reliability of both types of interview when applied to a common pool of applicants for positions in an emergency medicine residency program. METHODS: In 2008, one structured interview was added to the two unstructured interviews traditionally used in our resident selection process. A formal job analysis using the critical incident technique guided the development of the structured interview tool. This tool consisted of 7 scenarios assessing 4 of the domains deemed essential for success as a resident in this program. The traditional interview tool assessed 5 general criteria. In addition to these criteria, the unstructured panel members were asked to rate each candidate on the same 4 essential domains rated by the structured panel members. All 3 panels interviewed all candidates. Main outcomes were the overall, interitem, and interrater reliabilities, the correlations between interview panels, and the dimensionality of each interview tool. RESULTS: Thirty candidates were interviewed. The overall reliability reached 0.43 for the structured interview, and 0.81 and 0.71 for the unstructured interviews. Analyses of the variance components showed a high interrater, low interitem reliability for the structured interview, and a high interrater, high interitem reliability for the unstructured interviews. The summary measures from the 2 unstructured interviews were significantly correlated, but neither was correlated with the structured interview. Only the structured interview was multidimensional. CONCLUSIONS: A structured interview did not yield a higher overall reliability than both unstructured interviews. The lower reliability is explained by a lower interitem reliability, which in turn is due to the multidimensionality of the interview tool. Both unstructured panels consistently rated a single dimension, even when prompted to assess the 4 specific domains established as essential to succeed in this residency program.

SUBMITTER: Blouin D 

PROVIDER: S-EPMC3244318 | biostudies-other | 2011 Dec

REPOSITORIES: biostudies-other

Similar Datasets

| S-EPMC8376389 | biostudies-literature
| S-EPMC6415695 | biostudies-literature
| S-EPMC7489264 | biostudies-literature
| S-EPMC8170351 | biostudies-literature
| S-EPMC8684616 | biostudies-literature
| S-EPMC4892825 | biostudies-other
| S-EPMC7771615 | biostudies-literature
| S-EPMC10466443 | biostudies-literature
| S-EPMC3771184 | biostudies-other
| S-EPMC2951770 | biostudies-other