Use of an Objective Structured Clinical Examination (OSCE) to measure improvement in clinical competence during the surgical internship

D. A. Sloan, M. B. Donnelly, S. B. Johnson, R. W. Schwartz, W. E. Strodel, B. J. Browne, M. Hassett, A. K. Sachdeva, G. M. Larson, P. J. Fabri

Research output: Contribution to journalArticlepeer-review

80 Scopus citations

Abstract

Background. Traditional ward ratings and multiple-choice tests do not reliably assess clinical competence. This study determined the reliability of the Objective Structured Clinical Examination (OSCE) and its sensitivity in detecting the performance gains and deficits in surgical interns. Methods. A comprehensive 35-station OSCE was administered to 23 incoming interns and seven outgoing interns. The OSCE comprised 17 two-part clinical problems, relying primarily on actual or simulated patients. The reliability of the examination was assessed by coefficient α. Significant differences in performance between the two intern groups, between parts A and B, and among the 17 problems were determined by a three-way ANOVA. OSCE performance was also correlated with National Board of Medical Examiners Part II scores. Results. The reliabilities of part A, part B, and parts A and B combined were 0.72, 0.70, and 0.82, respectively. Overall, the outgoing interns performed significantly better than the incoming interns: 58% ± 1% mean OSCE score versus 47% ± 1% (p = 0.0001). The 17 clinical problems differed significantly in difficulty; major performance deficits were seen in both groups of trainees. The correlation of OSCE scores with National Board of Medical Examiners Part II scores was not significant (r = 0.11, p = 0.633). Conclusions. We conclude that the OSCE is an innovative, reliable tool for evaluating resident competence. Although outgoing interns performed better than did incoming interns, the OSCE scores clearly indicated major performance deficits in all interns.

Original languageEnglish
Pages (from-to)343-351
Number of pages9
JournalSurgery
Volume114
Issue number2
StatePublished - 1993

ASJC Scopus subject areas

  • Surgery

Fingerprint

Dive into the research topics of 'Use of an Objective Structured Clinical Examination (OSCE) to measure improvement in clinical competence during the surgical internship'. Together they form a unique fingerprint.

Cite this