Standardized video interviews do not correlate to United States medical licensing examination step 1 and step 2 scores
JournalWestern Journal of Emergency Medicine
MetadataShow full item record
AbstractIntroduction: In 2017, the Standardized Video Interview (SVI) was required for applicants to emergency medicine (EM). The SVI contains six questions highlighting professionalism and interpersonal communication skills. The responses were scored (6-30). As it is a new metric, no information is available on correlation between SVI scores and other application data. This study was to determine if a correlation exists between applicants' United States Medical Licensing Examination (USMLE) and SVI scores. We hypothesized that numeric USMLE Step 1 and Step 2 Clinical Knowledge (CK) scores would not correlate with the SVI score, but that performance on the Step 2 Clinical Skills (CS) portion may correlate with the SVI since both test communication skills. Methods: Nine EM residency sites participated in the study with data exported from an Electronic Residency Application Service (ERAS®) report. All applicants with both SVI and USMLE scores were included. We studied the correlation between SVI scores and USMLE scores. Predetermined subgroup analysis was performed based on applicants' USMLE Step 1 and Step 2 CK scores as follows: (= 200, 201-220, 221-240, 241-260, >260). We used linear regression, the Kruskal-Wallis test and Mann-Whitney U test for statistical analyses. Results: 1,325 applicants had both Step 1 and SVI scores available, with no correlation between the overall scores (p=0.58) and no correlation between the scores across all Step 1 score ranges, (p=0.29). Both Step 2 CK and SVI scores were available for 1,275 applicants, with no correlation between the overall scores (p=0.56) and no correlation across all ranges, (p=0.10). The USMLE Step 2 CS and SVI scores were available for 1,000 applicants. Four applicants failed the CS test without any correlation to the SVI score (p=0.08). Conclusion: We found no correlation between the scores on any portion of the USMLE and the SVI; therefore, the SVI provides new information to application screeners. Copyright 2019 Egan et al.
Identifier to cite or link to this itemhttps://www.scopus.com/inward/record.uri?eid=2-s2.0-85059888836&doi=10.5811%2fwestjem.2018.11.39730&partnerID=40&md5=adb87549f621d8c7aabe84b9b5c4e7bc; http://hdl.handle.net/10713/8704
- Assessing Residency Applicants' Communication and Professionalism: Standardized Video Interview Scores Compared to Faculty Gestalt.
- Authors: Schnapp BH, Ritter D, Kraut AS, Fallon S, Westergaard MC
- Issue date: 2019 Jan
- Correlation Between United States Medical Licensing Examination and Comprehensive Osteopathic Medical Licensing Examination Scores for Applicants to a Dually Approved Emergency Medicine Residency.
- Authors: Kane KE, Yenser D, Weaver KR, Barr GC Jr, Goyke TE, Quinn SM, Worrilow CC, Burckhart AJ, Leonetti AL, Yoshioka IE, Dusza SW, Kane BG
- Issue date: 2017 Feb
- How Well Does the Standardized Video Interview Score Correlate with Traditional Interview Performance?
- Authors: Chung AS, Shah KH, Bond M, Ardolic B, Husain A, Li I, Cygan L, Caputo W, Shoenberger J, van Dermark J, Bronner J, Weizberg M
- Issue date: 2019 Aug 20
- Standardized Video Interview Scores Correlate Poorly with Faculty and Patient Ratings.
- Authors: Hall MM, Lewis JJ, Joseph JW, Ketterer AR, Rosen CL, Dubosh NM
- Issue date: 2019 Dec 19
- Racial bias in using USMLE step 1 scores to grant internal medicine residency interviews.
- Authors: Edmond MB, Deschenes JL, Eckler M, Wenzel RP
- Issue date: 2001 Dec