The Limited Utility of Ranking Hospitals Based on Their Colon Surgery Infection Rates
JournalClinical infectious diseases : an official publication of the Infectious Diseases Society of America
PublisherOxford University Press
MetadataShow full item record
AbstractBackground: The Centers for Medicare and Medicaid Services (CMS) use colon surgical site infection (SSI) rates to rank hospitals and apply financial penalties. The CMS’ risk-adjustment model omits potentially impactful variables that might disadvantage hospitals with complex surgical populations. Methods: We analyzed adult patients who underwent colon surgery within facilities associated with HCA Healthcare from 2014 to 2016. SSIs were identified from National Health Safety Network (NHSN) reporting. We trained and validated 3 SSI prediction models, using (1) current CMS model variables, including hospital-specific random effects (HCA-adapted CMS model); (2) demographics and claims-based comorbidities (expanded-claims model); and (3) demographics, claims-based comorbidities, and NHSN variables (claims-plus–electronic health record [EHR] model). Discrimination, calibration, and resulting rankings were compared among all models and the current CMS model with published coefficient values. Results: We identified 39 468 colon surgeries in 149 hospitals, resulting in 1216 (3.1%) SSIs. Compared to the HCA-adapted CMS model, the expanded-claims model had similar performance (c-statistic, 0.65 vs 0.67, respectively), while the claims-plus-EHR model was more accurate (c-statistic, 0.70; 95% confidence interval, .67–.73; P = .004). The sampling variation, due to the low surgical volume and small number of infections, contributed 74% of the total variation in observed SSI rates between hospitals. When CMS model rankings were compared to those from the expanded-claims and claims-plus-EHR models, 18 (15%) and 26 (22%) hospitals changed quartiles, respectively, and 10 (8.3%) and 12 (10%) hospitals changed into or out of the lowest-performing quartile, respectively. Conclusions: An expanded set of variables improved colon SSI risk predictions and quartile assignments, but low procedure volumes and SSI events remain a barrier to effectively comparing hospitals. Copyright The Author(s) 2020. Published by Oxford University Press for the Infectious Diseases Society of America.
Identifier to cite or link to this itemhttp://hdl.handle.net/10713/15256
- Risk Adjustment for Determining Surgical Site Infection in Colon Surgery: Are All Models Created Equal?
- Authors: Muratore S, Statz C, Glover JJ, Kwaan M, Beilman G
- Issue date: 2016 Apr
- Ranking Hospitals Based on Colon Surgery and Abdominal Hysterectomy Surgical Site Infection Outcomes: Impact of Limiting Surveillance to the Operative Hospital.
- Authors: Yokoe DS, Avery TR, Platt R, Kleinman K, Huang SS
- Issue date: 2018 Sep 14
- Electronically Available Comorbidities Should Be Used in Surgical Site Infection Risk Adjustment.
- Authors: Jackson SS, Leekha S, Magder LS, Pineles L, Anderson DJ, Trick WE, Woeltje KF, Kaye KS, Lowe TJ, Harris AD
- Issue date: 2017 Sep 1
- Medicare claims can be used to identify US hospitals with higher rates of surgical site infection following vascular surgery.
- Authors: Calderwood MS, Kleinman K, Bratzler DW, Ma A, Kaganov RE, Bruce CB, Balaconis EC, Canning C, Platt R, Huang SS, CDC Prevention Epicenters Program., Oklahoma Foundation for Medical Quality.
- Issue date: 2014 Oct
- Surgical Site Infections: Volume-Outcome Relationship and Year-to-Year Stability of Performance Rankings.
- Authors: Calderwood MS, Kleinman K, Huang SS, Murphy MV, Yokoe DS, Platt R
- Issue date: 2017 Jan