- Research article
- Open Access
- Open Peer Review
Screening swabs surpass traditional risk factors as predictors of MRSA bacteremia
BMC Infectious Diseasesvolume 18, Article number: 270 (2018)
Consideration to add empiric MRSA therapy with vancomycin is a common clinical dilemma. However, vancomycin overuse has important adverse events. MRSA colonization screening is commonly performed for infection control. We hypothesized that in cases of S. aureus bacteremia, a score based on patient level factors and MRSA colonization could predict the risk of MRSA infection and inform the need for empiric coverage.
Using modern machine learning statistical methods (LASSO regression and random forests), we designed a predictive score for MRSA infection based on patient level characteristics, and MRSA colonization as measured by screening done 30 days before infection (30-Day criteria), or at any time before infection (Ever-Positive criteria). Patient factors (age, sex, number of previous admissions, and other medical comorbidities) were obtained through our electronic records.
With random forests, MRSA colonization largely surpassed all other factors in terms of accuracy and discriminatory power. Using LASSO regression, MRSA colonization was the only factor with MRSA infection predictive power with odds ratio of 10.3 (min: 5.99, max: 16.1) and 8.14 (min: 6.01, max: 14.8) for the 30-Day and Ever-Positive criteria, respectively. Further, patient comorbidities were not adequate predictors of MRSA colonization.
In an era of community acquired MRSA, colonization status appears to be the only independent and reliable predictor of MRSA infection in cases of S. aureus bacteremia. A clinical approach based on a patient’s known MRSA colonization status and on local susceptibility patterns may be appropriate.
Methicillin resistant Staphylococcus aureus (MRSA) colonization is common in North America  and is an important cause of infections including skin and soft tissue, bone and joint, pneumonia and bacteremia. Consideration for empiric MRSA treatment results in patients often being prescribed vancomycin for suspected Gram-positive infections, sometimes days before the final microbiological results are obtained. While this is likely initially appropriate for hemodynamically unstable patients or when the index of suspicion for MRSA is reasonably high, the overuse of vancomycin has a significant potential for harm. It is associated with an increased risk of nephrotoxicity, which may be more common when vancomycin is used in combination with piperacillin-tazobactam . This combination is one of the most commonly used treatments for empiric broad spectrum antimicrobial coverage. Vancomycin-associated nephrotoxicity is associated with an increased length of hospitalization, cost, and an increased risk of mortality [3, 4]. Further, the initial use of vancomycin may delay the timely initiation of beta-lactams, which are superior agents for methicillin sensitive S. aureus (MSSA) .
Our group and others have previously demonstrated that MRSA screening swab results can be helpful in determining the probability of MRSA bacteremia in patients presenting with staphylococcal bloodstream infection . Other factors associated with MRSA infection such as the presence of chronic wounds, venous catheters, or other in-dwelling medical devices have also been studied in cases of MRSA infection of the bone or joint [7, 8].
We hypothesized that by combining individual patient comorbidities and risk factors along with MRSA screening swab results we could better discriminate between MRSA and MSSA bacteremia using statistical algorithms to develop a clinical prediction rule. This would help to avoid potentially inappropriate empiric use of vancomycin.
We conducted a retrospective review of all consecutive adult S. aureus bacteremia from April 1, 2010 to April 1, 2015 at the McGill University Health Center (832 beds; 2 hospitals in Montréal, Canada) and obtained their most-recent MRSA screening swab results prior to the blood culture. To prevent patients with multiple positive blood cultures from biasing the results of the study, only the first positive blood culture per patient was included.
Each case of bacteremia was cross-referenced with our electronic medical record to identify associated patient comorbidities in order to calculate the Charlson Comorbidity Index (CCI), a validated scoring system used to assess disease burden and mortality risk . An algorithm was used to calculate the CCI from the ICD-10 codes . We also recorded the number of previous emergency room and inpatient visits within the prior 12 months to serve as a proxy for acute healthcare exposure. All patients on medical, surgical and critical care units are screened for MRSA on admission, and periodically thereafter. A minority of units, such as obstetrics, use only targeted screening. The screen is performed in the nares, though other sites are accepted on a case by case basis. The microbiology protocol has been previously described in detail .
MRSA colonization status was interpreted in two ways. To begin, only samples obtained in the 30 days preceding the bacteremia were used to establish recent colonization. Following this, all available screening samples in the patient’s history of hospitalizations were used. These were respectively reported as the “30-Day criteria” and the “Ever-Positive criteria” .
We used the following two methods for variable selection to predict MRSA bacteremia:  random forests methods, and  least absolute shrinkage selection and selection operator (Lasso) with 10-fold cross validation and the “one standard error rule” (1SE) . Both methods have their own benefits and pitfalls. Random forests yield good error rates and classifies variables by their accuracy and Gini index (a measure of a variable’s ability to discriminate between the potential outcomes), but are harder to interpret. The Lasso provides a reasonable middle ground between interpretability and stability of the effect size estimate . Other variable selection methods exist; however, they tend to be more susceptible to issues involving multiple hypothesis testing and overestimation of effect size (e.g. stepwise regression) or are difficult to interpret clinically (e.g. ridge regression, neural networks). A secondary analysis using Lasso logistic regression was performed to study the variables that most closely predicted MRSA colonization.
Variables were checked for collinearity using variance inflation factors. Analyses were performed in R (v3.2.0) with the glmnet (v2.0–5) and the randomForest (v4.6–12) packages. The McGill University Health Centre Research Ethics Board approved this study. Consent was not obtained from patients as this was a retrospective study with no intervention. Authorization to release datasets analysed during the current study was not specifically obtained from our ethics board, but can be made available from the corresponding author on reasonable request and in compliance with our REB requirements.
There were 376 patients with S. aureus bacteremia included, of which 100 (26.6%) had MRSA. Patient comorbidities are shown in Table 1. Using Random Forest analysis, the five best variables for predicting MRSA bacteremia are presented in Tables 2 and 3. With both the 30-day and the Ever-Positive criteria, MRSA swabs had a predictive power that was vastly greater than all other variables. For example, a positive MRSA swab had a much greater predictive power than the presence of other seemingly classic risk factors such as age, a history of malignancy, the number of prior hospitalizations in the preceding 12 months, and the Charlson Comorbidity Index. Using the Lasso method and1SE rule (see Additional file 1), the MRSA screening swab was the only variable with any clinically relevant predictive power. Through this method, the logistic regression odds ratios for the 30-Day criteria were on average 10.6 (minimum: 5.08, maximum: 19.2), and for the Ever-Positive criteria on average 8.26 (minimum: 5.23, maximum: 15.8). Using Lasso logistic regression, no patient level comorbidity was predictive of MRSA colonization. This suggests the screening swab is likely the only meaningful variable in the model with respect to clinical prediction. From the 2 × 2 tables, we obtained a graphical representation of MRSA swab positive and negative predictive values for MRSA bacteremia (Figs 1 and 2) as functions of prevalence.
Vancomycin overuse is common in S. aureus bacteremia and may be harmful. Our group and others have previously shown that screening swabs are useful predictors of MRSA bacteremia [6, 12], and could help avoid unnecessary vancomycin prescriptions. However, it is a common belief that MRSA colonization status can be explained by healthcare exposure or the presence of multiple medical comorbidities, and that the swab is a proxy for these comorbidities. Previous studies have discussed several potential predictors of MRSA infection [7, 8], but the added benefit of MRSA colonization for clinical decision making was unclear. We examined multiple patient level factors to try and determine which, if any, could predict methicillin resistance, in an effort to develop a clinically meaningful risk score to better optimize the use of anti-MRSA therapy. Our results suggest screening swabs are an independent marker of MRSA infection, regardless of patient comorbidities. The findings of our study are a departure from what has been previously quoted in the literature, in that the only patient level risk factor with a useful clinical predictive ability was a patient’s known MRSA status. In fact, the burden of comorbid disease as calculated by the CCI was poorly related to methicillin resistant bacteremia, and both emergency department visits and admissions to acute care failed to contribute significantly.
This outcome may be related to two factors. First, our choice of variable selection technique prioritizes clinical significance over statistical significance. This would explain why variables which were previously reported as statistically related to MRSA did not significantly contribute to predicting infections in our study. Second, over the past 20 years MRSA has become a community acquired organism, and hospital exposure or medical comorbidities may not predict infection risk as well as they once might have. Even patients with minimal healthcare exposure may now be carriers of MRSA.
Three main problems limit our study. First, there were a small number of patients with each individual comorbidity in Table 1. To alleviate the problem of smaller sample size, we used an established comorbidity score (CCI) and input direct healthcare exposure as separate variables in our model. This continued to support the use of the MRSA screening swab as the sole predictor of MRSA bacteremia. Second, this study is retrospective and therefore hypothesis generating as to whether the use of known MRSA status could optimize vancomycin use with neutral or improved patient outcomes. Third, our institution only regularly screens for MRSA of the nares. While the nares are the most common site for MRSA colonization and correlates well with colonization of other body sites , the addition of other body sites would have improved our test sensitivity, though the incurring loss of specificity is hard to establish. However, it is likely the overall effect would be an improvement of the negative predictive value with a reduction in the positive predictive value. Given the simplicity of the clinical question, and the fact that the data required for the analysis can be collected retrospectively without introducing significant bias, we still believe that our results could be helpful for clinicians who want to estimate the risk of MRSA bloodstream infection.
First, depending on the local prevalence of methicillin resistance in S. aureus bacteremia and in the absence of a nosocomial MRSA outbreak, MRSA colonization status could be factored into the clinical decision to initiate intravenous vancomycin in stable patients and antistaphylococcal beta-lactams in all patients so as to limit both under and overtreatment . Second, we should reconsider whether MRSA colonization status is directly linked to the usual medical comorbidities. Based on our results, variables that were previously thought to be associated with MRSA such as healthcare exposure may not be dependable factors to infer the presence of drug resistant bacteria. The notion that healthcare exposure is a consistently reliable marker for the presence of resistant organisms is being challenged, as was illustrated in recent IDSA guidelines with the removal of the classification of “Healthcare-Associated” pneumonia . In an era of community acquired resistant organisms such as MRSA, our results suggest that favoring an approach based on known colonization status and local susceptibility patterns may be more appropriate.
We have demonstrated that known MRSA colonization status, along with knowledge of local prevalence patterns, is a more powerful prediction tool than any other patient level comorbidity in guiding early and appropriate treatment in Staphylococcus aureus bacteremia. We hope that prospective studies will demonstrate that in appropriately selected hemodynamically stable patients this approach reduces the overuse of potentially toxic therapies, increases early targeted beta-lactam therapy, and improves patient outcomes.
1 standard error rule
Charlson comorbidity index
Methicillin resistant Staphylococcus aureus
Methicillin sensitive Staphylococcus aureus
Jarvis WR, Jarvis AA, Chinn RY. National prevalence of methicillin-resistant Staphylococcus aureus in inpatients at United States health care facilities, 2010. Am J Infect Control. 2012;40:194–200.
Navalkele B, Pogue JM, Karino S, Nishan B, Salim M, Solanki S, Pervaiz A, Tashtoush N, Shaikh H, Koppula S, Koons J, Hussain T, Perry W, Evans R, Martin ET, Mynatt RP, Murray KP, Rybak MJ, Kaye KS. Risk of acute kidney injury in patients on concomitant vancomycin and piperacillin-Tazobactam compared to those on vancomycin and Cefepime. Clin Infect Dis. 2017;64:116–23.
Pritchard L, Baker C, Leggett J, Sehdev P, Brown A, Bayley KB. Increasing vancomycin serum trough concentrations and incidence of nephrotoxicity. Am J Med. 2010;123:1143–9.
Jeffres MN. The whole price of vancomycin: toxicities, troughs, and time. Drugs. 2017;77:1143–54.
Chang FY, Peacock JE Jr, Musher DM, Triplett P, MacDonald BB, Mylotte JM, O'Donnell A, Wagener MM, Yu VL. Staphylococcus aureus bacteremia: recurrence and the impact of antibiotic treatment in a prospective multicenter study. Medicine (Baltimore). 2003;82:333–9.
Butler-Laporte G, Cheng MP, Cheng AP, McDonald EG, Lee TC. Using MRSA screening tests to predict methicillin resistance in Staphylococcus aureus bacteremia. Antimicrob Agents Chemother. 2016;60:7444–8.
Epstein L, Mu Y, Belflower R, Scott J, Ray S, Dumyati G, Felsen C, Petit S, Yousey-Hindes K, Nadle J, Pasutti L, Lynfield R, Warnke L, Schaffner W, Leib K, Kallen AJ, Fridkin SK, Lessa FC. Risk factors for invasive methicillin-resistant Staphylococcus aureus infection after recent discharge from an acute-care hospitalization, 2011-2013. Clin Infect Dis. 2016;62:45–52.
Lee JY, Chong YP, Kim T, Hong HL, Park SJ, Lee ES, Kim MN, Kim SH, Lee SO, Choi SH, Woo JH, Kim YS. Bone and joint infection as a predictor of community-acquired methicillin-resistant Staphylococcus aureus bacteraemia: a comparative cohort study. J Antimicrob Chemother. 2014;69:1966–71.
Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83.
Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–9.
Hastie T, Tibshirani R, Friedman J. The elements of statistical learning: data mining, inference, and prediction. New York: Second ed: Springer; 2009. https://www.springer.com/la/book/9780387848570
MacFadden DR, Elligsen M, Robicsek A, Ricciuto DR, Daneman N. Utility of prior screening for methicillin-resistant Staphylococcus aureus in predicting resistance of S. Aureus infections. Cmaj. 2013;185:E725–30.
Mermel LA, Cartony JM, Covington P, Maxey P, Morse D. Methicillin-resistant Staphylococcus aureus colonization at different body sites: a prospective, quantitative analysis. J Clin Microbiol. 2011;49:1119–21.
Kalil AC, Metersky ML, Klompas M, Muscedere J, Sweeney DA, Palmer LB, Napolitano LM, O'Grady NP, Bartlett JG, Carratalà J, El Solh AA, Ewig S, Fey PD, File TM, Restrepo MI, Roberts JA, Waterer GW, Cruse P, Knight SL, Brozek JL. Management of Adults with Hospital-acquired and Ventilator-associated Pneumonia: 2016 clinical practice guidelines by the Infectious Diseases Society of America and the American Thoracic Society. Clin Infect Dis. 2016;63:e61–111. https://doi.org/10.1093/cid/ciw353.
Availability of data and materials
Authorization to release datasets analysed during the current study was not specifically obtained from our ethics board. Data would be available from the corresponding author on reasonable request with REB approval and a data sharing agreement.
GBL analyzed the dataset it. GBL, MPC, EGM, TCL were involved in designing the study and interpretation of the data and its analysis. All authors were involved in writing and editing the manuscript. All authors read and approved the final manuscript.
Obtained from McGill University Health Center Research Ethics Board, which also deemed it unnecessary to obtain consent directly from patients as this was a retrospective study with no intervention.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Lasso Analysis An example of the data analysis performed using the Lasso method. The following are representative curve obtained from repeating the analysis 100 times. Figure S1A. Patient level comorbidities and 30-Day criteria vs MRSA bacteremia. Figure S1B. Patient level comorbidities and Ever-Positive criteria vs MRSA bacteremia (DOCX 2607 kb).