- Research article
- Open Access
- Open Peer Review
Management of ventilator-associated pneumonia in intensive care units: a mixed methods study assessing barriers and facilitators to guideline adherence
BMC Infectious Diseasesvolume 16, Article number: 349 (2016)
Guidelines from the Infectious Diseases Society of America/The American Thoracic Society (IDSA/ATS) provide recommendations for diagnosis and treatment of ventilator-associated pneumonia (VAP). However, the mere presence of guidelines is rarely sufficient to promote widespread adoption and uptake. Using the Systems Engineering Initiative for Patient Safety (SEIPS) model framework, we undertook a study to understand barriers and facilitators to the adoption of the IDSA/ATS guidelines.
We conducted surveys and focus group discussions of different health care providers involved in the management of VAP. The setting was medical-surgical ICUs at a tertiary academic hospital and a large multispecialty rural hospital in Wisconsin, USA.
Overall, we found that 55 % of participants indicated that they were aware of the IDSA/ATS guideline. The top ranked barriers to VAP management included: 1) having multiple physician groups managing VAP, 2) variation in VAP management by differing ICU services, 3) physicians and level of training, and 4) renal failure complicating doses of antibiotics.
Facilitators to VAP management included presence of multidisciplinary rounds that include nurses, pharmacist and respiratory therapists, and awareness of the IDSA/ATS guideline. This awareness was associated with receiving effective training on management of VAP, keeping up to date on nosocomial infection literature, and belief that performing a bronchoscopy to diagnose VAP would help with expeditious diagnosis of VAP.
Findings from our study complement existing studies by identifying perceptions of the many different types of healthcare workers in ICU settings. These findings have implications for antibiotic stewardship teams, clinicians, and organizational leaders.
Ventilator-associated pneumonia (VAP) is the most common nosocomial infection in the intensive care unit (ICU), with an incidence ranging from 9 % to as high as 39 % [1–4]. VAP is associated with prolonged hospitalization, health care costs and high mortality rates [5–7]. Healthcare-associated pneumonia, the majority of which in the ICU is VAP, accounts for more than 50 % of the antibiotics prescribed in the ICU and a significant proportion of inappropriate and overprescribed antibiotics [8, 9]. Several studies have shown that inappropriate treatment of VAP leads to adverse outcomes [10, 11].
Guidelines from the Infectious Diseases Society of America/The American Thoracic Society (IDSA/ATS) provide recommendations for diagnosis and treatment of VAP . However, it has become clear that the mere presence of a guideline, while necessary, is rarely sufficient to promote widespread adoption and uptake [13–23]. It is unclear as to what extent these guidelines are currently followed in ICUs and what barriers may exist that impede the implementation of these guidelines. A growing body of literature has identified barriers that must be addressed for guidelines to be effectively incorporated into clinical practice [24, 25]. We used a novel systems engineering framework (Systems Engineering Initiative for Patient Safety-SEIPS) to develop and administer a survey to understand barriers and facilitators to the adoption of the IDSA/ATS guideline.
These barriers may be broadly categorized into the five elements of the work system component of the SEIPS model : 1) characteristics of the guideline to be introduced (the ‘tool/technology’ element of the work system model), 2) characteristics of the individuals who play a role in adoption and usage of the guideline (the ‘individual’ element), 3) use of the guideline for changing behavior (the ‘task’ element), 4) characteristics of the organization in which the change is to occur, such as extent of training (the ‘organization’ element), and 5) characteristics of the physical environment in which the change is to occur (the ‘environment’ element) . The objective of this study was to characterize the barriers and facilitators of guideline-concordant care for VAP management.
This study was conducted in medical-surgical ICUs at the University of Wisconsin Hospital, a tertiary academic hospital (hospital A) and St. Joseph’s Hospital, a large multispecialty rural hospital (hospital B) in the Midwestern US. The medical-surgical ICU at the University of Wisconsin is a 24 bed ICU staffed by board certified intensivists and anesthesiologists. The medical-surgical ICU at St Joseph’s hospital is also staffed by trained intensivists. The study was conducted in 2008–2009.
Focus group methods and development of survey
To identify barriers and facilitators of managing VAP in ICUs from the providers’ perspective, a survey was developed based on literature review and content analysis of data collected from focus groups. Two focus group discussions (FGDs) (one with physicians and one with nurses, respiratory therapists and pharmacists) were conducted at each of the two hospitals. The objective of the FGDs was to identify and discuss issues of VAP management using the SEIPS framework (Fig. 1). Content analysis of focus groups’ transcripts identified a total of 193 “unique” comments, which were further classified into 9 themes: (1) communication between providers, (2) difficulty in diagnosing VAP, (3) education related to VAP and VAP management, (4) guideline awareness and use, (5) management of the condition, (6) provider responsibilities, (7) technology and its use, (8) use of clinically indicated tests, and (9) variation in practice. Based on the comments and themes identified, a survey was developed and pilot tested on four participants, all of whom were involved in medical management of VAP. They included one physician, one nurse, one respiratory therapist and one pharmacist. Revisions to the content of the questions were made to the survey according to the feedback from pilot testing.
The final survey was adapted to the two hospitals. The version developed for hospital A consisted of five sections. Background had two questions asking the participants if they were aware of the IDSA/ATS guideline for VAP management and to what extent they were willing to follow the guideline. Methods asked participants to indicate to what extent they agree or disagree with 45 statements on VAP management, using a 5-point Likert scale (1 strongly agree, 2 agree, 3 neither agree nor disagree, 4 disagree and 5 strongly disagree). Results asked participants to indicate the frequency with which 17 situations occurred in VAP management. This used a 5-point Likert scale (1 rarely, 2 occasionally, 3 sometimes, 4 fairly often and 5 very often). Discussion had five yes/no questions. These addressed VAP management and diagnosis guidelines and assessed considerations regarding the mini-bronchoalveolar lavage (mini-BAL) procedure. Conclusion collected demographic information of participants including gender, age, job position, work shift, and average length working for the present employer in the current position.
The survey developed for hospital B similarly had five sections, but a few questions were different from those for hospital A. This was because, in addition to the IDSA/ATS guideline for management of VAP, hospital A also has its own VAP management guidelines that were largely similar to national guidelines but not identical.
The paper survey was distributed to all physicians, nurses, respiratory therapists and pharmacists who practiced in the medical-surgical ICUs at both hospitals. The study was approved by the University of Wisconsin-Madison and the Marshfield Clinic Institutional Review Boards (IRBs). We obtained informed consent from all participants involved in the study.
Survey data was entered (with verification for accuracy) in an SPSS database. Descriptive statistics were calculated to identify top-ranked barriers and facilitators of VAP management. For each question, the number and percentage of participants who chose each of the available response categories were calculated. If the wording of a question was positive (e.g., pharmacist participation on ICU rounds is beneficial), then participants who chose “agree” and “strongly agree” or “fairly often” and “very often,” (when the question was about frequency), considered it as a facilitator; and participants who chose “disagree” and “strongly disagree” or “occasionally” and “rarely” considered it as a barrier. In contrast, if a question was stated in a negative manner (e.g., having multiple groups of physicians manage patients in the ICU complicates VAP guideline use), then participants who chose “agree” and “strongly agree” or “fairly often” and “very often” considered it as a barrier; and participants who chose “disagree” and “strongly disagree” or “occasionally” and “rarely” considered it as a facilitator. Questions were ranked according to the percentage of respondents who considered them as barriers or as facilitators.
Statistical analysis was performed to compare perceptions of participants from different professional groups and to examine the impact of guideline awareness on the perceptions of participants. Three questions designed only for hospital A were excluded from the analysis because they were not applicable to hospital B and 7 questions were excluded from the analysis because they were designed only for physicians and were not applicable to the other healthcare professional groups. Analysis for the remaining questions proceeded as follows. We treated questions that used a 5-point Likert scale (1 rarely, 2 occasionally, 3 sometimes, 4 fairly often and 5 very often) or (1 strongly agree, 2 agree, 3 neither agree nor disagree, 4 disagree and 5 strongly disagree), depending on whether the question was about agreement or frequency, as continuous variables . Because the dependent variables examining the differences between physicians, nurses, respiratory therapists and pharmacists were not normally distributed, we conducted one-way non-parametric ANOVA. When significant differences were identified between different professional groups, post-hoc analysis was performed using the Mann-Whitney test. This test was also used to examine differences between participants who were aware of and who were not aware of the IDSA/ATS guideline for VAP management. The Mann-Whitney test works by ranking all the values from low to high. Therefore, the hypothesis tested in these tests was that means of the ranks in the two comparison groups was zero.
Surveys were distributed to 115 participants from hospital A and 85 participants in hospital B. A total of 150 participants completed the survey, among whom 87 were from hospital A and 63 participants were from hospital B. The overall response rate was 75 %. (hospital A: 75 %, hospital B: 74 %). Table 1 shows the demographics of the participants from the two hospitals.
Barriers and facilitators
The top ranked barriers to VAP management identified in this study included (Table 2): 1) having multiple physician groups managing VAP, 2) variation in VAP management by differing ICU services, 3) physicians and level of training, and 4) renal failure complicating doses of antibiotics.
Facilitators to VAP management (Table 3) included presence of multidisciplinary rounds that include nurses, pharmacist and respiratory therapists, and awareness of the IDSA/ATS guideline. This awareness was associated with receiving effective training on management of VAP, keeping up to date on nosocomial infection literature, and belief that performing a bronchoscopy to diagnose VAP would help with expeditious diagnosis of VAP.
Table 4 shows the number of participants from each professional group who were aware of and who were not aware of the IDSA/ATS guideline for VAP management. Overall, 55 % of participants indicated that they were aware of the IDSA/ATS guideline for VAP management.
The next set of analyses shows results of the one-way non-parametric ANOVA and Mann-Whitney tests applied to items classified within each of nine themes identified from the content analysis of focus groups. The category with a smaller mean rank for a positively worded questions indicates that the group did better on that item than the comparison group, while a smaller mean rank on a negatively worded question indicates that the group did worse than the comparison.
None of the questions classified under three of the nine themes—variation in practice, communication between providers, and technology and its use differed significantly between participants who were aware of the guideline and those who were not (results not presented). For professional groups, only statistically significant (Bonferroni corrected) pairwise comparisons are presented in the paper and are summarized in Table 5 (Online supplemental material).
Compared to other professional groups, a higher proportion (71 %) of respiratory therapists agreed that more clinically useful specimens are collected when mini-BALs are performed (followed by physicians (61 %), nurses (45 %) and then pharmacists (25 %), (p = 0.01).
VAP accounts for a major proportion of anti-infective use in the ICU. Recent data indicate that antibiotic use is significantly higher in ICU patients compared with non-ICU patients for most antimicrobials  Optimizing management of VAP is clearly essential yet remains variable [30, 31] and is associated with suboptimal prescribing practices .
Antibiotic treatment guidelines have emerged as a potentially effective means of avoiding unnecessary antibiotic administration, increasing the effectiveness of prescribed antibiotics, and reducing antimicrobial resistance as well .
In our study, we attempted to understand the adoption and uptake of a national VAP diagnosis and management guideline . Overall, we found that 55 % of participants indicated that they were aware of the IDSA/ATS guideline. The top ranked barriers to VAP management included: 1) having multiple physician groups managing VAP, 2) variation in VAP management by differing ICU services, 3) physicians and level of training, and 4) renal failure complicating doses of antibiotics. Changes in renal clearance following renal failure make it difficult to establish precise antimicrobial dosing .
One of the top barriers to VAP management, having multiple physician groups managing VAP may be more likely to lead to poor patient outcomes particularly because of the increased likelihood of communication errors in the presence of multiple providers [35, 36].
Most respondents felt that nurse, pharmacist, and respiratory therapy participation in rounds was beneficial for VAP management. This finding further emphasizes the need for multidisciplinary rounds which have been associated with improved patient outcomes such as reduced mortality [37, 38] and reduced length of hospital stay .
Participants who were aware of the guideline also believed that they received effective training on management and kept up to date on nosocomial infection literature. However, they were less likely to believe that ICU respiratory therapists are capable of performing mini-BALs.
Compared to nurses, more pharmacists believed that there was variation in VAP management. This is not surprising because most of the variation in VAP management occurs in antibiotic use and pharmacists have a key role in that decision-making process. Awareness of the guideline was also more likely to be associated with belief that performing a bronchoscopy to diagnose VAP would help with expeditious diagnosis of VAP.
Other studies have shown that implementing the IDSA/ATS guideline by customizing it into center-specific guidelines was associated with increased adherence to guideline diagnostic criteria for nosocomial pneumonia and guideline-concordant empiric antibiotics [40, 41]. Our findings complement these existing studies by identifying perceptions of the many different types of healthcare workers (HCWs) in ICU settings.
Our study has limitations. Our survey was limited to two institutions in Wisconsin and thus may limit generalizability of our findings. We did not measure guideline adherence or correlate it with outcomes. A recent study found that guideline-adherent initial intravenous antibiotic therapy led to better patient outcomes and was less expensive than non-guideline adherent therapy . However, other studies have shown that guideline adherent care alone did not necessarily improve patient outcomes such as the frequent need for mechanical ventilation and all-cause 30 day mortality [43, 44]. We did not collect further data on the demographics of the respondents to allow comparisons between attendings and trainees for example. Knowledge of the guidelines might be different between these categories. We had less physician participation than other types of HCWs. Finally, as with any survey-based studies, we also cannot rule out the possibility of variability in question interpretation [45, 46].
These limitations notwithstanding, our findings have implications for antibiotic stewardship teams, clinicians, and organizational leaders.
About half of the respondents reported that they were aware of the IDSA/ATS guideline. Awareness of guidelines was associated with a belief that respondents received effective training on management and kept up to date on nosocomial infection literature. The top ranked barriers to VAP management included having multiple physician groups managing VAP, variation in VAP management by differing ICU services, physicians and level of training and renal failure complicating doses of antibiotics. Nurse, pharmacist and respiratory therapy participation in rounds was viewed as beneficial to VAP management by most respondents. Future studies should rigorously examine the impact of guideline adherence for VAP management to clinical patient outcomes and assess process measures to gauge degree and success of guideline implementation.
ANOVA, Analysis of variance; ATS, American Thoracic Society; HCWs, healthcare workers; ICU, intensive care unit; IDSA, Infectious Diseases Society of America; mini-BAL, mini-bronchoalveolar lavage; SEIPS, Systems Engineering Initiative for Patient Safety; VAP, ventilator-associated pneumonia
Mitharwal SM, Yaddanapudi S, Bhardwaj N, Gautam V, Biswal M, Yaddanapudi L. Intensive care unit-acquired infections in a tertiary care hospital: An epidemiologic survey and influence on patient outcomes. Am J Infect Control. 2016;44(7):e113–e117.
Bor C, Demirag K, Okcu O, Cankayali I, Uyar M. Ventilator-associated pneumonia in critically ill patients with intensive antibiotic usage. Pak J Med Sci. 2015;31(6):1441–6.
Rosenthal VD, Maki DG, Jamulitrat S, Medeiros EA, Todi SK, Gomez DY, et al. International Nosocomial Infection Control Consortium (INICC) report, data summary for 2003-2008, issued June 2009. Am J Infect Control. 2010;38(2):95–104. e2.
Edwards JR, Peterson KD, Mu Y, Banerjee S, Allen-Bridson K, Morrell G, et al. National Healthcare Safety Network (NHSN) report: data summary for 2006 through 2008, issued December 2009. Am J Infect Control. 2009;37(10):783–805.
Shorr AF, Zilberberg MD, Kollef M. Cost-effectiveness analysis of a silver-coated endotracheal tube to reduce the incidence of ventilator-associated pneumonia. Infect Control Hosp Epidemiol. 2009;30(8):759–63.
Kollef KE, Schramm GE, Wills AR, Reichley RM, Micek ST, Kollef MH. Predictors of 30-day mortality and hospital costs in patients with ventilator-associated pneumonia attributed to potentially antibiotic-resistant gram-negative bacteria. Chest. 2008;134(2):281–7.
Safdar N, Dezfulian C, Collard HR, Saint S. Clinical and economic consequences of ventilator-associated pneumonia: a systematic review. Crit Care Med. 2005;33(10):2184–93.
Glowacki RC, Schwartz DN, Itokazu GS, Wisniewski MF, Kieszkowski P, Weinstein RA. Antibiotic combinations with redundant antimicrobial spectra: clinical epidemiology and pilot intervention of computer-assisted surveillance. Clin Infect Dis. 2003;37(1):59–64.
Koenig SM, Truwit JD. Ventilator-associated pneumonia: diagnosis, treatment, and prevention. Clin Microbiol Rev. 2006;19(4):637–57.
Micek ST, Heuring TJ, Hollands JM, Shah RA, Kollef MH. Optimizing antibiotic treatment for ventilator-associated pneumonia. Pharmacotherapy. 2006;26(2):204–13.
Luna CM, Aruj P, Niederman MS, Garzon J, Violi D, Prignoni A, et al. Appropriateness and delay to initiate therapy in ventilator-associated pneumonia. Eur Respir J. 2006;27(1):158–64.
Guidelines for the management of adults with hospital-acquired, ventilator-associated, and healthcare-associated pneumonia. Am J Respir Crit Care Med 2005;171(4):388-416.
Ilan R, Fowler RA, Geerts R, Pinto R, Sibbald WJ, Martin CM. Knowledge translation in critical care: factors associated with prescription of commonly recommended best practices for critically ill patients. Crit Care Med. 2007;35(7):1696–702.
Jain MK, Heyland D, Dhaliwal R, Day AG, Drover J, Keefe L, et al. Dissemination of the Canadian clinical practice guidelines for nutrition support: results of a cluster randomized controlled trial. Crit Care Med. 2006;34(9):2362–9.
Hagedorn H, Hogan M, Smith JL, Bowman C, Curran GM, Espadas D, et al. Lessons learned about implementing research evidence into clinical practice. Experiences from VA QUERI. J Gen Intern Med. 2006;21 Suppl 2:S21–4.
Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, et al. Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci. 2006;1:23.
Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21 Suppl 2:S1–8.
Rello J, Lorente C, Bodi M, Diaz E, Ricart M, Kollef MH. Why do physicians not follow evidence-based guidelines for preventing ventilator-associated pneumonia?: a survey based on the opinions of an international panel of intensivists. Chest. 2002;122(2):656–61.
Finkelstein JA, Lozano P, Shulruff R, Inui TS, Soumerai SB, Ng M, et al. Self-reported physician practices for children with asthma: are national guidelines followed? Pediatrics. 2000;106(4 Suppl):886–96.
Bishop PB, Wing PC. Knowledge transfer in family physicians managing patients with acute low back pain: a prospective randomized control trial. Spine J. 2006;6(3):282–8.
Vernacchio L, Vezina RM, Mitchell AA. Knowledge and practices relating to the 2004 acute otitis media clinical practice guideline: a survey of practicing physicians. Pediatr Infect Dis J. 2006;25(5):385–9.
Vernacchio L, Vezina RM, Mitchell AA. Management of acute otitis media by primary care physicians: trends since the release of the 2004 American Academy of Pediatrics/American Academy of Family Physicians clinical practice guideline. Pediatrics. 2007;120(2):281–7.
Cason CL, Tyner T, Saunders S, Broome L. Nurses’ implementation of guidelines for ventilator-associated pneumonia from the Centers for Disease Control and Prevention. Am J Crit Care. 2007;16(1):28–36. discussion 7; quiz 8.
Carayon P, Gurses AP, Hundt AS, Ayoub P, Alvarado CJ. Performance obstacles and facilitators of healthcare providers. In: Korunka C, Hoffmann P, editors. Change and Quality in Human Service Work, vol. 4. Munchen: Hampp Publishers; 2005. p. 257–76.
Erhardt LR. Barriers to effective implementation of guideline recommendations. Am J Med. 2005;118(Suppl 12A):36–41.
Carayon P, Schoofs Hundt A, Karsh BT, Gurses AP, Alvarado CJ, Smith M, et al. Work system design for patient safety: the SEIPS model. Qual Saf Health Care. 2006;15 Suppl 1:i50–8.
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. Jama. 1999;282(15):1458–65.
Carifio J, Perla R. Ten common misunderstandings, misconceptions, persistent myths and urban legends about Likert scales and Likert response formats and their antidotes. J Soc Sci. 2007;3:106–16.
McGowan Jr J, Tenover F. Antimicrobial resistance in the intensive care unit: impact of new patterns. Int J Clin Pract Suppl. 1998;95:14–22.
Fowler RA, Flavin KE, Barr J, Weinacker AB, Parsonnet J, Gould MK. Variability in antibiotic prescribing patterns and outcomes in patients with clinically suspected ventilator-associated pneumonia. Chest. 2003;123(3):835–44.
Kollef MH, Morrow LE, Niederman MS, Leeper KV, Anzueto A, Benz-Scott L, et al. Clinical characteristics and treatment patterns among patients with ventilator-associated pneumonia. Chest. 2006;129(5):1210–8.
Dupont H, Mentec H, Sollet JP, Bleichner G. Impact of appropriateness of initial antibiotic therapy on the outcome of ventilator-associated pneumonia. Intensive Care Med. 2001;27(2):355–62.
Kollef MH, Fraser VJ. Antibiotic resistance in the intensive care unit. Ann Intern Med. 2001;134(4):298–314.
Kumar A, Singh NP. Antimicrobial dosing in critically ill patients with sepsis-induced acute kidney injury. Indian J Crit Care Med. 2015;19(2):99–108.
Streitenberger K, Breen-Reid K, Harris C. Handoffs in care--can we make them safer? Pediatr Clin North Am. 2006;53(6):1185–95.
The Joint Commission announces the 2006 National Patient Safety Goals and requirements. Jt Comm Perspect 2005;25(7):1-10.
McHugh MD. Daily multidisciplinary team rounds associated with reduced 30-day mortality in medical intensive care unit patients. Evid Based Nurs. 2010;13(3):91–2.
Kim MM, Barnato AE, Angus DC, Fleisher LA, Fleisher LF, Kahn JM. The effect of multidisciplinary care teams on intensive care unit mortality. Arch Intern Med. 2010;170(4):369–76.
Dutton RP, Cooper C, Jones A, Leone S, Kramer ME, Scalea TM. Daily multidisciplinary rounds shorten length of stay for trauma patients. J Trauma. 2003;55(5):913–9.
Mangino JE, Peyrani P, Ford KD, Kett DH, Zervos MJ, Welch VL, et al. Development and implementation of a performance improvement project in adult intensive care units: overview of the Improving Medicine Through Pathway Assessment of Critical Therapy in Hospital-Acquired Pneumonia (IMPACT-HAP) study. Crit Care. 2011;15(1):R38.
Madaras-Kelly KJ, Remington RE, Sloan KL, Fan VS. Guideline-based antibiotics and mortality in healthcare-associated pneumonia. J Gen Intern Med. 2012;27(7):845–52.
Wilke M, Grube RF, Bodmann KF. Guideline-adherent initial intravenous antibiotic therapy for hospital-acquired/ventilator-associated pneumonia is clinically superior, saves lives and is cheaper than non guideline adherent therapy. Eur J Med Res. 2011;16(7):315–23.
Grenier C, Pépin J, Nault V, Howson J, Fournier X, Poirier MS, et al. Impact of guideline-consistent therapy on outcome of patients with healthcare-associated and community-acquired pneumonia. J Antimicrob Chemother. 2011;66(7):1617–24.
Becher RD, Hoth JJ, Rebo JJ, Kendall JL, Miller PR. Locally derived versus guideline-based approach to treatment of hospital-acquired pneumonia in the trauma intensive care unit. Surg Infect (Larchmt). 2012;13(6):352–9.
Furnham A. Response bias, social desirability and dissimulation. Personal Individ Differ. 1986;7(3):385–400.
Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health (Oxf). 2005;27(3):281–91.
We acknowledge all the individuals that participated in the study as respondents.
The project described was supported by the Clinical and Translational Science Award (CTSA) program, through the NIH National Center for Advancing Translational Sciences (NCATS), grant UL1TR000427. NS is supported by a United States Department of Veterans Affairs MERIT award. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or the Department of Veterans Affairs. There are no conflicts of interest for any of the authors.
Availability of data and materials
The data on which conclusions are based is available from authors upon request.
NS: obtained funding and led the study JSM: participated in drafting of the manuscript and analysis. AX: critical editing of the manuscript and participation in study activities. AH critical editing of the manuscript and participation in study activities. MH: critical editing of the manuscript and participation in study activities. KEW: critical editing of the manuscript and participation in study activities. PC: critical editing of the manuscript and participation in study activities. All authors read and approved the manuscript.
NS: Has an MD and a PhD degree. She is the Associate Chief of Staff for Research and staff physician in infectious diseases at the William S. Middleton VA Medical Center, Madison, Wisconsin, USA. She is also an Associate Professor in the Department of Medicine, University of Wisconsin-Madison, WI, USA.
JSM: Holds a medical degree, a master of Public Health and a master of science in Population Health Sciences. He is currently a PhD candidate in Clinical Epidemiology at the University of Wisconsin, Madison, USA.
AX: Has a PhD in Industrial and Systems Engineering. He is currently an Assistant Professor at Armstrong Institute for Patient Safety and Quality, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.
ASH: Has a PhD in Industrial and Systems Engineering. She is currently the Associate Director for Education at the Center for Quality and Productivity Improvement, University of Wisconsin-Madison, Madison, WI, USA.
MH: Is an Infectious disease physician at the Department of Infectious Medicine, Marshfield Clinic, Marshfield, WI, USA.
KEW: Professor of Medicine at the R Adams Cowley Shock Trauma Center, University of Maryland School of Medicine, Baltimore, MD, USA.
PC: Has a PhD in Industrial and Systems Engineering. She is a Procter & Gamble Bascom Professor in Total Quality, Industrial and Systems Engineering. She is also the Director, Center for Quality and Productivity Improvement, University of Wisconsin-Madison, Madison, WI, USA.
Investigators will receive only normal scholarly gains from taking part in this study. The authors declare no competing interests.
Ethics approval and consent to participate
The study was approved by the University of Wisconsin-Madison and the Marshfield Clinic Institutional Review Boards (IRBs). We obtained informed consent from all participants involved in the study.