- Open Access
The SURgical PAtient Safety System (SURPASS) checklist optimizes timing of antibiotic prophylaxis
Patient Safety in Surgery volume 4, Article number: 6 (2010)
Surgical site infection (SSI) is an adverse event in which a close relation between process of care and outcome has been demonstrated: administration of antibiotic prophylaxis decreases the risk of SSI. In our tertiary referral centre, a SURgical PAtient Safety System (SURPASS) checklist was developed and implemented. This multidisciplinary checklist covers the entire surgical pathway and includes, among other items, administration of antibiotic prophylaxis before induction of anaesthesia. The aim of this study was to determine the effect of SURPASS implementation on timing of antibiotic prophylaxis.
A retrospective analysis was performed on two cohorts of patients: one cohort of surgical patients that underwent surgery before implementation of the checklist and a comparable cohort after implementation. The interval between administration of antibiotic prophylaxis and incision was compared between the two cohorts.
A total of 772 surgical procedures were included. More than half of procedures were gastro-intestinal; others were vascular, trauma and hernia repair procedures. After implementation, the checklist was used in 81.4% of procedures. The interval between administration of antibiotic prophylaxis and incision increased from 23.9 minutes before implementation of SURPASS to 29.9 minutes after implementation (p = 0.047). In procedures where the checklist was used, the interval increased to 32.9 minutes (p = 0.004). The proportion of patients that did not receive antibiotics until after the incision decreased significantly.
The use of the SURPASS checklist leads to better compliance with regard to the timing of antibiotic prophylaxis administration.
Surgical site infection (SSI) is a common complication of surgery: reported incidence rates range from 2% to 20%, the variation largely depending on case mix [1–3]. SSIs are a major cause of morbidity, mortality and healthcare costs [4–6]. While in many adverse events, the connection between process of care and outcome is hard to define, this is not the case with SSI. Among many process measures that decrease SSI rates, the effect of preoperative administration of antibiotic prophylaxis (AP) has been demonstrated most extensively [7–10].
Much has been written about the optimal time frame of AP. Studies suggest that AP administration should be as close to the incision as possible, while agreeing that some time must be allowed for adequate tissue concentration to be built up [11–13]. In 1992, Classen et al showed that the greatest risk reduction for SSI occurred when antibiotics were administered within two hours before the incision, as opposed to administration after incision or more than two hours prior to the incision . Since then, a number of studies have been published that attempted to further define this interval [15–18]. A recent publication by Weber et al included 3,836 general surgical procedures; the greatest risk reduction occurred when antibiotics were administered between 30 and 60 minutes prior to the incision . In contrast, a study by Steinberg et al, including 4,472 cardiac, orthopaedic and gynaecological patients, showed that the risk of SSI was lowest when antibiotics were administered within the final 30 minutes pre-incision, a difference that did not reach statistical significance .
Most guidelines recommend administration within one to two hours of incision [19–21]. However, the practical implementation of these recommendations has been shown to be difficult [22–27]. In some settings, antibiotics have been administered too early [28–30]; in most, too late or not at all [22, 23, 25].
To increase standardization in the surgical pathway and improve surgical patient safety, a SURgical PAtient Safety System (SURPASS) checklist was developed using all relevant literature and subsequently validated by observation of the surgical pathway and practical evaluation . This multidisciplinary checklist covers the entire surgical pathway and includes, among many other items, administration of AP in the operating room before induction of anaesthesia. The aim of this study was to determine the effect of SURPASS implementation on timing of AP.
This study was performed in a tertiary referral centre. In this centre, AP is given in the operating room (OR) and the standard for the timing of AP is ≥30 minutes before the incision. Most commonly, the anaesthesiologist will insert an intravenous line once the patient has arrived in the operating room. Before the implementation of the checklist, in some cases, antibiotics would be administered by the anaesthesiologist at the start of induction. More often, antibiotics would not be administered until the start of surgery, when the surgeon ordered AP to be given.
Over the course of a year (Jan-Dec 2008), the entire SURPASS checklist was implemented in a step-by-step fashion in the surgical wards and operating rooms. From January 2008 onwards, the time out part of SURPASS was implemented in the OR. This part consists of a short discussion to be performed in the operating room before induction of anaesthesia. One of the 16 items to be checked by the surgeon, anaesthesiologist and operating assistant during this discussion is: 'Appropriate antibiotic prophylaxis administered ≥30 minutes before incision'. All completed checklists were prospectively registered in the electronic registration system in use in the operating rooms.
A retrospectively defined cohort of patients that underwent surgery prior to the implementation of the checklist was compared to a cohort that underwent surgery after implementation. For two three-month periods (October-December 2007 vs. October-December 2008), all surgical procedures where AP was indicated by protocol were analysed. Both elective and urgent procedures were included. In the post-intervention cohort, all procedures were included, whether or not the checklist had been used. This strategy was chosen in order to provide a realistic estimate of the potential effect of the intervention, taking into account a less than 100% compliance rate.
Registration of data was partly prospective. For all procedures, the time of incision was extracted from the electronic registration system in use in the operating rooms. In 2008, an electronic patient data management system was implemented for the anaesthesiologists in the OR and recovery room. For the post-intervention cohort, data on timing and choice of antibiotics were extracted from these electronic anaesthesia records. For the pre-intervention cohort, data on timing and choice of antibiotics were extracted from the paper anaesthesia records. Reliability of retrospectively collected data was checked by observation of a new sample of procedures, in which actual times of antibiotic administration and incision were compared to electronically registered times.
Intervals between administration of AP and incision were calculated. The means of the two cohorts were compared using the independent samples T test. In addition, the proportion of patients that received AP after the incision was assessed and the difference between the two cohorts was calculated using the Chi-Square test.
In a second analysis, all procedures where the checklist had not been used were excluded from the post-intervention cohort, to identify the actual effect of the checklist in case of a 100% compliance rate. All statistical analyses were two-tailed and values of p < 0.05 were considered significant. The analyses were completed using Statistical Package for the Social Sciences version 15.0 (SPSS®, Chicago, Illinois, USA).
A total of 772 surgical procedures were included (figure 1). In the post-implementation cohort, the checklist was actually used in 328 of 403 procedures (81.4%). Patient characteristics are listed in table 1. More than half of procedures were gastro-intestinal; others being vascular, trauma and hernia repair procedures. Data on antibiotic prophylaxis were available in 729 procedures. The percentage of patients that did not receive antibiotics did not differ between the two groups (table 1). Most patients (45.7%) received cefuroxime and clindamycin; a third of patients received a single dose of cefuroxime.
To validate the time points that were collected from the electronic databases, a sample of 44 procedures was observed. The median difference between registered and observed time of antibiotic administration was -1.0 minute (interquartile range (IQR) -6.6 to 4.0), and the median difference between registered and observed time of incision was -0.5 minutes (IQR -2.0 to 1.0).
Data on timing of antibiotic prophylaxis was available in 590 procedures. The mean interval between administration of AP and incision increased from 23.9 minutes (standard deviation 37.1) before implementation of the checklist to 29.9 minutes (standard deviation 31.9) after implementation (p = 0.047) (figure 2). The proportion of patients that did not receive antibiotics until after the incision decreased from 12.1% to 7.1% (p = 0.04).
When looking only at procedures where the checklist was actually used, the post-implementation interval increased to 32.2 minutes (p = 0.006; figure 3). In this cohort, the proportion of patients that did not receive antibiotics until after the incision decreased to 6.0% (p = 0.015).
Although it has been shown repeatedly that timely administration of AP decreases the incidence of SSI, the implementation of this knowledge into daily practice remains problematic. This study showed that implementation of a comprehensive surgical safety checklist (SURPASS) significantly improved compliance with hospital standards for timing of AP administration. The proportion of patients that did not receive antibiotics until after the incision decreased significantly.
Remarkably, the proportion of patients that did not receive AP, thus deviating from protocol, did not change. This might reflect deliberate divergence from protocol, as there were no differences in case mix before and after implementation. The inclusion criteria were based on groups of surgical procedures, without taking into account individual patient characteristics. In the 10% of patients that did not receive antibiotic prophylaxis, this might well have been a deliberate and well-considered choice, for example in the case of correction of a ventral hernia, where antibiotic prophylaxis is not always mandatory.
The checklist was not always used correctly: since the item on the checklist reads: 'Appropriate antibiotic prophylaxis administered ≥30 minutes before incision', one would expect AP to have been administered at least 30 minutes before incision in all procedures where the checklist had been used. This was obviously not the case. Apparently, the item was sometimes completed before AP had been administered and the 30 minute interval could not be guaranteed afterwards. This suboptimal way of checklist use might be solved with more education.
The optimal AP-incision interval to prevent SSIs has not been firmly established yet. Over 30 years ago, it was shown that administration within 1 hour prior to the incision yielded better results than administration 8 to 12 hours before incision . In 1992, Classen et al showed that administration within two hours to incision is preferable to administration before or after this period . Two recent studies attempting to further define this interval presented conflicting results [16, 18]. However, all available studies agree that AP administration after incision is undesirable; the SURPASS significantly decreased the proportion of patients receiving AP after incision. In addition, the mean AP-incision interval increased to within hospital standards.
Other studies have described interventions to improve timing of AP administration, usually in the context of multiple simultaneous interventions to decrease SSI rates. In a multicentre improvement project, a number of interventions were performed, consisting mostly of educational activities and generation of feedback data . In that study, the proportion of patients receiving antibiotics within one hour preoperatively improved by 15%. Another quality improvement project focused mainly on changes in workflow management and the assignment of responsibilities . Compliance with national guidelines improved by 20%. In an orthopaedic setting, timely administration of AP was added to a time out protocol to prevent wrong site surgery, leading to a 34% increase in the proportion of patients that received antibiotics within one hour preoperatively . The intervention last mentioned resembles the present study, although one crucial difference is that the time out procedure described by Rosenberg et al takes place just before the incision, whereas the time out procedure included in the SURPASS checklist must be performed before the start of anaesthesia. This by itself can lead to an interval of at least 30 minutes in most procedures (assuming the checklist is used correctly), in particular in centres with more complex surgery, where anaesthetic preparation can take a considerable amount of time.
Although SURPASS is the only validated comprehensive checklist for the entire surgical patient pathway, another surgical checklist consisting of an extended time out procedure was recently described by a working party of the World Health Organization . One of the items on that checklist was 'administration of AP within 60 minutes of incision', but this item was not checked until directly before incision. The authors report that mean rates of AP administration rose from as low as 56.1% (with a lower range of 18.1%) to 82.6%, and that SSI rates dropped from 6.2% to 3.4%. However, this study included a number of low-income countries with high baseline rates of SSI, where the effect of using proper AP to start with would have had a large impact. Considering the baseline SSI rate of approximately 5% and the baseline AP compliance rate of 90% in our centre, the number of patients included in the present study was too small to be able to detect a relevant influence of the checklist on SSI rates.
This study has several limitations. First, it is a before-after study: any change that was observed might have been influenced by secular changes, for example, the introduction of electronic anaesthesia records. However, we have no reason to suspect the introduction of electronic anaesthesia records had any influence on timing or recording of antibiotic prophylaxis, as it was merely a registration system and did not provide any prompts. In addition, a randomized study was not feasible because in interventions that aim to change human behaviour, there will always be contamination between intervention and control arm: whether consciously or not, the care that is provided to non-checklist patients will be influenced by the checklist. A parallel design comparing different hospitals would have been hampered by uncertainties related to inter-hospital and case mix differences. Second, the difference in data collection regarding timing of antibiotics before and after the intervention might have been of influence. In the pre-intervention cohort (paper records), data on timing of AP were missing in 73 patients, whereas, in the post-intervention cohort (electronic records), data were available in all but 4 patients. However, a difference in timing between procedures where data on timing were available and procedures where these data were not available, was deemed unlikely. Third, the fact that data on timing were collected retrospectively might render them less reliable; however, method validation in a separate small cohort comparing electronic recording with simultaneous observation showed negligible differences. Fourth, and most importantly, the effect of the SURPASS checklist on patient outcomes such as SSI's was not assessed in this study, because the numbers were too small to be able to detect a decrease in SSI's. Whether the implementation of SURPASS will lead to a decrease in SSI's will have to be tested in a much larger cohort of patients.
In this study, implementation of the multidisciplinary SURPASS checklist improved compliance with hospital standards for the timing of antibiotic prophylaxis. The proportion of patients that did not receive antibiotics until after the incision decreased significantly.
The checklist is currently being adopted in numerous hospitals, both in the Netherlands and in other European countries.
Auerbach A: Prevention of surgical site infections. Making health care safer: a critical analysis of patient safety practices. Evidence report/technology assessment no. 43. AHRQ publication no. 01-E058: 221-44. Edited by: Shojania KG, Duncan BW, McDonald KM, et al. 2001, Rockville, MD: Agency for Healhcare Research and Quality
Burke JP: Infection control - a problem for patient safety. N Engl J Med. 2003, 348: 651-656. 10.1056/NEJMhpr020557.
Gaynes RP, Culver DH, Horan TC, Edwards JR, Richards C, Tolson JS: Surgical site infection (SSI) rates in the United States, 1992-1998: the National Nosocomial Infections Surveillance System basic SSI risk index. Clin Infect Dis. 2001, 33 (Suppl 2): S69-S77. 10.1086/321860.
Astagneau P, Rioux C, Golliot F, Brucker G: Morbidity and mortality associated with surgical site infections: results from the 1997-1999 INCISO surveillance. J Hosp Infect. 2001, 48: 267-274. 10.1053/jhin.2001.1003.
Kirkland KB, Briggs JP, Trivette SL, Wilkinson WE, Sexton DJ: The impact of surgical-site infections in the 1990s: attributable mortality, excess length of hospitalization, and extra costs. Infect Control Hosp Epidemiol. 1999, 20: 725-730. 10.1086/501572.
Perencevich EN, Sands KE, Cosgrove SE, Guadagnoli E, Meara E, Platt R: Health and economic impact of surgical site infections diagnosed after hospital discharge. Emerg Infect Dis. 2003, 9: 196-203.
Bratzler DW, Houck PM, Richards C, Steele L, Dellinger EP, Fry DE, Wright C, Ma A, Carr K, Red L: Use of antimicrobial prophylaxis for major surgery: baseline results from the National Surgical Infection Prevention Project. Arch Surg. 2005, 140: 174-182. 10.1001/archsurg.140.2.174.
Nelson RL, Glenny AM, Song F: Antimicrobial prophylaxis for colorectal surgery. Cochrane Database Syst Rev. 2009, CD001181.
Page CP, Bohnen JM, Fletcher JR, McManus AT, Solomkin JS, Wittmann DH: Antimicrobial prophylaxis for surgical wounds. Guidelines for clinical care. Arch Surg. 1993, 128: 79-88.
Song F, Glenny AM: Antimicrobial prophylaxis in colorectal surgery: a systematic review of randomized controlled trials. Br J Surg. 1998, 85: 1232-1241. 10.1046/j.1365-2168.1998.00883.x.
Bergamini TM, Polk HC: Pharmacodynamics of antibiotic penetration of tissue and surgical prophylaxis. Surg Gynecol Obstet. 1989, 168: 283-289.
Burke JF: The effective period of preventive antibiotic action in experimental incisions and dermal lesions. Surgery. 1961, 50: 161-168.
DiPiro JT, Vallner JJ, Bowden TA, Clark BA, Sisley JF: Intraoperative serum and tissue activity of cefazolin and cefoxitin. Arch Surg. 1985, 120: 829-832.
Classen DC, Evans RS, Pestotnik SL, Horn SD, Menlove RL, Burke JP: The timing of prophylactic administration of antibiotics and the risk of surgical-wound infection. N Engl J Med. 1992, 326: 281-286.
Hawn MT, Itani KM, Gray SH, Vick CC, Henderson W, Houston TK: Association of timely administration of prophylactic antibiotics for major surgical procedures and surgical site infection. J Am Coll Surg. 2008, 206: 814-819. 10.1016/j.jamcollsurg.2007.12.013.
Steinberg JP, Braun BI, Hellinger WC, Kusek L, Bozikis MR, Bush AJ, Dellinger EP, Burke JP, Simmons B, Kritchevsky SB: Timing of antimicrobial prophylaxis and the risk of surgical site infections: results from the Trial to Reduce Antimicrobial Prophylaxis Errors. Ann Surg. 2009, 250: 10-16. 10.1097/SLA.0b013e3181ad5fca.
van Kasteren ME, Mannien J, Ott A, Kullberg BJ, de Boer AS, Gyssens IC: Antibiotic prophylaxis and the risk of surgical site infections following total hip arthroplasty: timely administration is the most important factor. Clin Infect Dis. 2007, 44: 921-927. 10.1086/512192.
Weber WP, Marti WR, Zwahlen M, Misteli H, Rosenthal R, Reck S, Fueglistaler P, Bolli M, Trampuz A, Oertli D: The timing of surgical antimicrobial prophylaxis. Ann Surg. 2008, 247: 918-926. 10.1097/SLA.0b013e31816c3fec.
Bratzler DW, Houck PM: Antimicrobial prophylaxis for surgery: an advisory statement from the National Surgical Infection Prevention Project. Am J Surg. 2005, 189: 395-404. 10.1016/j.amjsurg.2005.01.015.
Mangram AJ, Horan TC, Pearson ML, Silver LC, Jarvis WR: Guideline for Prevention of Surgical Site Infection, 1999. Centers for Disease Control and Prevention (CDC) Hospital Infection Control Practices Advisory Committee. Am J Infect Control. 1999, 27: 97-132. 10.1016/S0196-6553(99)70088-X.
Stone HH, Haney BB, Kolb LD, Geheber CE, Hooper CA: Prophylactic and preventive antibiotic therapy: timing, duration and economics. Ann Surg. 1979, 189: 691-699. 10.1097/00000658-197906000-00004.
Bull AL, Russo PL, Friedman ND, Bennett NJ, Boardman CJ, Richards MJ: Compliance with surgical antibiotic prophylaxis--reporting from a statewide surveillance programme in Victoria, Australia. J Hosp Infect. 2006, 63: 140-147. 10.1016/j.jhin.2006.01.018.
Castella A, Charrier L, Di LV, Pastorino F, Farina EC, Argentero PA, Zotti CM: Surgical site infection surveillance: analysis of adherence to recommendations for routine infection control practices. Infect Control Hosp Epidemiol. 2006, 27: 835-840. 10.1086/506396.
Dellinger EP, Hausmann SM, Bratzler DW, Johnson RM, Daniel DM, Bunt KM, Baumgardner GA, Sugarman JR: Hospitals collaborate to decrease surgical site infections. Am J Surg. 2005, 190: 9-15. 10.1016/j.amjsurg.2004.12.001.
Rosenberg AD, Wambold D, Kraemer L, Begley-Keyes M, Zuckerman SL, Singh N, Cohen MM, Bennett MV: Ensuring appropriate timing of antimicrobial prophylaxis. J Bone Joint Surg Am. 2008, 90: 226-232. 10.2106/JBJS.G.00297.
Tan JA, Naik VN, Lingard L: Exploring obstacles to proper timing of prophylactic antibiotics for surgical site infections. Qual Saf Health Care. 2006, 15: 32-38. 10.1136/qshc.2004.012534.
White A, Schneider T: Improving compliance with prophylactic antibiotic administration guidelines. AORN J. 2007, 85: 173-180. 10.1016/S0001-2092(07)60023-4.
Galandiuk S, Polk HC, Jagelman DG, Fazio VW: Re-emphasis of priorities in surgical antibiotic prophylaxis. Surg Gynecol Obstet. 1989, 169: 219-222.
Lizan-Garcia M, Garcia-Caballero J, sensio-Vegas A: Risk factors for surgical-wound infection in general surgery: a prospective study. Infect Control Hosp Epidemiol. 1997, 18: 310-315. 10.1086/647617.
Silver A, Eichorn A, Kral J, Pickett G, Barie P, Pryor V, Dearie MB: Timeliness and use of antibiotic prophylaxis in selected inpatient surgical procedures. The Antibiotic Prophylaxis Study Group. Am J Surg. 1996, 171: 548-552. 10.1016/S0002-9610(96)00036-0.
de Vries EN, Hollmann MW, Smorenburg SM, Gouma DJ, Boermeester MA: Development and validation of the SURgical PAtient Safety System (SURPASS) checklist. Qual Saf Health Care. 2009, 18: 121-126. 10.1136/qshc.2008.027524.
Stone HH, Hooper CA, Kolb LD, Geheber CE, Dawkins EJ: Antibiotic prophylaxis in gastric, biliary and colonic surgery. Ann Surg. 1976, 184: 443-452. 10.1097/00000658-197610000-00007.
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MC: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360: 491-499. 10.1056/NEJMsa0810119.
Part of data presented as poster during the Annual Meeting of the Surgical Infection Society in Chicago, May 6th-9th 2009.
The authors declare that they have no competing interests.
EdV conceived of the study, analysed the data and wrote the first draft of the manuscript. LD collected the data, assisted in analysing the data and assisted in writing the first draft of the manuscript. SM participated in the design of the study. RM participated in the design of the study and facilitated data collection. MB conceived of the study, participated in the design and analysis and helped draft the manuscript. All authors read and approved the final manuscript.