Research | Open | Published:
Utilization of surgical safety checklists by urological surgeons in Germany: a nationwide prospective survey
Patient Safety in Surgeryvolume 9, Article number: 37 (2015)
We aimed to investigate the contemporary usage rate and habits of the WHO Surgical Safety Checklist (SSC) in German urological departments.
We designed a 26-item questionnaire that was sent to all urological departments in Germany. The primary aim of this study was to evaluate the usage rate of the SSC. Secondary aims were to compare perioperative characteristics of users vs. non-users of the SSC and to assess circumstances of the SSC application.
A total of 213 of 234 (91 %) urological departments were users of the SSC, and 21 (9 %) were non-users. SSC users had more often a standard protocol, took less time and had fewer people involved for checking perioperative patient data compared to non-users. Financial budgeting for the SSC existed in 55 (24 %) departments and for patient safety in 73 (32 %) departments.
The usage rate of the SSC in urological departments in Germany is high despite restricted financial budgeting. Users of the SSC profit by saving time and manpower for checking perioperative patient data.
Surgery is one of the most complex health interventions to be delivered. An estimated 234 million people require surgical treatment every year for different medical reasons , and adverse events in surgery were reported to occur in 14 % of patients . Among all types of surgery, the rate of preventable adverse events was 71 % for transurethral resection of the prostate or bladder, which was the second most common of all operations and thus seems to possess significant potential for improvement . Urology as a surgical discipline implies various dangers for patient safety because it is a high-volume and a high-technology discipline. Instruments used in endourology or in robotic surgery could endanger the success of an operation due to malfunctions of the technical system . An investigation on wrong-site surgery found that of 126 wrong site surgeries reported, 14 (11 %) were urological . The Joint Commission on Accreditation of Healthcare Organizations identified three key components to reduce the risks of wrong-site surgery: preoperative verification, site marking, and a timeout in the operating room, ensured by a safety checklist .
The Safe Surgery Saves Lives Study Group at the World Health Organization published a perioperative surgical safety checklist (SSC) in 2008 . The introduction of the SSC in eight hospitals around the world was associated with a reduction in deaths from 1.5 % to 0.8 % and in major complications from 11.0 % to 7.0 % . In a following study, de Vries et al. reported that implementation of a comprehensive checklist in hospitals with a high standard of care was associated with a reduction in postoperative complication rate from 27.3 % to 16.7 % . Despite the existing evidence for the use of the SSC, little is known about its real usage rate. To date, there are no reports in the medical literature on the usage rate of the SSC for the field of urology. Furthermore, usage habits of the SSC and reasons and circumstances of non-users of the SSC have not been explored.
The objective of this study was to evaluate the usage rate of the SSC in urological departments in Germany. Secondary aims were to compare perioperative characteristics of users vs. non-users of the SSC and to assess circumstances of the SSC application.
Development of the survey
The survey was designed and conducted according to reporting guidelines for surveys found on equator-network.org, an international initiative providing robust reporting guidelines [9, 10]. The first step for development of the survey was item generation. A literature search on Medline was done using the terms “surgical safety checklist” and “patient safety” in order to identify key topics concerning the use of the SSC. The survey contained 26 items, which were arranged on 4 pages. The response formats were closed and included binary, nominal and ordinal measurements. The complete survey design is depicted in Fig. 1. The survey starts with the central question of whether the responder uses a SSC or not. Depending on the answer, it continues with 9 questions for the user-group and 11 questions for the non-user group. The survey ends for both groups with 5 questions. The survey was then transferred to an independent online tool on www.surveymonkey.com and was approved by an institutional review board. The target populations were the urological departments in Germany. Email and postal addresses of all departments were collected from the database of the German Society of Residents in Urology. Since the number of 332 departments was reachable for this survey, there was no sampling done. The study was conducted in accordance with the Ethical Issues in Patient Safety Research published by the World Health Organization.
Administration of the survey
Before administration, the survey was tested for usability and technical functionality by doctors from the investigators’ department. It was then sent out to the 332 urological departments via email containing the web link to the online-survey. Once the survey was started an answer to every question was mandatory until completion. The timeframe for data collection via email distribution of the survey was 2 weeks. In order to increase the response rate, the survey was printed out and sent to all 332 urological departments as a paper version. Enclosed was a note not to fill out the paper survey if the online version had already been completed. The timeframe for data collection via postal distribution of the survey was 8 weeks.
Statistical calculations were performed using Statistical Package for the Social Sciences 22.0 software (SPSS Inc., Chicago, IL, USA). The groups of users of the SSC and non-users of the SSC were compared with regard to different parameters. To test whether a standard protocol for checking perioperative patient data was used more frequently by users of the SSC or by non-users of the SSC, the χ2 test was applied. The Mann–Whitney U-test was used to assess differences concerning how many people were engaged in and how much time was consumed for checking perioperative patient data. A p-value of less than 0.05 was considered significant.
Use and practicability of surgical safety checklist
Overall, 234 of 332 chairmen responded to the survey resulting in a response rate of 70 %. Of these, 119 (36 %) responded to the online version and 115 (35 %) to the paper version of the survey. Of the 234 responders, 213 (91 %) were users and 21 (9 %) were non-users of the SSC. The users of the SSC found it reasonable and not very laborious (79 %) rather than reasonable and laborious (19 %) or unreasonable and laborious (2 %). The estimated time consumption for completion of the SSC is shown in Fig. 2. Anesthisiologists (87 %), surgeons (85 %), surgical nurses (75 %), ward nurses (37 %) and ward doctors (28 %) were integrated in filling out the SSC.
Characteristics of users and non-users of the SSC
Differences found between the groups of users and non-users of the SSC are listed in Table 1. Users of the SSC (95 %) more often had a standard protocol for checking perioperative patient data than non-users (76 %), and this difference was statistically significant (p = 0.001). In addition, checking perioperative patient data took less time (p < 0.001), and fewer people were involved (p = 0.008) in the user group than in the non-user group. The reason for non-usage of the SSC was seldom for financial (10 %) or acceptance (24 %) matters and remained unclear (24 %) or of other nature (43 %) in most of the cases.
Resources for SSC and potential for improvement
Figure 3 shows the financial budget of the urological departments for patient safety. Overall, 136 of 234 departments (58 %) had no financial budget for patient safety at all. A budget for the SSC was provided for 15 of 234 departments (6 %). An assigned person in charge of patient safety was present in 162 of 234 (69 %) departments. A second team timeout after 4 h of operation time was reasonable for a minority (63/234, 27 %) of the departments. However, an adaptation of the SSC for specific procedures in minimally invasive and prosthetic surgery was considered to be useful by the majority (148/234, 63 %) of the responders.
A survey on the use of the SSC was sent out to all urological departments in Germany. The results of a representative sample showed a high, but incomplete, usage rate of the SSC of 91 %. The users of the SSC needed less time and fewer people to check perioperative patient data than the non-users. An improvement of the SSC through adaptation to specific procedures in minimally invasive and prosthetic urological surgery was found to be useful by the majority of departments.
The usage rate of the SSC was 91 % in our series of urological departments in Germany. Recent surveys reported a slightly lower usage rate in Switzerland of 79 %  and in Ireland of 78 % . The SSC has been mandated for use in surgical procedures in several countries including Sweden, the United Kingdom, and the USA. In England and Wales it has been modified by the National Patient Safety Agency in order to adjust it to national structures and processes. Examples of different versions of the SSC are shown in Additional file 1. Studies on the 30-day morbidity and mortality between countries with overall and fractional use the SSC might shed light on whether a mandated use of the SSC is beneficial.
Although the usage rate of the SSC found for urological departments in Germany was high this does not automatically go along with compliance to the SSC, which represents an unresolved conundrum in the current age of safety checklists. A recent prospective observational study of 854 surgeries performed in Colorado revealed a uniformly poor compliance with respect to assessment of case duration, blood loss, anesthesiologists’ concerns, or display of essential imaging . Moreover, active participation by physicians was observed in only 71 % of surgeries . Our survey respondees claimed higher percentages for involvement of anesthesiologists (87 %) and surgeons (85 %), however the crucial distinction of use of the SSC and compliance to the SSC has to be kept in mind when interpreting our findings.
The time consumption for checking perioperative patient data was lower for the group of users of the SSC than for non-users. Our results of an average time consumption of less than 2 min for completion of the SSC are in agreement with the time consumption found by Taylor et al. . Moreover, an observational study found that preoperative safety briefings did not delay the operating theatre start time . The perception of the users of the SSC was very positive in our population. 98 % found the SSC to be meaningful, and only 21 % found it to be laborious. Accordingly, Norton et al. reported that 89 % of hospital staff believed that the checklist has improved patient safety in the perioperative environment .
Only 32 % of departments had a financial budget for patient safety, and only 24 % had a budget for the SSC. In this context, the question of cost effectiveness of the SSC must be discussed. Costs of implementing a checklist mostly involve checklist development and modification, formal staff notification, training, and additional operating room time. In 2010, Semel et al. performed a hypothetical decision analysis of the checklist introduction . Per-use cost of the SSC was only $11 and it generated cost savings once it prevented at least five major complications, since the cost of a major surgical complication was found to be $11,626 on average . Furthermore, hospitals may realize savings through gains in efficiency by introduction of the SSC. A checklist use in operating rooms resulted in improved nurse retention and a decrease in the number of operations that were cancelled or delayed . Additional evidence suggests that operative briefings may actually decrease disruptions to the surgical workflow . In summary, evidence supports cost-effectiveness of the SSC and thus financial budget should be provided for this purpose.
Despite the described success of the SSC, there is still much to be improved. Since every specialty has its own specific needs, the adaptation of the SSC to urological conditions was considered useful by 63 % of the departments. An example for adaptation of the SSC was presented by Khan et al. who developed a comprehensive checklist to be used in operating theatres with advanced robotic technology . The SSC was also adapted by interventional radiologists according to their specific needs . In our survey, the subspecialties of prosthetic and minimally invasive urological surgery were regarded to be especially suitable for adaptation of the SSC. A second team timeout after 4 h for robotic surgery was proposed by Song et al. in order to further improve patient safety during long-lasting operations . The complication rate has been shown to increase linearly over time with a steep increase for long operations . However, only 27 % of responders in our survey considered the introduction of a second team time out after 4 h of operating time to be useful.
There are some limitations to the findings of our study due to survey methodology. Although the response rate of 70 % was very high for a survey, the findings might not be representative for all urological departments because 30 % did not respond. We assume that users of the SSC tended to answer the survey more frequently than non-users, and thus the real usage rate of the SSC might be slightly lower than 91 %. Furthermore, there is the potential for a double answer from one department for both the online and the paper version of the survey, which were sent out successively. However, the paper version included a note not to fill out the paper survey if the online version had already been completed. Finally, our survey was limited to the use of the SSC and did not monitor the compliance to the SSC in terms of quality and performance level of adhering to all required steps in the protocol.
We found a high usage rate of the SSC in urological departments in Germany of 91 %, although these departments often lack a budget for the SSC and for patient safety. Users of the SSC found it reasonable and saved time and manpower for checking perioperative patient data compared to non-users. The checklist should be understood not merely as a list of items to be checked off, but as an instrument for the improvement of communication, teamwork, and safety culture in the operating room, and it should be used accordingly.
Weiser TG, Regenbogen SE, Thompson KD, Haynes AB, Lipsitz SR, Berry WR, et al. An estimation of the global volume of surgery: a modelling strategy based on available data. Lancet. 2008;372(9633):139–44. doi:10.1016/S0140-6736(08)60878-8.
Anderson O, Davis R, Hanna GB, Vincent CA. Surgical adverse events: a systematic review. Am J Surg. 2013;206(2):253–62. doi:10.1016/j.amjsurg.2012.11.009.
Gawande AA, Thomas EJ, Zinner MJ, Brennan TA. The incidence and nature of surgical adverse events in Colorado and Utah in 1992. Surgery. 1999;126(1):66–75. doi:10.1067/msy.1999.98664.
Chen CC, Ou YC, Yang CK, Chiu KY, Wang SS, Su CK, et al. Malfunction of the da Vinci robotic system in urology. Int J Urol. 2012;19(8):736–40. doi:10.1111/j.1442-2042.2012.03010.x.
VA strengthens critical patient-safety procedure. Two systems replace traditional paper-based informed-consent process with an electronic time-out checklist integrated into electronic records. Health management technology. 2010;31(4):28–9.
WHO’s patient-safety checklist for surgery. Lancet. 2008;372(9632):1. doi:10.1016/S0140-6736(08)60964-2.
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, et al. A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009;360(5):491–9. doi:10.1056/NEJMsa0810119.
de Vries EN, Prins HA, Crolla RM, den Outer AJ, van Andel G, van Helden SH, et al. Effect of a comprehensive surgical safety system on patient outcomes. N Engl J Med. 2010;363(20):1928–37. doi:10.1056/NEJMsa0911535.
Burns KE, Duffett M, Kho ME, Meade MO, Adhikari NK, Sinuff T, et al. A guide for the design and conduct of self-administered surveys of clinicians. CMAJ. 2008;179(3):245–52. doi:10.1503/cmaj.080372.
Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. 2004;6(3):e34. doi:10.2196/jmir.6.3.e34.
Mascherek AC, Schwappach DL, Bezzola P. Frequency of use and knowledge of the WHO-surgical checklist in Swiss hospitals: a cross-sectional online survey. Patient Saf Surg. 2013;7(1):36. doi:10.1186/1754-9493-7-36.
Nugent E, Hseino H, Ryan K, Traynor O, Neary P, Keane FB. The surgical safety checklist survey: a national perspective on patient safety. Ir J Med Sci. 2013;182(2):171–6. doi:10.1007/s11845-012-0851-4.
Biffl WL, Gallagher AW, Pieracci FM, Berumen C. Suboptimal compliance with surgical safety checklists in Colorado: A prospective observational study reveals differences between surgical specialties. Patient Saf Surg. 2015;9(1):5. doi:10.1186/s13037-014-0056-z.
Taylor B, Slater A, Reznick R. The surgical safety checklist effects are sustained, and team culture is strengthened. Surgeon. 2010;8(1):1–4.
Ali M, Osborne A, Bethune R, Pullyblank A. Preoperative surgical briefings do not delay operating room start times and are popular with surgical team members. J Patient Saf. 2011;7(3):139–43. doi:10.1097/PTS.0b013e31822a9fbc.
Norton EK, Singer SJ, Sparks W, Ozonoff A, Baxter J, Rangel S. Operating Room Clinicians’ Attitudes and Perceptions of a Pediatric Surgical Safety Checklist at 1 Institution. J Patient Saf. 2014. doi:10.1097/PTS.0000000000000120.
Semel ME, Resch S, Haynes AB, Funk LM, Bader A, Berry WR, et al. Adopting a surgical safety checklist could save money and improve the quality of care in U.S. hospitals. Health Aff. 2010;29(9):1593–9. doi:10.1377/hlthaff.2009.0709.
Dimick JB, Chen SL, Taheri PA, Henderson WG, Khuri SF, Campbell Jr DA. Hospital costs associated with surgical complications: a report from the private-sector National Surgical Quality Improvement Program. J Am Coll Surg. 2004;199(4):531–7. doi:10.1016/j.jamcollsurg.2004.05.276.
Nundy S, Mukherjee A, Sexton JB, Pronovost PJ, Knight A, Rowen LC, et al. Impact of preoperative briefings on operating room delays: a preliminary report. Arch Surg. 2008;143(11):1068–72. doi:10.1001/archsurg.143.11.1068.
Henrickson SE, Wadhera RK, Elbardissi AW, Wiegmann DA, Sundt 3rd TM. Development and pilot evaluation of a preoperative briefing protocol for cardiovascular surgery. J Am Coll Surg. 2009;208(6):1115–23. doi:10.1016/j.jamcollsurg.2009.01.037.
Ahmed K, Khan N, Khan MS, Dasgupta P. Development and content validation of a surgical safety checklist for operating theatres that use robotic technology. BJU Int. 2013;111(7):1161–74. doi:10.1111/bju.12010.
Athreya S, Mikhail M, Reis Welsh S, Muzzafar A, Martin D. Patient safety in interventional radiological procedures: safety checklists and protocols. J Patient Saf. 2013;9(3):119–21. doi:10.1097/PTS.0b013e31829fc281.
Song JB, Vemana G, Mobley JM, Bhayani SB. The second “time-out”: a surgical safety checklist for lengthy robotic surgeries. Patient Saf Surg. 2013;7(1):19. doi:10.1186/1754-9493-7-19.
Procter LD, Davenport DL, Bernard AC, Zwischenberger JB. General surgical operative duration is associated with increased risk-adjusted infectious complication rates and length of hospital stay. J Am Coll Surg. 2010;210(1):60–5. doi:10.1016/j.jamcollsurg.2009.09.034. e1-2.
We thank all participators of the survey for their contribution.
The authors declare that they have no competing interests.
HB: Project development, Data collection and management, Data analysis, Manuscript writing and editing. SH: Project development, Data collection and management, Data analysis. MR: Data analysis, Manuscript writing and editing. TH: Data management, Data analysis, Manuscript writing. DS: Project development, Manuscript editing. IT: Data management, Data analysis, Manuscript writing. AH: Project development, Data analysis, Manuscript editing. All authors read and approved the final manuscript.
Examples of different surgical safety checklists used to improve patient safety. A: World Health Organization Surgical Safety Checklist, B: Surgical Safety Checklist used in Canada, C: Colorado hospital association Surgical Safety Checklist used in Colorado/USA, D: Surgical Safety Checklist used by University Hospital Frankfurt in Germany. (PDF 711 kb)