Compliance with the surgical safety checklist in Switzerland: an observational multicenter study based on self-reported data
Patient Safety in Surgery volume 16, Article number: 17 (2022)
Since publication of the surgical safety checklist by the WHO in 2009, it has been introduced in many hospitals. However, frequency and quality of surgical safety checklist use is often low probably limiting the effectiveness of the checklist in preventing patient harm. The focus of this study was to examine the current state of compliance with the surgical safety checklist in Switzerland and to evaluate how the data relates to international comparative data.
Between November 2020 and March 2021 twelve hospitals with 15 sites collected for at least 200 surgical interventions each whether the three sections of the surgical safety checklist (Sign In, Team Time Out, Sign Out) have been applied. This data collection was part of a large quality improvement project focusing on measuring and improving compliance with the surgical safety checklist via peer observation and feedback. Descriptive statistics were used to analyze the data; chi-square tests were used to compare sub-samples.
The hospitals collected valid compliance data for 8622 surgical interventions. Mean compliance rate was 91% when distinguishing between the two categories applied (including partially applied) and not applied. In line with previous research, Sign In (93%) and Team Time Out (94%) sections have been applied more frequently than Sign Out (86%). All three surgical safety checklist sections have been applied in 79% of the surgical interventions, no sections in 1%.
The results of this study indicate that the overall application of the surgical safety checklist in Switzerland can be considered high, although the completeness, especially of the Sign Out section, could be improved. At present, it seems difficult to compare compliance rates from different studies as measurement methods and definitions of compliance vary widely. A systematization and homogenization of the methodology within, but also beyond, national borders is desirable for the future.
In 2012 the Swiss Patient Safety Foundation (SPS) published as part of the national pilot program progress! Safe surgery a surgical safety checklist (SSC) for Switzerland in the three national languages French, German, and Italian [1, 2]. This checklist was based on the SSC of the World Health Organization (WHO) , but adapted for the Swiss healthcare context. Both checklists, from WHO and SPS, consist of three sections that should be applied at three critical points: The Sign In (SI) must be performed prior to induction of anesthesia, the Team Time Out (TTO) prior to skin incision, and the Sign Out (SO) prior to the patient or surgeon leaving the operating room (OR). Since publication, the SSC has been introduced in many hospitals in Switzerland, although SSC application is not mandatory. However, frequency and quality of SSC use in Switzerland is often low [2, 4,5,6], probably limiting the effectiveness of the SSC in preventing patient harm as several systematic reviews have shown [7,8,9].
A systematic review published in 2012 showed a range of compliance rates from 12 to 100% . An international observational study combined with a systematic review and meta-analysis published in 2018 showed that overall SSC compliance rates vary internationally between 62.5% and 98.7% . However, the compliance rates cannot be simply compared, as there are major differences in defining, measuring and interpreting compliance rates .
First of all, compliance can be defined in very different ways: Full compliance with the SSC may exist if the checklist has been signed by the responsible person , if all checklist sections are available and have been applied , if all of the items have been read aloud , etc. Second, compliance can be measured in many different ways: by internal hospital staff [14, 15] or external persons/audits , by analyzing data (in the case of electronic checklists ) or documents (in the case of paper checklists or measurement sheets) or by direct observation , etc. And third, most of the studies and reviews have a specific focus and limit the report of the compliance rates within specific target groups: adult  or pediatric surgery ), types of interventions (e.g., elective [6, 9, 18]), within single institutions, or single checklist sections (e.g., TTO [16, 18]) or TTO and SO [5, 6], etc.
In Switzerland, there is no regular, systematic collection of data on compliance with the SSC. Thus, in 2019 the national pilot program progress! COM-Check—Safe surgery aiming to implement a method for continuous monitoring of checklist compliance and to increase compliance with the SSC through peer audit and feedback was launched. First, documented compliance was collected by the participating hospitals themselves. Second, the hospital teams observed their colleagues applying the checklist and provided brief feedback immediately after the observation. The focus of this paper is on the documented compliance data to examine the current state of compliance with the SSC in all three language regions of Switzerland and to evaluate how this (self-collected, documentation-based) compliance data relates to international comparative data.
The national pilot program progress! COM-Check—Safe surgery
In 2019, the national pilot program progress! COM-Check—Safe surgery was launched in Switzerland. The main goals of the program were to implement a method for continuous monitoring of SSC compliance and to increase compliance with the SSC through peer audit and feedback. Participation in the program was voluntary. Requirement for participation was the willingness to form an interprofessional team consisting of at least three persons in leading positions in surgery, anesthesia, and nursing. The teams should assess for at least 200 surgical interventions whether the SSC has been applied and perform at least 30 in-house observations with immediate feedback on SSC application.
The program started with a kick-off event in January 2020. Between August and November 2020 each hospital team participated in a one-day training during which they practiced using the electronic data collection tools and giving feedback. Data collection took place between November 2020 and March 2021. In June 2021 first results of the data analyses were presented to and discussed with the hospital teams. The project ended in September 2021 with publication of the program material.
Participating hospitals and their SSCs
At the start of the national pilot program progress! COM-Check—Safe surgery, 17 hospitals with 20 sites signed up for program. An initial analysis of their 24 SSCs revealed that there was a large variation between the checklists .
By the start of data collection, five hospitals had withdrawn from the program for various reasons, mainly pandemic-related, resulting in a final sample of twelve hospitals with 15 sites. The hospitals were very heterogeneous; for example, in addition to acute care hospitals, a children's hospital, an eye clinic and an ambulatory center participated in the program. While there were very similar in terms of general structure (e.g., all SSCs included at least the three sections SI, TTO, SO) and standard items such as identity check, there were considerable differences in the number of items. For the SI, the number of items ranged from 6 to 22 (median = 10), for the TTO from 9 to 22 (median = 12), and for the SO from 3 to 7 (median = 5). The shortest checklist comprised in total 18 items, while the longest checklist had 50 items.
Data collection and monitoring
There were three options for data collection: Hospitals already recording their checklist use electronically could submit the exported data. Hospitals using paper SSCs had to compare them with the operating room (OR) program and record for each surgical intervention in an electronic tool whether the three SSC sections (SI, TTO, SO) had been applied. The third option concerned hospitals using the SSC as a visual aid (e.g., a laminated form of the SSC). These hospitals had to add paper sheets to the patient's records for the time of data collection and then enter the data into the electronic tool. For each surgical intervention, it was mandatory to record whether each of the three SSC sections had been applied. A checklist section was considered as applied if at least one item had been completed. Originally it was planned to distinguish only between the two categories checklist section applied versus checklist section not applied. Some hospitals asked for adding a third category checklist section partially applied. This third option was optional and not defined by the original program.
The electronic tool further contained some general indicators that had to be collected from all hospitals: date, time (night: after 4.59 PM or before 7.30 AM ), surgical discipline, type of anesthesia, planning of surgical intervention (elective/emergent), supplemented by a field for free comments. Before starting the data collection, the tool was adapted to the needs of the hospitals (e.g., selection of surgical disciplines). Some hospitals wanted to distinguish between different sites, others wanted to additionally record whether surgical procedures were performed on inpatients or outpatients, and still others whether procedures were performed by in-house surgeons or affiliated physicians. The electronic data collection tool was provided to the hospitals. It was cloud-based, and the data was additionally backed up weekly on local servers. The hospitals designated one person from their project team who had access to immediate evaluations in the electronic tool at any time.
Descriptive statistics were used to analyze the data; chi-square tests were used to compare sub-samples (significance level p < 0.05). Cramer's V was calculated as effect size measurement differentiating between small (V = 0.10), medium (V = 0.30), and large (V = 0.50) effects .
During the data collection period the hospitals assessed whether SSC had been applied for 8753 surgical interventions. Of these data, 131 had to be excluded due to multiple entries resulting in 8622 valid cases. This means that an average of 719 valid cases were collected per hospital. The sample was very heterogeneous in terms of language regions, disciplines, populations, day of the week, time of day, urgency of the procedure, and type of anesthesia (see Table 1).
The data shows that the SI was applied in 93% of all cases, the TTO in 94%, and the SO in 86% (on average 91%) when distinguishing between the two categories applied (including partially applied) and not applied. Of the 12 hospitals, 10 hospitals included the category partially applied (covering n = 6312 cases, 73%), while two hospitals distinguished only between applied and not applied (n = 2310, 27%). Considering the category partially applied as a separate category, data shows that the checklist sections were applied completely in 87% (SI), 85% (TTO), and 71% (SO) of all cases (on average 81%), and partially applied in 6% (SI), 9% (TTO), and 15% (SO) of all cases (see Fig. 1). For the further analyses we distinguish only between the two categories applied (including partially applied) and not applied.
For the SI, we found a significant difference in checklist application between elective (94%) and emergent (88%) surgical interventions (χ2(1)= 68.90, p < = 0.001); effect size was medium (V = 0.089). This difference was also evident for the TTO (elective: 95%; emergent: 92%; χ2(1)= 19.44, p < = 0.001), but here effect size was weak (V = 0.048). Regarding the time of the surgical interventions, there was a significant difference at the SI between day (93%) and night (90%) (χ2(1) = 23.18, p < = 0.001); effect size was moderate (V = 0.052).
Table 2 shows all combinations of applied SSC sections.
All three SSC sections have been applied in 79%, some sections in 20%, and no section in 1% of all cases. Comparing the samples of the surgical interventions where all three SSC sections have been applied (n = 6810), some checklist sections (n = 1702), and no section (n = 110), we found significant differences for urgency, type of anesthesia, day, time, and surgical discipline (see Table 3). The effects are small to medium; except for type of anesthesia where a large effect was found.
The aim of this study was to assess the current state of compliance with the SSC in Switzerland via self-collected, documentation-based data and compare these data with compliance rates from other countries. With an overall compliance rate of 91%, it is considerably higher than the mean compliance rate (75%) reported in the systematic review of Borchard and colleagues , but in the second lowest quartile if put in the ranking of the results of Abbott and colleagues .
The data collection was part of a larger quality improvement initiative focusing on improving compliance with the SSC. Improvement methods were implemented at the same time as the compliance data collection, which might have had a (positive) influence on compliance data. Consistent with other findings in the literature [5, 22], the SO is the section that is least likely to be applied completely, namely in only 71% of the cases. If the SSC sections are viewed in isolation, it could be concluded that compliance at SI and TTO is already quite satisfactory, but should be improved at SO. However, a look at the entire SSC reveals that in 21% of the cases none (1%) or at least not all three checklist sections (20%) were applied. This means that in about every 5th case the compliance goal complete SSC application of all three sections in all surgical interventions is not met. A deeper look into the data also shows that there is a significant number of partially applied checklist sections (e.g., 9% at TTO). If we exclude this partially applied option, the average of the completely applied SSC sections decreases to 81% (compared to 91% including partially applied).
Cases with no checklist section completed at all were more likely to be emergency surgeries, especially gynecologic/obstetric procedures. This is consistent with findings from other studies . A shortened checklist with a minimal set of few elementary items could be an option for such surgeries under high time pressure.
The SSCs examined in this study were very heterogeneous, as shown by a preliminary analysis at the beginning of the program . Especially short SSCs are easy to use and easier to complete than longer SSCs but may not have the same effectiveness as the recommended WHO checklist. Thus, short SSCs may show better compliance rates with limited effectiveness. When measuring and comparing compliance rates, it is important to consider and report on the level of complexity of the checklists. Caution should be taken when comparing compliance data based on samples with different inclusion criteria. For example, our study included pediatric and adult, elective and emergency, weekend and weekday surgeries from different disciplines and documents varying levels of compliance within these sub-sets. Results should thus not be compared to compliance rates obtained in general elective adult surgeries which are commonly higher .
The measurement method seems to be a critical aspect for the comparison and interpretation of compliance rates as there are huge differences between studies [8, 10]. Thus, it is crucial to define exactly what SSC applied means, and to include a well-defined SSC partially applied category as this helps to gain a better insight of the application of the SSC sections and single items. As already requested by others , a uniform measurement of compliance would be desirable for the future. We thus propose the following three categories for the evaluation of paper checklists:
SSC completely applied: All SSC items have been marked as checked.
SSC partially applied: At least one SSC item has been marked as checked, but not all.
SSC not applied: No SSC item has been marked as checked or SSC is missing.
Such a definition would be most valuable for studies covering multiple sites each with different checklists, items and application procedures, such as ours.
The data were collected by the hospitals themselves and not validated by external controls. Therefore, we cannot make any statements about the reliability of the data. For example, we cannot verify whether all the surgical interventions for which no SSC section was applied were recorded.
The category partially applied was not predefined. Responses in the free comment fields indicate that individual hospitals assigned cases to categories differently. For example, some hospitals rated a missing signature as partially applied, while other hospitals rated only the application of the content items to assess the degree of fulfillment. Therefore, the data in the partially applied category should be interpreted with caution.
The results of this study indicate that the overall application of the surgical safety checklist in Switzerland can be considered high, although the completeness, especially of the SO section, could be improved.
At the present time, there seem to be as many methods of collection as there are compliance rates. A systematization and homogenization of the methodology within, but also beyond, national borders is desirable for the future.
Finally, compliance rates tell very little about the quality of the checklists and their application , resulting in the risk that a pure consideration of (high) compliance rates creates a false sense of safety.
Availability of data and materials
The datasets used and analysed during the current study are available from the corresponding author on reasonable request.
Swiss Patient Safety Foundation
Surgical Safety Checklist
Team Time Out
World Health Organization
Bezzola P, Hochreutener MA, Schwappach DLB. Operation Sichere Chirurgie. Die chirurgische Checkliste und ihre Implementierung: Kultur-Team-Tools. Schriftenreihe Nr. 5. Zürich: Stiftung Patientensicherheit Schweiz; 2012.
Mascherek AC, Bezzola P, Gehring K, Schwappach DLB. Effect of a two-year national quality improvement program on surgical checklist implementation. Z Evid Fortbild Qual Gesundhwes [Internet]. 2016;114:39–47. Available from: http://www.sciencedirect.com/science/article/pii/S1865921716300666
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat A-HS, Dellinger EPP, et al. A Surgical Safety Checklist to Reduce Morbidity and Mortality in a Global Population. N Engl J Med [Internet]. 2009 Jan 29;360(5):491–9. Available from: http://www.nejm.org/doi/abs/https://doi.org/10.1056/NEJMsa0810119
Mascherek AC, Schwappach DLB. Surgical checklist use in Switzerland 2015 – where are we today?: a cross-sectional national survey study. Saf Heal [Internet]. 2016 Dec 7;2(1):6. Available from: http://www.safetyinhealth.com/content/2/1/6
Schwendimann R, Blatter C, Lüthy M, Mohr G, Girard T, Batzer S, et al. Adherence to the WHO surgical safety checklist: an observational study in a Swiss academic center. Patient Saf Surg [Internet]. 2019 Dec 12;13(1):14. Available from: https://pssjournal.biomedcentral.com/articles/https://doi.org/10.1186/s13037-019-0194-4
Cullati S, Le Du S, Raë A-C, Micallef M, Khabiri E, Ourahmoune A, et al. Is the Surgical Safety Checklist successfully conducted? An observational study of social interactions in the operating rooms of a tertiary hospital. BMJ Qual Saf [Internet]. 2013 Aug;22(8):639–46. Available from: http://qualitysafety.bmj.com/lookup/doi/https://doi.org/10.1136/bmjqs-2012-001634
Borchard A, Schwappach DLB, Barbir A, Bezzola P. A Systematic Review of the Effectiveness, Compliance, and Critical Factors for Implementation of Safety Checklists in Surgery. Ann Surg [Internet]. 2012 Dec;256(6):925–33. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201212000-00011
Bergs J, Hellings J, Cleemput I, Zurel Ö, De Troyer V, Van Hiel M, et al. Systematic review and meta-analysis of the effect of the World Health Organization surgical safety checklist on postoperative complications. Br J Surg [Internet]. 2014 Feb [cited 2020 Mar 26];101(3):150–8. Available from: http://doi.wiley.com/https://doi.org/10.1002/bjs.9381
Abbott TEF, Ahmad T, Phull MK, Fowler AJ, Hewson R, Biccard BM, et al. The surgical safety checklist and patient outcomes after surgery: a prospective observational cohort study, systematic review and meta-analysis. Br J Anaesth [Internet]. 2018 Jan;120(1):146–55. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0007091217539458
Liu LQ, Mehigan S. A Systematic Review of Interventions Used to Enhance Implementation of and Compliance With the World Health Organization Surgical Safety Checklist in Adult Surgery. AORN J [Internet]. 2021 Aug 27;114(2):159–70. Available from: https://onlinelibrary.wiley.com/doi/https://doi.org/10.1002/aorn.13469
Weckenbrock R. Anspruch und Wirklichkeit: Umsetzung der G-BA Qualitätsmanagement-Richtlinie bezüglich der Anwendungspraxis der OP-Checkliste – Status Quo an einem universitären Maximalversorger. Das Gesundheitswes [Internet]. 2020 Sep 4; Available from: http://www.thieme-connect.de/DOI/DOI?https://doi.org/10.1055/a-1192-4981
Wangoo L, Ray RA, Ho Y-H. Staff Attitudes and Compliance Toward the Surgical Safety Checklist in North Queensland. Int Surg [Internet]. 2018 May 1;103(5–6):270–9. Available from: https://meridian.allenpress.com/international-surgery/article/103/5-6/270/11601/Staff-Attitudes-and-Compliance-Toward-the-Surgical
Giles K, Munn Z, Aromataris E, Deakin A, Schultz T, Mandel C, et al. Use of surgical safety checklists in Australian operating theatres: an observational study. ANZ J Surg [Internet]. 2017 Dec;87(12):971–5. Available from: http://dx.doi.org/https://doi.org/10.1111/ans.13638
Tan J, Ngwayi JRM, Ding Z, Zhou Y, Li M, Chen Y, et al. Attitudes and compliance with the WHO surgical safety checklist: a survey among surgeons and operating room staff in 138 hospitals in China. Patient Saf Surg [Internet]. 2021 Dec 6;15(1):3. Available from: https://pssjournal.biomedcentral.com/articles/https://doi.org/10.1186/s13037-020-00276-0
Biffl WL, Gallagher AW, Pieracci FM, Berumen C. Suboptimal compliance with surgical safety checklists in Colorado: A prospective observational study reveals differences between surgical specialties. Patient Saf Surg [Internet]. 2015;9(1):5. Available from: http://www.pssjournal.com/content/9/1/5
Taplin C, Romano L, Tacey M, Hodgson R. Everyone has Their Role to Play During the World Health Organisation Surgical Safety Checklist in Australia: A Prospective Observational Study. World J Surg. 2020;44(6):1755–61.
Röhsig V, Maestri RN, Parrini Mutlaq MF, Brenner de Souza A, Seabra A, Farias ER, et al. Quality improvement strategy to enhance compliance with the World Health Organization Surgical Safety Checklist in a large hospital: Quality improvement study. Ann Med Surg [Internet]. 2020 Jul;55(January):19–23. Available from: https://doi.org/10.1016/j.amsu.2020.04.027
Muensterer OJ, Kreutz H, Poplawski A, Goedeke J. Timeout procedure in paediatric surgery: effective tool or lip service? A randomised prospective observational study. BMJ Qual Saf [Internet]. 2021 Aug;30(8):622–7. Available from: https://qualitysafety.bmj.com/lookup/doi/https://doi.org/10.1136/bmjqs-2020-012001
Fridrich A, Imhof A, Schwappach DLB. How Much and What Local Adaptation Is Acceptable? A Comparison of 24 Surgical Safety Checklists in Switzerland. J Patient Saf [Internet]. 2021 Apr 14;17(3):217–22. Available from: https://journals.lww.com/https://doi.org/10.1097/PTS.0000000000000802
van Klei WA, Hoff RG, van Aarnhem EEHL, Simmermacher RKJJ, Regli LPEE, Kappen TH, et al. Effects of the Introduction of the WHO “Surgical Safety Checklist” on In-Hospital Mortality. Ann Surg [Internet]. 2012 Jan;255(1):44–9. Available from: http://journals.lww.com/annalsofsurgery/Fulltext/2012/01000/Effects_of_the_Introduction_of_the_WHO__Surgical.8.aspx
Ellis PD. Interpreting effects. In: The Essential Guide to Effect Sizes [Internet]. Cambridge: Cambridge University Press; p. 31–44. Available from: https://www.cambridge.org/core/product/identifier/CBO9780511761676A010/type/book_part
Tully PA, Ng B, McGagh D, Meehan N, Khachane A, Higgs J, et al. Improving the WHO Surgical Safety Checklist sign-out. BJS Open [Internet]. 2021 May 7;5(3). Available from: https://academic.oup.com/bjsopen/article/doi/https://doi.org/10.1093/bjsopen/zrab028/6271349
Delisle M, Pradarelli JC, Panda N, Koritsanszky L, Sonnay Y, Lipsitz S, et al. Variation in global uptake of the Surgical Safety Checklist. Br J Surg [Internet]. 2020 Jan 5 [cited 2020 Apr 28];107(2):e151–60. Available from: http://doi.wiley.com/https://doi.org/10.1002/bjs.11321
Giles K, Munn Z, Aromataris E, Deakin A, Schultz T, Mandel C, et al. Use of surgical safety checklists in Australian operating theatres: an observational study. ANZ J Surg [Internet]. 2017 Dec;87(12):971–5. Available from: https://onlinelibrary.wiley.com/doi/https://doi.org/10.1111/ans.13638
We thank the following hospitals and representatives who participated in the project with their interprofessional teams and collected data for this study:
Dr. med. Mirko Brenni from the See-Spital Horgen Kilchberg; Frau Adriana Degiorgi from the Ospedale Regionale di Lugano and from the Ospedale Regionale di Bellinzona e Valli; Daniela Franco from the Clinica Ars Medica; Anne-Catherine Germain from the Spital Davos; Dr. med. Werner Girgsdies from the Medizinisches Zentrum Brugg AG; Dr Nicolas Millet from the Hôpital ophtalmique Jules-Gonin; Dr. med. Mireille Neumann from the Spital Zofingen; Dr. Marwan Obeid from the Hôpital Riviera-Chablais Vaud-Valais; Michela Pfyffer von Altishofen from the Clinica Sant’Anna; Bekim Qerimi from the AndreasKlinik Cham Zug; Nadine Schneider from the Privatklinik Bethanien, PD Dr. med. Sven Staender from the Spital Männedorf; PD Dr. med. Ulrike Subotic from the Universitäts-Kinderspital beider Basel.
This work was supported by the Swiss Federal Office of Public Health [500.005-7_2]. The funding body had no influence on the design of the study, the collection, analysis, and interpretation of the data, or the writing of the manuscript.
Ethics approval and consent to participate
The cantonal ethics committee Zurich, Switzerland, confirmed that no ethic approval was required for this study (BASEC Nr. Req-2019–00163).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Fridrich, A., Imhof, A. & Schwappach, D.L.B. Compliance with the surgical safety checklist in Switzerland: an observational multicenter study based on self-reported data. Patient Saf Surg 16, 17 (2022). https://doi.org/10.1186/s13037-022-00327-8
- Patient safety
- Measurement methods