Frequency of use and knowledge of the WHO-surgical checklist in Swiss hospitals: a cross-sectional online survey
Patient Safety in Surgery volume 7, Article number: 36 (2013)
The WHO-surgical checklist is strongly recommended as a highly effective yet economically simple intervention to improve patient safety. Its use and potentially influential factors were investigated as little data exist on the current situation in Switzerland.
A cross-sectional online survey with members (N = 1378) of three Swiss professional associations of invasive health care professionals was conducted in German, French, and Italian. The survey assessed use of, knowledge of and satisfaction with the WHO-surgical checklist. T-Tests and ANOVA were conducted to test for differences between professional groups. Bivariate correlations were computed to test for associations between measures of knowledge and satisfaction.
1090 (79.1%) reported the use of a surgical checklist. 346 (25.1%) use the WHO-checklist, 532 (38.6%) use the Swiss Patient Safety Foundation recommendations to avoid Wrong Site Surgery, and 212 (15.7%) reported the use of other checklists. Satisfaction with checklist use was generally high (doctors: 71.9% satisfied, nurses: 60.8% satisfied) and knowledge was moderate depending on the use of the WHO-checklist. No association between measures of subjective and objective knowledge was found.
Implementation of a surgical checklist remains an important task for health care institutions in Switzerland. Although checklist use is present in Switzerland on a regular basis, a substantial group of health care personnel still do not use a checklist as a routine. Influential factors and the associations among themselves need to be addressed in future studies in more detail.
Patient safety has become an important issue worldwide since the Institute of Medicine published its article “To Err Is Human” in 1999 . Since then, several interventions have been developed and established to improve patient safety [2–4]. Surgery is one major focus of health care improvement. In a recent, restrictive systematic review of studies on adverse events in surgery, Anderson at al.  found that adverse events occurred in 14.4% of patients. 5.2% of those events were judged as potentially preventable. Surgery has also been identified as a major predictor of patient reported hospital-acquired infection across 11 countries . The World Health Organization’s (WHO) surgical checklist is an effective intervention to decrease morbidity and mortality in surgical procedures [7–9]. The checklist is now strongly recommended for adoption by international experts as a highly effective yet economically simple intervention .
However, implementation of a checklist alone does not necessarily lead to improvements in safety. Compliance with the checklist use is a prerequisite for the checklist to be effective . Generally, compliance rates are often found to be below 100% [8, 12–14]. Health care professionals’ (HCP) knowledge also plays a crucial role for correct and compliant checklist use [7, 11, 15, 16]. Vats et al.  explicitly identified lack of knowledge as one important aspect for not correctly using the checklist. The better people are educated about how and why to use the surgical checklist, the more compliant they are. Both, subjective and objective levels of knowledge are important for changes in behaviour and thus successful implementation of interventions [17, 18].
Shared knowledge and beliefs among HCPs are important for successful teamwork and cooperation and implementation of high safety standards, in particular in multiprofessional action-teams, like OR teams [12, 19–24]. Recent research suggests that nurses often have more positive attitudes towards the checklist as compared to doctors and surgeons [22, 23]. Thus, one essential prerequisite for successful checklist is the harmonization of checklist acceptance and knowledge among OR team members. Taken together, the effects of the use of surgical checklists on patient outcome have been widely acknowledged and relevant determinants for successful implementation have been identified. However, little data exist on the current situation in Switzerland. Available studies either address special settings  and samples (also see ) or are restricted to one hospital .
Hence, the aim of the present study was to evaluate checklist use and potentially influential factors in Switzerland. We investigated use, knowledge of, and satisfaction with the surgical checklist in Switzerland in a sample of different professional groups working together in the OR. Subjective and objective knowledge were both assessed as important factors influencing compliance. Levels of satisfaction were assessed, because we hypothesized that knowledge would not only be related to better compliance rates but also to higher levels of satisfaction.
A cross-sectional online-survey study was conducted by the Patient Safety Foundation in Switzerland in December 2012. The EFS-Survey Software tool was used to program and administer the computer-based survey. The questionnaire was developed in German and then translated into French and Italian by professional translators. Translations were approved by HCP native speakers. The survey sample consisted of all members of three Swiss professional associations of invasive HCPs (doctors, nurses, nurses with special education in anaesthesia nursing or intensive care, and surgical technicians). Nurses were identified from the mailing list of all registered members of two professional associations. All doctors were members of the Foederatio Medicorum Chirurgicorum Helvetica, the holding organization of all sub-organisations of invasive specialties in Switzerland. Subjects were invited for participation by individual emails in which aim and procedure of the study were explained. Participants obtained a personal URL to the online-questionnaire and could then choose their preferred language (Italian, German, or French). Every URL could only be used once, hence, participation was only possible once per person. Two reminders were sent by mail with an interval of 1 week and 2 weeks, respectively to non-responders. Completion of the questionnaire was regarded as informed consent. Ethical approval is not necessary for this type of study in Switzerland.
The survey was developed to assess use of, knowledge of and attitudes towards the WHO-surgical checklist. It was developed on the basis of extensive review of the literature. The survey consisted of three conceptual parts. The first part referred to the general use of surgical checklists in the OR (e.g., “which of the following checklists do you use?”) and relative frequency of use (rated on a 0-100% scale subdivided into 6 categories). Satisfaction with use was also assessed in part one and rated on a 5-point-Likert-scale ranging from “very unsatisfied” to “very satisfied”. In the second part, subjective and objective knowledge about the WHO-checklist was assessed. Subjects were presented 10 statements regarding the checklist (4 correct and 6 incorrect items) and were asked to indicate which of the items were correct or false. They rated their subjective knowledge about the checklist on a 5-point-Likert-scale from “very bad” to “very good”. In the third part, attitudes, norms and behavioural control towards checklist use [27, 28] were assessed (not reported in this analysis). The survey was pre-tested with individuals from all professions and languages. Based on a professional translation, the survey was additionally validated by native speakers. The survey was not back translated.
Survey data were analysed using descriptive statistics. For objective knowledge, a sum score was calculated based on the number of correctly answered questions out of 10. T-Tests and ANOVA were conducted to test for differences in frequency of use, satisfaction, and knowledge between professional groups. Bivariate correlations were computed to test for associations between measures of knowledge and satisfaction. All analyses were conducted using STATA v12.1 .
Of the 5928 invited HCPs 1378 completed the survey (23.3% response rate). Sample characteristics are presented in Table 1.
Among responders, 1090 (79.1%) reported the use of a surgical checklist in their OR. 346 (25.1%) participants use the WHO-checklist, 532 (38.6%) participants use the Swiss Patient Safety Foundation recommendations to avoid Wrong Site Surgery which is based on the Universal Protocol, and 212 (15.7%) reported the use of other checklists. 288 (20.9%) indicated to use no checklist at all. Addressing the frequency of use, Figure 1 shows that 84.1% of doctors and 79.7% of nurses who use a checklist use it virtually in all procedures. The difference in reported use between groups is not significant (t(1088) = 1.18, n.s.; M = 5.7, SD = 0.8 for doctors, M = 5.7, SD = 0.7 for nurses).
Satisfaction with checklist use
Satisfaction with checklist use was moderate (doctors: 71.9% satisfied, nurses: 60.8% satisfied). Figure 2 depicts satisfaction with checklist use at the primary workplace for both professional groups. Level of satisfaction of doctors (M = 2.6, SD = 0.7) is significantly higher compared to nurses (M = 2.4, SD = 0.8; t(1088) = 3.1; p < .05).
Knowledge regarding WHO-checklist
We report subjective and objective knowledge concerning the WHO-checklist, separately for individuals who work with the WHO-checklist at their primary workplace and those who do not (for wording of questions assessing objective knowledge see Table 2).
On average, in the group of individuals who use the checklist, doctors answered 7.6 (SD = 1.4) and nurses 7.4 (SD = 1.2) out of 10 questions correctly. In the group of individuals who do not use the WHO-checklist, doctors, on average, responded to 7.4 (SD = 1.4) and nurses to 7.0 (SD = 1.5) out of 10 questions correctly. The results show that levels of knowledge were significantly different between doctors and nurses as well as between individuals working with the checklist and those who do not (professional group: F(1;625) = 4.4; p < .05, WHO-checklist use: F(1;625) = 8.2; p < .05). Note, however, that both variables explained only about 2% of variance. The practical relevance of the differences is small.
For subjective knowledge, different results emerged. In the group of individuals not working with the checklist, 98.4% of the doctoral staff and 97.8% of the nursing staff evaluated their knowledge as being bad. In the group working with the checklist, almost the opposite picture emerged: 80.2% of the doctoral staff and 75.8% of the nursing staff evaluated their knowledge as being good. Differences were statistically significant only between users of the WHO-checklist and non-users (WHO-checklist use: F(1;625) = 106.7; p < .05). For subjective knowledge, WHO-checklist use explained about 18% of variance. Hence, working with the WHO-checklist was pivotal for self-rated knowledge in both groups. For objectively assessed knowledge, both, WHO-checklist use and professional group affiliation significantly influenced the outcome.
In a last step of the analyses, associations between subjective and objective knowledge and satisfaction with checklist-use were examined for checklist use separately. Results for the bivariate correlations are depicted in Table 3.
As can be seen from Table 3, the correlations between satisfaction, objective knowledge and subjective knowledge are very small. None of the tested correlations were statistically significant.
In the present study we investigated the use and knowledge of the WHO surgical checklist in Switzerland. To the best of our knowledge, the study is the first providing a comprehensive overview including all parts of Switzerland as well as different professional groups working together in the OR.
The majority of participants reported the systematic use of a surgical checklist at their primary workplace with no significant differences between the professions. In their study, Fourcade et al. report compliance rates about 92%, however with completion rates being as low as 61% [8, 12]. In their systematic literature review, Borchard et al. report compliance rates ranging from 12% to 100% . Hence, although the results from the present study are comparable to results from the literature, checklist use is still no routine and improvement is needed. Literature shows that one crucial aspect of improving patient safety with the use of a surgical checklist is 100% compliance, including, urgent surgeries [11, 30]. Hence, from the present study the conclusion seems warranted that even though surgical checklists seem to be widely used by some professional groups in Switzerland, still effort and time need to be invested to establish a reliable and exhaustive use for all procedures.
Overall, both professional groups reported moderate satisfaction. This indicates that in ORs where the checklist has been implemented, acceptance is present. But satisfaction with checklist use is likely to be overestimated in the present study. Considering participants’ professional position and years of job experience we infer that individuals in the sample hold influential positions and probably have the opportunity to shape organizational structures and standards. Still up to 16% of nurses and 13% of doctors reported being unsatisfied. One may conclude that individuals in less influential positions might report even lower levels of satisfaction. It is known from psychological research, that perceived control is associated with higher levels of satisfaction (see for example ). Hence, one might infer, that individuals in influential positions experience higher levels of control, and, hence might report higher levels of satisfaction. However, this remains speculative and future studies need to investigate predictors of satisfaction with checklist in more detail. Significant differences in levels of satisfaction emerged between professional groups. Doctors reported higher levels of satisfaction than nurses. Group differences in the OR are known from other OR-relevant topics, e.g. perception of teamwork [19, 22, 24]. The origin of these differences remains unclear.
In the analyses of knowledge regarding the WHO-checklist, we found significant differences between WHO-checklist users and non-users and a difference between professional groups. Individuals working with the WHO-checklist achieved significantly higher levels of knowledge than individuals not working with the WHO-checklist. Although doctors achieved higher levels of knowledge than nurses, the effect was too small to be of practical relevance. Note that no inferences about causality can be made. Correlations reflect associations between variables. However, a correlation between variables does not imply that one causes the other. The reason for or the direction of the association between variables is not explained by correlations. Hence, whether better knowledge leads to checklist use or checklist use leads to better knowledge remains unclear.
In a last step, the association between subjective knowledge, objective knowledge, and satisfaction was assessed for both professional groups. No significant association could be found between any of the constructs in both groups. It is known from social cognitive research that not only objectively assessable knowledge but also subjective levels of knowledge are an important factor for the evaluation of situations, attitudes and behaviour . Subjective representations are often of behavioural relevance (e.g.,  on aging). As a consequence, subjective evaluation of one’s own expertise can be decisive for developing the motivation to take part in trainings or further education concerning the correct use of checklists (e.g.,). With no association between the constructs, as found in the present study, the possibility of a gap between needed and claimed education and training or an overly excessive use of education increases.
This result has important implications for practice: with no association between self-evaluation and objective assessment, employees cannot reliably self-elect themselves for training when needed, because of the lack of adequate assessment of their own level of expertise. In case of overestimation this imposes a possible threat on patients, in case of underestimation, this leads to a waste of resources. The importance of organizational commitment in the process of checklist implementation and the promotion of compliance becomes evident. Without reliable self-management due to a lack of valid self-evaluation, an organization is in charge of ensuring that employees obtain training and education on a regular, institutionalized basis to improve patient safety. Note, however, because subjective knowledge was assessed with one item only, the effect of measurement error also needs to be considered.
The present study has some limitations. First we focused on the WHO-checklist in survey items. The assessment of use and knowledge of other checklists may be underestimated. Because surgical checklists contain similar items and have similar objectives, individuals working with other checklists might have profound knowledge about checklists that has not been assessed in the present study, yet is an important aspect of patient safety in surgery as well. Second, although we assessed compliance in terms of the frequency of use, we have no information about the quality of use. Using the checklist does not exhibit any information about the quality of use as the study by Cullati et al. indicates . Third, our response rate was only moderate. Quantitatively, this response rate is in accordance with similarly designed studies in health care . Although different professional groups and geographical regions are well represented in our sample, we have no information about reasons for non-participation and checklist use among non-responders. However, it is likely that HCP working with an interest in patient safety or the surgical checklist were more likely to respond to our survey. Thus, our results probably overestimate checklist dissemination in Switzerland.
Taken together, what do the results of the present study say about frequency of use, knowledge of, and satisfaction with the WHO-surgical checklist in Switzerland?
According to the results of the present study, checklist use is present in Switzerland on a regular basis. However, a substantial group of HCP’s still does not use checklists as a routine. Satisfaction with checklist use is moderate. Improvement of satisfaction could be used as motivation to fully and comprehensively implement the checklist. Additionally, against the background that knowledge is crucial for successful implementation, levels of knowledge in the present study reveal need for improvement. Even for individuals working with checklists, levels of knowledge are far from perfect. Differences between groups indicate that knowledge acquisition is not systematically supported but is left to individuals. Much more attention needs to be paid to staff’s training and education concerning checklist use.
We conclude that the results provide valuable insight into checklist use in Switzerland.
Institute of Medicine: To err is human. Building a safer health system. 2000, Washington, DC: The National Academy Press
Shekelle P, Wachter R, Pronovost P, Schoelles K, McDonald KM, Dy S: Making Health Care Safer II: An updated critical analysis of the evidence for patient safety practices. Comparative Effectiveness Review No.211. 2013, Rockville, MD: AHRQ Publication No 13-E001-EF
Pronovost P, Needham D, Berenholtz S, Sinopoli D, Chu H, Cosgrove S: An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU. N Engl J Med. 2006, 355: 2725-2732. 10.1056/NEJMoa061115.
Schwappach DL, Conen D: Patient safety–who cares?. Swiss Med Weekly. 2012, 142: w13634-
Anderson O, Davis R, Hanna GB, Vincent CA: Surgical adverse events: a systematic review. Am J Surg. 2013, 206: 253-262. 10.1016/j.amjsurg.2012.11.009.
Schwappach DL: Frequency of patient-reported infections among sicker adults in high-income countries: an international perspective. Am J Infect Control. 2013, 41: 174-176. 10.1016/j.ajic.2012.02.011.
van Klei WA, Hoff RG, van Aarnhem EE, Simmermacher RK, Regli LP, Kappen TH: Effects of the introduction of the WHO "Surgical Safety Checklist" on in-hospital mortality: a cohort study. Ann Surg. 2012, 255: 44-49. 10.1097/SLA.0b013e31823779ae.
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP: A surgical safety checklist to reduce morbidity and mortality in a global population. N Eng J Med. 2009, 360: 491-499. 10.1056/NEJMsa0810119.
Sewell M, Adebibe M, Jayakumar P, Jowett C, Kong K, Vemulapalli K: Use of the WHO surgical safety checklist in trauma and orthopaedic patients. Int Orthop. 2011, 35: 897-901. 10.1007/s00264-010-1112-7.
Shekelle PG, Pronovost PJ, Wachter RM, McDonald KM, Schoelles K, Dy SM: The Top Patient Safety Strategies That Can Be Encouraged for Adoption Now. Ann Intern Med. 2013, 158: 365-368. 10.7326/0003-4819-158-5-201303051-00001.
Borchard A, Schwappach DLB, Barbir A, Bezzola P: A systematic review of the effectiveness, compliance, and critical factors for implementation of safety checklists in surgery. Ann Surg. 2012, 256: 925-933. 10.1097/SLA.0b013e3182682f27.
Fourcade A, Blache JL, Grenier C, Bourgain JL, Minvielle E: Barriers to staff adoption of a surgical safety checklist. BMJ Qual Saf. 2012, 21: 191-197. 10.1136/bmjqs-2011-000094.
Vats A, Vincent CA, Nagpal K, Davies RW, Darzi A, Moorthy K: Practical challenges of introducing WHO surgical checklist: UK pilot experience. BMJ. 2010, 340: b5433-10.1136/bmj.b5433.
Cullati S, Le Du S, Raë AC, Micallef M, Khabiri E, Ourahmoune A: Is the Surgical Safety Checklist successfully conducted? An observational study of social interactions in the operating rooms of a tertiary hospital. BMJ Quality & Safety. 2013, doi:10.1136/bmjqs-2012-001634
Bliss LA, Ross-Richardson CB, Sanzari LJ, Shapiro DS, Lukianoff AE, Bernstein BA: Thirty-Day Outcomes Support Implementation of a Surgical Safety Checklist. J Am Coll Surg. 2012, 215: 766-776. 10.1016/j.jamcollsurg.2012.07.015.
Conley DM, Singer SJ, Edmondson L, Berry WR, Gawande AA: Effective surgical safety checklist implementation. J Am Coll Surg. 2011, 212: 873-879. 10.1016/j.jamcollsurg.2011.01.052.
Hovlid E, Bukve O, Haug K, Aslaksen AB, von PC: Sustainability of healthcare improvement: what can we learn from learning theory?. BMC Health Serv Res. 2012, 12: doi:10.1186/1472-6963-12-235
Martin IM, Bender H, Raish C: What motivates individuals to protect themselves from risks: the case of wildland fires. Risk Anal. 2007, 27: 887-900. 10.1111/j.1539-6924.2007.00930.x.
Brock D, Abu-Rish E, Chiu CR, Hammer D, Wilson S, Vorvick L: Interprofessional education in team communication: working together to improve patient safety. BMJ Quality & Safety. 2013, doi:10.1136/bmjqs-2012-000952
Lingard L, Espin S, Rubin B, Whyte S, Colmenares M, Baker GR: Getting teams to talk: development and pilot implementation of a checklist to promote interprofessional communication in the OR. Qual Saf Health Care. 2005, 14: 340-346. 10.1136/qshc.2004.012377.
Lingard L, Espin S, Whyte S, Regehr G, Baker GR, Reznick R: Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Saf Health Care. 2004, 13: 330-334. 10.1136/qshc.2003.008425.
Makary MA, Sexton JB, Freischlag J, Holzmueller C, Millman EA, Rowen L: Operating room teamwork among physicians and nurses: teamwork in the eye of the beholder. J Am Coll Surg. 2006, 202: 746-752. 10.1016/j.jamcollsurg.2006.01.017.
Takala RS, Paunihao SL, KOTKANSALO A, Helmio P, Blomgren K, HELMINEN M: A pilot study of the implementation of WHO surgical checklist in Finland: improvements in activities and communication. Acta Anaesthesiol Scand. 2011, 55: 1206-1214. 10.1111/j.1399-6576.2011.02525.x.
Walker IA, Reshamwalla S, Wilson IH: Surgical safety checklists: do they improve outcomes?. Br J Anaesth. 2012, 109: 47-54. 10.1093/bja/aes175.
Lübbeke A, Hovaguimian F, Wickboldt N, Barea C, Clergue F, Hoffmeyer P: Effectiveness of the surgical safety checklist in a high standard care environment. Med Care. 2013, 51: 425-429. 10.1097/MLR.0b013e31828d1489.
Kaderli R, Hertig RC, Laffer U, Businger AP: Surgical Safety Checklists in Operative Medicine in Switzerland. Arch Clin Exp Surg. 2012, 1: 158-167.
Fishbein M, Ajzen I: Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research. 1975, Reading, MA: Addison-Wesley
Ajzen I, Manstead ASR: Changing health-related behaviors: An approach based on the theory of planned behavior. The scope of social psychology: Theory and applications. Edited by: van den-Bos K, Hewstone M, de Wit J, Schut H, Stroebe M. 2007, New York: Psychology Press, 43-63.
StataCorp: Stata Statistical Software: Release 12. 2011, College Station, TX: StataCorp LP
Weiser TG, Haynes AB, Dziekan G, Berry WR, Lipsitz SR, Gawande AA: Safe Surgery Saves Lives Investigators and Study Group, Effect of a 19-item surgical safety checklist during urgent operations in a global patient population. Ann Surg. 2010, 251: 976-980. 10.1097/SLA.0b013e3181d970e3.
Lachman M, Röcke C: The rise and fall of control beliefs and life satisfaction in adulthood: Trajectories of stability and change over ten years. Aging and cognition: Research methodologies and empirical advances. Decade of Behavior (2000–2010). Edited by: Bosworth H, Hertzog C. 2009, Washington DC, US: American Psychological Association, 143-160.
Hines JC, Touron DR, Hertzog C: Metacognitive influences on study time allocation in an associative recognition task: an analysis of adult age differences. Psychol Aging. 2009, 24: 462-475.
Hess TM, Leclerc CM, Swaim E, Weatherbee SR: Aging and everday judgements: The impact of motivational and processing resource factors. Psychol Aging. 2009, 24: 735-740.
Bandura A: Self-efficacy: Toward a unifying theory of behavioral change. Psychol Rev. 1977, 84: 191-215.
Sheehan KB: E-mail survey response rates: a review. J Comput-Mediated Commun. 2001, 6: 0-
Parts of the preparation of this article were supported by the Federal Office of Public Health, Switzerland (BAG).
The authors declare that they have no competing interests.
AM and DS wrote the manuscript. AM conducted statistical analyses. DS and PB designed the study and supervised the research. All authors read and approved the final manuscript.
About this article
Cite this article
Mascherek, A.C., Schwappach, D.L. & Bezzola, P. Frequency of use and knowledge of the WHO-surgical checklist in Swiss hospitals: a cross-sectional online survey. Patient Saf Surg 7, 36 (2013). https://doi.org/10.1186/1754-9493-7-36