- Open Access
The incidence, root-causes, and outcomes of adverse events in surgical units: implication for potential prevention strategies
Patient Safety in Surgery volume 5, Article number: 13 (2011)
We need to know the scale and underlying causes of surgical adverse events (AEs) in order to improve the safety of care in surgical units. However, there is little recent data. Previous record review studies that reported on surgical AEs in detail are now more than ten years old. Since then surgical technology and quality assurance have changed rapidly. The objective of this study was to provide more recent data on the incidence, consequences, preventability, causes and potential strategies to prevent AEs among hospitalized patients in surgical units.
A structured record review study of 7,926 patient records was carried out by trained nurses and medical specialist reviewers in 21 Dutch hospitals. The aim was to determine the presence of AEs during hospitalizations in 2004 and to consider how far they could be prevented. Of all AEs, the consequences, responsible medical specialty, causes and potential prevention strategies were identified. Surgical AEs were defined as AEs attributable to surgical treatment and care processes and were selected for analysis in detail.
Surgical AEs occurred in 3.6% of hospital admissions and represented 65% of all AEs. Forty-one percent of the surgical AEs was considered to be preventable. The consequences of surgical AEs were more severe than for other types of AEs, resulting in more permanent disability, extra treatment, prolonged hospital stay, unplanned readmissions and extra outpatient visits. Almost 40% of the surgical AEs were infections, 23% bleeding, and 22% injury by mechanical, physical or chemical cause. Human factors were involved in the causation of 65% of surgical AEs and were considered to be preventable through quality assurance and training.
Surgical AEs occur more often than other types of AEs, are more often preventable and their consequences are more severe. Therefore, surgical AEs have a major impact on the burden of AEs during hospitalizations. These findings concur with the results from previous studies. However, evidence-based solutions to reduce surgical AEs are increasingly available. Interventions directed at human causes are recommended to improve the safety of surgical care. Examples are team training and the surgical safety checklist. In addition, specific strategies are needed to improve appropriate use of antibiotic prophylaxis and sustainable implementation of hygiene guidelines to reduce infections.
Adverse events are a major source of morbidity and mortality. Patient record review studies showed that the incidence of adverse events (AEs) varied from 3% to 17% among hospitalized patients [1–12]. Approximately 50% of the AEs were judged to be preventable. Most of the AEs resulted in minor or temporary disability, but a proportion of the AEs, 4% to 21%, contributed to death. All these studies have shown that a high percentage of AEs are attributable to surgical specialties, ranging from 51% to 77% [1, 2, 4, 8–10, 13, 14]. Previous population-based record review studies that reported on AEs attributable to surgical specialties in detail are now more than ten years old [13, 14]. Since then both surgical techniques and quality assurance have developed rapidly. Surgical techniques have been improved, increasing the opportunities for successful treatment of complex diseases. However, this also increases the potential for errors that can result in patient harm, leading to disability or death [15, 16]. In the meantime, many solutions designed to reduce the risk associated with surgery have been developed.
Recent data are needed to provide insight into the scale, nature, causes and preventability of surgical AEs and to identify those prevention strategies which can reduce the main causes of surgical AEs. A large patient record review study on the occurrence of AEs was performed in order to assess the national incidence of AEs among Dutch hospitalized patients in 2004 [17, 18]. We use the data from this study in our paper in order to present a detailed description of surgical AEs.
Our research questions were: (1) what is the incidence, consequences, nature, and preventability of surgical AEs among hospitalized patients, and (2) what are the causes of, and potential prevention strategies for, surgical AEs?
Study design and setting
We have performed a patient record review study in a random sample of 21 Dutch hospitals: 4 university, 6 tertiary teaching and 11 general hospitals. From each hospital we randomly selected 200 admissions (>24 hours stay) of discharged patients and 200 admissions of deceased hospital patients in 2004 - or less if the total number of patients who died in 2004 was lower. The study was carried out between August 2005 and October 2006. We selected admissions for 2004 in order to obtain a complete overview of the patient information, including a 1-year period after discharge or death of the patient .
In total, 3,983 admissions of deceased hospital patients and 3,943 admissions of discharged patients (>24 hours stay) were reviewed, excluding admissions in psychiatry, obstetrics and for children younger than one year-old. A large sample of deceased patients was included to assess more precisely the occurrence of potentially preventable deaths in hospitals. All figures in this paper were corrected for the sampling frame and were representative of the Dutch population of hospitalized patients . The methods were based on previous AE studies in other countries and have been described in detail elsewhere . The study protocol was approved by the Amsterdam VU University Medical Center Ethics Board.
The hospital records of the selected admissions were reviewed by a team of 66 nurses and 55 medical specialists. The eligibility criteria for medical specialists to act as a reviewer were: more than 10 years post graduate general clinical experience; a good reputation among colleagues; that they had been retired for no longer than 5 years; that they had experience or affinity with the analysis of incidents, complaints and errors in clinical care; and that they were available for at least one day per week.
An additional expert panel of 18 medical specialists from several sub specialties was recruited to offer expert advice about accepted clinical practice during the review process. These specialists were authorities within their specialization and were recruited by the scientific associations of medical specialists. The panel consisted of specialists from all medical disciplines involved in the study.
The nurses and medical specialists followed a one-day training course in small groups comprising a maximum of 12 participants led by one researcher and one experienced nurse or medical specialist, respectively. During the training, the study protocol, definitions, and electronic review forms were explained and examples of AEs were discussed. The reviewers practiced on examples of cases and with the review forms. They were provided with a review manual in which the research protocol, instruments, and definitions were defined . After one month of reviewing, they undertook a half-day training session to discuss their problems concerning the review process. The reviewers were also updated with the latest insights about the review process. These training sessions were repeated frequently during the data collection period. The problems discussed were collected and noted in a regularly updated Frequently Asked Questions (FAQ) document, which was distributed to all reviewers.
Structured review of patient records
The nursing, medical and, if available, outpatient records of the 7,926 sampled hospital admissions were reviewed in a three stage review process. In the first stage, the nurse reviewers screened the records by using 18 explicit screening criteria indicating potential AEs (Appendix A).
In the second stage of the review process, two medical specialists independently reviewed the records screened positive by the nurses in stage one (4,317 patient records). During the previous stage, nurses indicated which medical specialty would be most suitable for reviewing each particular record. Two physician reviewers from the specialty indicated reviewed each record independently and determined whether an AE had occurred.
Records with screening criteria concerning surgical care were reviewed by two surgeons. They used a standardized procedure with a structured electronic review form to determine whether an AE had occurred and to what degree it was preventable. The determination of an AE was based on three criteria: (1) an unintended physical and/or mental injury; which (2) resulted in temporary or permanent disability, death or prolongation of hospital stay, and; was (3) caused by health care management rather than the patient's disease (Appendix A) [1–3, 8, 17]. Preventability was defined as care that fell below the current professional standards and expected performance for practitioners or systems. Preventability was measured on a six-point scale (one = no preventability and six = definite preventability). Consistent with most previous international studies, we used a score of one to three to indicate that AEs were not preventable and a score of at least four to indicate that AEs were preventable .
If there was disagreement about the presence and/or preventability of an AE between the two independent surgeon reviewers, they started a procedure to achieve a consensus (stage 3). If the two surgeons could not reach a consensus, a third surgeon reviewer with access to all the information determined the final judgment.
If an AE was identified, the consequences, most responsible specialty, causes and potential prevention strategies were assessed. Surgical AEs were defined as AEs attributable to surgical treatment and care processes. The surgeon reviewers classified the surgical AEs by clinical procedure involved, such as diagnostic process, surgical procedure, drug/fluid, medical procedure, other clinical management, discharge, and other. The consequences were defined as: a prolonged hospital stay, extra treatment, a readmission to the hospital, extra outpatient care, a temporary or permanent disability at discharge, and death as a result of an AE. The consequences of surgical AEs were also classified by the type of injury, such as: bleeding, infection, shock, thrombosis, necrosis, fistula forming, and abnormal wound healing. The classification by injury was according to the national reporting system of adverse outcomes developed by the Association of Surgeons in The Netherlands [19, 20]. For each AE, the reviewers indicated all consequences.
In addition, the underlying causes of AEs were assessed. An AE arises often due to several causal factors, including technical, organisational, human, and patient-related factors. For each AE, the surgeon reviewers selected one or more causes. The reviewers selected all causes that contributed to the occurrence of the AE. They used a recognized taxonomy of root causes: the Eindhoven Classification Model of PRISMA-Medical, a root cause analysis tool [21, 22]. The categories of the taxonomy are:
Human factors which are, skill-based, for example failures in the performance of highly developed skills, or, rule-based, for example an incorrect fit between an individual's training or education and a particular task, or knowledge-based, for example inadequate application of existing knowledge;
organizational factors, for example inadequate or unavailable protocols, management priorities, inadequate transfer of information and cultural aspects;
technical factors, for example material defects, failures due to poor design of equipment, software, labels or forms;
patient-related factors, for example, co-morbidity, age, and treatment compliance .
Finally, for all preventable AEs, potential prevention strategies were selected. The categories were based on PRISMA and the Canadian patient record review study [1, 22]. The review form distinguished ten prevention strategies: quality assurance/peer review, training, evaluation, procedures, motivation, information and communication, technology/equipment, personnel, scaling up, and financial investment. For each AE, the surgeon reviewers could select one or more potential prevention strategy. The reviewers selected the causes and potential prevention strategies based on information in the patient record and on their perception of the situation .
The incidence, preventability, nature, consequences, causes and potential prevention strategies of surgical AEs were analyzed using descriptive statistics and frequency tables. To convert the study sample into results representative of the Netherlands, a weighting factor was used to correct for over-representation of patients admitted to a university hospital and patients who died in hospital in the study sample. The weighting factor was the inverse of the probability of being included in the sample and was calculated by dividing the representation of a group in the population by the representation of this same group in the study sample . All statistical analyses were performed using SPSS 14.0.
For all the comparisons of incidence rates, consequences and causes, tests for the comparison of proportions in two independent groups were used, corrected for binomial distribution .
Incidence and preventability
In the 7,926 reviewed patient records, 744 AEs were found. Using the weighting factor for over-representation of deceased patients and hospital type, the results showed that surgical AEs occurred in 3.6% of hospital admissions and accounted for 64.5% of all AEs (Table 1). The incidence rate of surgical AEs is significantly higher than the incidence rate of non-surgical AEs (2.1%). Of all surgical AEs, 40.5% were judged to be preventable. Table 2 presents examples of surgical AEs identified in this study.
Surgical AEs contributed less often to patients' deaths compared to other types of AEs (6.5% [5.3% -7.9%] vs. 13.6% [10.5% - 17.5%]; z = 2.47; P <.01) (Figure 1). The other consequences of surgical AEs were more severe compared to other types of AEs. Surgical AEs more often led to extra interventions or treatments (89.4% [95% CI, 84.6%-92.8%] vs. 76.7% [68.1%-83.5%]; z = 3.76; P <.01), disability at discharge (33.7% [27.2% - 40.9%] vs. 14.6% [8.9% - 23.1%]; z = 4.54; P <.01), readmissions to the hospital (28.8% [22.6% - 35.9%] vs. 14.7% [9.0% - 23.1%]; z = 3.32; P <.01), prolonged hospital stay (48.9% [41.9% - 56.1%] vs. 39.4% [30.8% - 48.8%]; z = 2.02; P <.05), and more outpatient visits (25.6% [19.7% - 32.4%] vs. 9.7% [5.2% - 17.5%]; z = 4.04; P <.01).
More than half of the AEs attributable to anesthesiology, plastic surgery and orthopedics were judged to be preventable (Table 3). AEs attributable to vascular surgery (23.3%), anesthesiology (22.2%), heart/thorax surgery (19.2%), and plastic surgery (18.2%) contributed relatively often to permanent disability including death.
The AEs attributable to surgical specialties were classified by clinical procedure (Table 4). Most of them were a result of surgical procedures (83.1%). Some surgical AEs were a result of medical procedures (5.5%), for instance urinary tract infection by bladder catheterization and lung bleeding after insertion of a Swann Ganz catheter. 3.7% of the surgical AEs were drug-related, such as administering the wrong type of medication, under- or overdoses of medication, or adverse drug reactions. Surgical AEs classed as 'other clinical management' (2.8%) were related to insufficient post operative care, for example inadequate administration of gastro-enteral feeding resulting in aspiration or a liver abscess drain becoming disconnected, resulting in sepsis. Examples of diagnosis-related surgical AEs (2.5%) were: 'missed intra-abdominal perforation' which resulted in a sepsis, 'missed incarcerated inguinal hernia', and 'missed appendicitis'. All surgical AEs related to 'other clinical management', the diagnostic process and discharge procedure were judged to be preventable.
The most frequent injuries as a result of surgical AEs were: inflammation/infection (39.3%); bleeding/hematoma (23.1%); injury by mechanical/physical or chemical cause (22.1%); and other functional impairment (16.5%), like urine retention, respiratory insufficiency, renal insufficiency, anuria, strangulation of the ileus, and dystrophy of the hand after an operation for carpal tunnel syndrome (Table 5). AEs with a high percentage of preventability were pressure ulcers, injury by mechanical/physical or chemical cause, fistula forming, shock, and ischemia/heart failure. Injuries like shock and ischemia/heart failure contributed relatively often to permanent disability including death.
Causes and prevention strategies
The surgeon reviewers selected 653 causal factors for the 367 surgical AEs found in this study. Causal factors of surgical AEs were judged to be predominantly human (65.2%) and patient-related (35.3%), and less often organizational (12.7%), and technical (4.4%) (Figure 2). Causes for surgical AEs were significantly more often related to human factors than in the other types of AEs (65.2% [95% CI, 58.1% - 71.7%] vs. 49.9% [40.8% - 59.0%]; z = 3.25; P <.01). Causes related to patients were less often the causal factor of surgical AEs compared to other types of AEs (35.3% [28.8% - 42.4%] vs. 44.4% [35.6% - 53.6%]; z = 1.91; P = .06).
The surgeon reviewers recommended 442 potential prevention strategies for all 150 surgical AEs that were judged to be preventable (Table 6). For more than 70% of the surgical AEs, quality assurance/peer review was selected as a potential prevention strategy. Other frequently selected prevention strategies were training (58.9%), evaluation (51.4%), and improving procedures (40.6%).
In this study the incidence rate of surgical AEs is 3.6% of all hospital admissions. Of all in-hospital AEs, 65% were attributable to surgical specialties of which 41% were considered to be preventable. The scale of surgical AEs is comparable to findings in previous studies [1, 2, 4, 8–10, 13, 14]. After years of improvements in patient safety  the scale of surgical AEs is still considerable. Surgical care is developing continuously. Over the past decades, the number and complexity of diagnostic procedures and therapeutic interventions have increased markedly. More diseases can be treated successfully and vulnerable patients are receiving surgical treatment more often. Surgical interventions by their nature are associated with a higher degree of risk. The increasingly complicated techniques and innovations, however, also enhance the potential for error [15, 16, 26].
Surgical AEs led more often to permanent disability, unplanned readmissions, unnecessary treatments and outpatient visits than other types of AEs. Our study showed that infection, bleeding and injury due to a mechanical/physical or chemical cause formed the largest group of injuries as a result of surgical AEs, reflecting the results of patient record review studies of more than ten years ago [13, 14]. The high percentage of infections and bleeding raises the question whether evidence-based prophylactic protocols and guidelines have been successfully implemented [13, 14]. More than two-thirds of the injuries related to a mechanical/physical or chemical cause was judged to be preventable. The surgeon reviewers noticed that an inaccurately performed procedure was a major contributing factor to injuries by puncture or perforation of other organs, such as nerves, vessels and bowels. Moreover, specific techniques that are not carried out according to the latest guidelines resulted in AEs such as leakage and wound dehiscence. Also the inadequate application of new techniques, such as endoscopic procedures, and procedures that demand specific expertise and experience, for example vessel surgery, resulted in AEs.
In this study, causal factors of surgical AEs were judged to be predominantly human factors (65%) and less often organizational (13%) or technical (4%). Given the high degree of preventability of surgical AEs that resulted in injury by mechanical/physical or chemical cause, the frequently recommended prevention strategies were: more training; improving procedures; and quality assurance.
Strengths and limitations
A strong aspect of the study is the large number of patient records that were reviewed systematically. The use of a random, stratified, sample of diverse patient admissions and a systematic screening process led to results representative of Dutch hospitals. Also, AE criteria are well known, which allows comparisons with other studies. A patient record review of hospitalized patients is by far the most applied and thoroughly studied method for the assessment of the occurrence and nature of AEs . The record review method has, however, some limitations. Because it depends on the completeness of the information that is recorded in the patient record, the amount of surgical AEs identified in this study could be underestimated. It is unknown whether the detection of AEs is equal for surgical and non-surgical AEs. If surgical AEs are easier to recognize in medical records, the difference between surgical and non-surgical AEs may be overestimated. Moreover, the inter-rater agreement for the judgment of AEs was fair for the assessment of AEs (κ = 0.25) and their preventability (κ = 0.40) .
Record review may not be the most accurate method to get an insight into the technical and organizational causal factors. Because technical and organizational factors are less often reported in the patient records, they may have been under-reported in this study . An approach that combines a record review with prospective methods in which clinical staff are interviewed about the origin of the AEs will give a more appropriate and complete picture of the organizational and technical causes. The combination of record review and interviews with clinical staff may compensate for the lack of information in patient records .
The aim of the Dutch Adverse Event Study was to measure a national incidence rate for hospital AEs. An in-depth analysis of surgical AEs based on the national study is hampered by the small numbers of AEs for some sub categories. The results of the categories with a small number of AEs should be interpreted with caution.
Implications for practice
Interventions to reduce surgical AEs based on evidence-based studies, systematic reviews and ongoing clinical trials are increasingly available. In Table 7, we present well-known interventions tailored to the main prevention strategies recommended in this study.
The interventions are focused both on technical and non-technical aspects of surgical care. For example, simulation training [29–31] and the concentration of certain procedures [32, 33] to improve the technical performance on the one hand, and medical team training and checklists to improve the communication between team members in the operation theatre, on the other [34–37]. Specific procedures to reduce infections comprise both consistently applying antibiotic prophylaxis, and better adherence to existing protocols and guidelines in the operation theatre, which includes issues such as hand disinfection, the number of persons in the operation theatre, the number of door movements, and the sterilization of instruments) [15, 38–43].
Quality assurance, i.e. monitoring of the performance of professionals by individuals in the same field, may take the form of morbidity and mortality conferences, a patient record review, reporting and learning from safety incidents, and evaluating the competence and performance of health care professionals with multisource feedback systems and portfolios [44–50].
Several interventions are incorporated into national safety campaigns, such as infection prevention, reporting and learning from safety incidents, medical team training and the surgical safety checklist [15, 51, 52].
Recommendations for future research
Not all interventions we suggested are evidence-based or evaluated for surgical care. Future research should evaluate the cost-effectiveness of the interventions, especially for surgical specialties. Several interventions are currently being evaluated in Dutch hospitals, such as medical team training, the surgical safety checklist, multisource feedback, and incident reporting. Some of the interventions have been familiar for decades, like protocols for hand hygiene and appropriate use of antibiotic prophylaxis. More research should be done to explore the barriers and drivers for sustainable implementation of patient safety interventions in health care.
Appendix A Definitions and outcome measures
Description of 18 screening criteria for potential adverse events 
Unplanned admission before index admission (admission reasons are related to the index admission)
Unplanned readmission after discharge from index admission
Hospital-incurred patient injury (Permanent or temporary injury obtained (acquired) during index admission)
Adverse drug reaction
Unplanned transfer from general care to (an) intensive care (unit)
Unplanned transfer to another acute care hospital (after unexpected deterioration of the patient)
Unplanned return to the operating room
Unplanned removal, injury or repair of organ during surgery
Hospital-acquired infection or sepsis
Other patient complication
Development of neurological deficit not present on admission
Cardiac or respiratory arrest
Injury related to abortion or delivery
Inappropriate discharge to home
Dissatisfaction with care documented in the medical record
Documentation or correspondence indicating litigation
Any other undesirable outcome not covered above
The determination of an adverse event was based on three criteria :
an unintended (physical and/or mental) injury which
results in temporary or permanent disability, death or prolongation of hospital stay, and is
caused by health care management rather than the patient's disease
To determine whether the injury was caused by health care management or the disease process a 6-point scale was used:
(Virtually) no evidence for management causation
Slight to modest evidence of management causation
Management causation not likely (less than 50/50, but 'close call')
Management causation more likely (more than 50/50, but 'close call')
Moderate to strong evidence of management causation
(Virtually) certain evidence of management causation
Causation scores of 4 to 6 were classified as adverse events.
The degree of preventability of the adverse events was measured on a 6-point scale:
(Virtually) no evidence for preventability
Slight to modest evidence of preventability
Preventability not quite likely (less than 50/50, but 'close call')
Preventability more than likely (more than 50/50, but 'close call')
Strong evidence of preventability
(Virtually) certain evidence of preventability
Adverse events with a preventability score of 4 to 6 were defined as preventable.
= Adverse event.
Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hébert P, Majumdar SR, O'Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R: The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004, 170: 1678-86. 10.1503/cmaj.1040498.
Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med. 1991, 324: 370-6. 10.1056/NEJM199102073240604.
Davis P, Lay-Yee R, Briant R, Ali W, Scott A, Schug S: Adverse events in New Zealand public hospitals I: occurrence and impact. N Z Med J. 2002, 115: U271-
Davis P, Lay-Yee R, Briant R, Ali W, Scott A, Schug S: Adverse events in New Zealand public hospitals II: preventability and clinical context. N Z Med J. 2003, 116: U624-
Leape LL, Brennan TA, Laird N, Lawthers AG, Localio AR, Barnes BA, Herbert L, Newhouse JP, Weiler PC, Haitt H: The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. N Engl J Med. 1991, 324: 377-84. 10.1056/NEJM199102073240605.
Michel P, Quenon JL, de Sarasqueta AM, Scemama O: Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals. BMJ. 2004, 328: 199-10.1136/bmj.328.7433.199.
Schioler T, Lipczak H, Pedersen BL, Mogensen TS, Bech KB, Stockmarr A, Svenning AR, Frolich A, Danish Adverse Event Study: [Incidence of adverse events in hospitals. A retrospective study of medical records]. Ugeskr Laeger. 2001, 163: 5370-8.
Thomas EJ, Studdert DM, Burstin HR, Orav EJ, Zeena T, Williams EJ, Howard KM, Weiler PC, Brennan TA: Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000, 38: 261-71. 10.1097/00005650-200003000-00003.
Vincent C, Neale G, Woloshynowych M: Adverse events in British hospitals: preliminary retrospective record review. BMJ. 2001, 322: 517-9. 10.1136/bmj.322.7285.517.
Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD: The Quality in Australian Health Care Study. Med J Aust. 1995, 163: 458-71.
Soop M, Fryksmark U, Koster M, Haglund B: The incidence of adverse events in Swedish hospitals: a retrospective medical record review study. Int J Qual Health Care. 2009, 21: 285-291. 10.1093/intqhc/mzp025.
Aranaz-Andres JM, Aibar-Remon C, Vitaller-Burillo J, Requena-Puche J, Terol-Garcia E, Kelly E, Gea-Velazquez de Castr MT, ENEAS work group: Impact and preventability of adverse events in Spanish public hospitals: results of the Spanish National Study of Adverse Events (ENEAS). Int J Qual Health Care. 2009, 21: 408-414. 10.1093/intqhc/mzp047.
Gawande AA, Thomas EJ, Zinner MJ, Brennan TA: The incidence and nature of surgical adverse events in Colorado and Utah in 1992. Surgery. 1999, 126: 66-75. 10.1067/msy.1999.98664.
Kable AK, Gibberd RW, Spigelman AD: Adverse events in surgical patients in Australia. Int J Qual Health Care. 2002, 14: 269-76. 10.1093/intqhc/14.4.269.
World alliance for patient safety: The second global patient safety challenge. Safe surgery saves lives. 2008, Geneva: World Health Organisation
Steel K, Gertman PM, Crescenzi C, Anderson J: Iatrogenic illness on a general medical service at a university hospital. New England Journal of Medicine. 1981, 304: 638-42. 10.1056/NEJM198103123041104.
Zegers M, de Bruijne MC, Wagner C, Groenewegen PP, Waaijman R, van der Wal G: Design of a retrospective patient record study on the occurrence of adverse events among patients in Dutch hospitals. BMC Health Serv Res. 2007, 7:
Zegers M, de Bruijne MC, Wagner C, Hoonhout LHF, Waaijman R, Smits M, Hout FAG, Zwaan L, Christiaans-Dingelhoff , Timmermans DRM, Groenewegen PP, van der Wal G: Adverse events and potentially preventable deaths in Dutch hospitals. Results of a retrospective patient record review study. Qual Saf Health Care. 2009, 18: 297-302. 10.1136/qshc.2007.025924.
Marang-van de Mheen PJ, Stadlander MC, Kievit J: Adverse outcomes in surgical patients: implementation of a nationwide reporting system. Qual Saf Health Care. 2006, 15: 320-324. 10.1136/qshc.2005.016220.
Master classification complication registration. http://orde.artsennet.nl/uri/?uri=AMGATE_6059_397_TICH_R187324105776887
van Vuuren W, Shea CE, van der Schaaf TW: The development of an incident analysis tool for the medical field. 1997, Eindhoven: Eindhoven University of Technology
van der Schaaf TW, Habraken MMP: PRISMA-Medical: a brief description. 2005, Eindhoven: Eindhoven University of Technology
Smits M, Zegers M, Wagner C, Timmermans DRM, Zwaan L, van der Wal G, Groenewegen PP: Exploring the causes of adverse events in hospitals and potential prevention strategies. Qual Saf Health Care. 2010, 19: 1-7.
Altman DG: Practical Statistics for Medical Research. 1991, London: Chapman & Hall
Longo DR, Hewett JE, Ge B, Schubert S: The Long Road to Patient Safety A Status Report on Patient Safety Systems. JAMA. 2005, 294: 2858-2865. 10.1001/jama.294.22.2858.
Williams J: Risk management in surgery. Clinical Risk Management. Edited by: Vincent CA. 2001, London: BMJ Publications
Lilford RJ, Mohammed MA, Braunholtz D, Hofer TP: The measurement of active errors: methodological issues. Qual Saf Health Care. 2003, 12 (Suppl 2): ii8-12.
Michel P, Quenon JL, Djihoud A, Tricaud-Vialle S, de Sarasqueta AM: French national study of inpatient adverse events prospectively assessed with ward staff. Qual Saf Health Care. 2007, 16: 369-377. 10.1136/qshc.2005.016964.
Aggarwal R, Ward J, Balasundaram I, Sians P, Athanasiou T, Darzi A: Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann of Sur. 2007, 246: 771-779. 10.1097/SLA.0b013e3180f61b09.
Grantcharov TP, Bardam L, Funch-Jensen P, Rosenberg J: Learning curves and impact of previous operation expercience on performance on a virtual reality simulator to test laparoscopic surgical skills. Am J Surg. 2003, 185 (2): 146-9. 10.1016/S0002-9610(02)01213-8.
Scheeres DE, Mellinger JD, Brasser BA, Davies AT: Animate advanced laparoscopic courses improve resident operative performance. Am J Surg. 2004, 188: 157-160. 10.1016/j.amjsurg.2004.04.002.
Halm EA, Lee C, Chassin MR: Is volume related to outcome in health care? A systematic review and methodologic critique of the literature. Ann Intern Med. 2002, 137: 511-520.
Gooiker GA, van Gijn W, Post PN, van de Velde CJ, Tollenaar RA, Wouters MW: A systematic review and meta-analysis of the volume-outcome relationship in the surgical treatment of breast cancer. Are breast cancer patients better of with a high volume provider?. Eur J Surg Oncol. 2010, 36 (Suppl 1): S27-S35.
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MC, Merry AF, Moorthy K, Reznick RK, Taylor B, Gawande AA, Safe Surgery Saves Lives Study Group: A surgical checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360: 491-9. 10.1056/NEJMsa0810119.
de Vries EN, Prins HA, Crolla RM, den Outer AJ, van Andel G, van Helden SH, Schlack WS, van Putten MA, Gouma DJ, Dijkgraaf MGW, Smorenburg SM, Boermeester MA, the SURPASS Collaborative Group: Effect of a Comprehensive Surgical Safety System on Patient Outcomes. N Engl J Med. 2010, 363: 1928-37. 10.1056/NEJMsa0911535.
de Vries EN, Dijkstra L, Smorenburg SM, Meijer RP, Boermeester MA: The SURgical PAtient Safety System (SURPASS) checklist optimizes timing of antibiotic prophylaxis. Patient Safety in Surgery. 2010, 4: 6-10.1186/1754-9493-4-6.
Awad SS, Fagan SP, Bellows C, Albo D, Green-Rashad B, Garza De la M, Berger DH: Bridging the communication gap in the operating room with medical team training. Am J Surg. 2005, 190: 770-774. 10.1016/j.amjsurg.2005.07.018.
Leape LL, Berwick DM, Bates DW: What practices will most improve safety? Evidence-based medicine meets patient safety. JAMA. 2002, 288: 501-507. 10.1001/jama.288.4.501.
Prevention of postoperative infections in hospitals. http://www.vmszorg.nl/10-Themas/POWI
Song F, Glenny AM: Antimicrobial prophylaxis in colorectal surgery: a systematic review of randomized controlled trials. Br J Surg. 1998, 85: 1232-1241. 10.1046/j.1365-2168.1998.00883.x.
The Netherlands Health Care Inspectorate: Standardisation crucial for risk reduction in operative procedures (in Dutch). 2008, Den Haag: IGZ
Stone S, Teare L, Cookson B: Guiding hands of out teachers. Hand-hygiene Liaison Group. Lancet. 2001, 357: 479-480.
Pittet D, Hugonnet S, Harbarth S, Mourouga P, Sauvan V, Touveneau S, Perneger TV: Effectiveness of a hospital-wide programme to improve compliance with hand hygiene. Lancet. 2000, 356: 1307-1312. 10.1016/S0140-6736(00)02814-2.
Baba-Akbari Sari A, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine system for reporting patient safety incidents in an NHS hospital: retrospective patient case note review. BMJ. 2007, 334 (7584): 79-10.1136/bmj.39031.507153.AE.
Neale G, Chapman EJ, Hoare J, Olsen S: Recognising adverse events and critical incidents in medical practice in a district general hospital. Clin Med. 2006, 6: 157-62. 10.1007/s10238-006-0116-5.
Institute of Medicine: To err is human: building a safer health system. 2000, Washington, DC: National Academy Press
Harbison SP, Regehr G: Faculty and Resident Opinions Regarding the Role of Morbidity and Mortality Conference. Am J Surg. 1999, 177: 136-139. 10.1016/S0002-9610(98)00319-5.
Benn J, Koutantji M, Wallace L, Spurgeon P, Rejman M, Healey A, Vincent C: Feedback from incident reporting: information and action to improve patient safety. Qual Saf Health Care. 2009, 18 (1): 11-21. 10.1136/qshc.2007.024166.
Violato C, Lockyer J, Fidler H: Multisource feedback: a method of assessing surgical practice. BMJ. 2003, 326: 546-548. 10.1136/bmj.326.7388.546.
Wilkinson TJ, Challis M, Hobma SO, Newble DI, Parboosingh JT, Sibbald RG, Wakeford R: The use of portfolios for assessment of the competence and performance of doctors in practice. Med Educ. 2002, 36: 918-924. 10.1046/j.1365-2923.2002.01312.x.
NVZ, Orde van medisch specialisten, LEVV, V&VN, NFU: Patient safety campaign: prevent adverse events, work safe in Dutch hospitals. 2007, (in Dutch)
McCannon CJ, Schall MW, Calkins DR, Nazem AG: Saving 100,000 lives in US hospitals. BMJ. 2006, 332 (7553): 1328-1330. 10.1136/bmj.332.7553.1328.
Draft RCP record keeping standards-inpatients. http://www.rcplondon.ac.uk/sites/default/files/audit-tool-for-rcp-generic-record-keeping-standards-2009.pdf
We would like to thank everyone who contributed to the study: the nurse and specialist reviewers, the researchers for the co-ordination of the data collection, and the 21 hospitals and their staff who participated for facilitating the patient records.
Funding: The Dutch Patient Safety Research Program has been initiated by the Dutch Order of Medical Specialists with financial support from the Ministry of Health, Welfare and Sport. The Program is carried out by EMGO Institute/VUmc and NIVEL.
The authors declare that they have no competing interests.
MZ wrote the manuscript, prepared the protocol and instruments of the study, and collected and analyzed the data. MCB contributed to the manuscript, the design and conception of the study. GK reviewed patient records and has been involved in revising the article critically for important intellectual content. HM and PPG have been involved in revising the article critically for important intellectual content. GW contributed to the design and conception of the study and has been involved in revising the article critically for important intellectual content. CW is the general supervisor of the Dutch patient safety research group, contributed to the design and conception of the study, and contributed to the manuscript. All authors read and have approved the final manuscript.