Incidence of adverse events in an integrated US healthcare system: a retrospective observational study of 82,784 surgical hospitalizations
Patient Safety in Surgery volume 8, Article number: 23 (2014)
Many health care facilities have developed electronic reporting systems for identifying and reporting adverse events (AEs), so that measures can be taken to improve patient safety. Although several studies have examined AEs in surgical settings, there has not previously been a systematic assessment of the variations in adverse event rates among different types of surgery, nor an identification of the particular types of AEs that are most common within each surgical category. Additionally, this study will identify the AE severity level associated with each of the AE category types.
This retrospective observational study was conducted at three Midwestern hospitals that are part of a large integrated healthcare system. Data from 2006 through 2009 were analyzed to determine the rates of reported adverse events (per 1,000 hospitalizations involving a surgical procedure) for 96 categories of surgery as classified according to the ICD-9-CM procedural coding system. Univariate and bivariate summary statistics were compiled for AEs by type, severity, and patient age.
During the four-year study period, there was a total of 82,784 distinct hospitalizations involving at least one surgical procedure at these three hospitals. At least one adverse event was reported at 5,368 (6.5%) of those hospitalizations. The mean rate of AEs among all surgical procedure groups was 82.8 AEs per 1,000 hospitalizations. Adverse event rates varied widely among surgical categories with a high of 556.7 AEs per 1,000 hospitalizations for operations on the heart and pericardium. The most common type of adverse event involved care management, followed by medication events and events related to invasive procedures.
Detecting variations in AEs among surgical categories can be useful for surgeons and for hospital quality assurance personnel. Documenting the specific AE incidence rates among the most common types of surgical categories, and determining AE severity and age distributions within surgical categories will enable officials to better identify specific patient safety needs and develop appropriately targeted interventions for improvement.
Improving the quality of care by minimizing surgical complications and adverse events (AEs) is an important goal for surgeons. To this end, several national initiatives have been launched in the U.S. to enhance the quality of surgical care and the avoidance of surgical errors [1–3]. Improving surgical quality requires data systems for reporting and categorizing problems that occur. Many hospitals and integrated health systems nationally now have an electronic event reporting system (ERS) to identify and analyze AEs, so that appropriate quality assurance measures can be undertaken [4, 5].
Several studies have been conducted using an ERS to describe the extent and type of AEs reported in hospital settings. For example, Milch et al.  analyzed 92,547 AEs from 26 acute-care hospitals. Their study found that 33% of the AEs were related to medication errors, 15% involved laboratory problems, 13% were falls, 13% were administrative mistakes, and the remaining 19% were miscellaneous non-medication errors . A similar study at an academic medical center in Missouri found that 26% of events were medication-related, 11% were related to therapeutic interventions, 9% were falls, and there was a large variety of miscellaneous events . Paradis’ et al.  ERS-based study at three hospitals in Oregon found that 38% of events were medication errors, 39% were the result of treatment procedures, and 9% were related to falls .
In the surgical field, it has been estimated that surgery related AEs occur in 1.9% to 3.6% of all hospitalizations, representing 46% to 65% of all AEs [9–11]. A few studies of AE reporting have been conducted for specific surgical subspecialties, including dermatologic, cardiac, and orthopedic surgery [12–15]. This study aims to provide more comprehensive information than has previously been available about the rates of AE occurrence across major surgical categories, and the types of AEs that are associated with specific varieties of surgery. Stratified analyses of the data will describe patterns of AE severity and the distribution of AEs by patient age range.
Several national initiatives, such as the American College of Surgeons National Surgical Quality Improvement Program (NSQIP), have been established to capture standardized information about the type and rate of surgically-related adverse events. Such systems are generally based on collecting data utilizing uniform event reporting protocols. While standardized reporting procedures promotes uniformity and benchmarking, the use of a facility-based or hospital system specific event reporting system has the potential benefit of enabling more detailed and comprehensive information than would be available by the use of national standardized AE reporting systems alone. There may be a significant advantage, for example, to capture surgical event information during the pre-operative and post-operative phases of the hospitalization to provide information on contextual events (e.g., falls) related to the surgical episode.
The accuracy of reporting adverse events is heavily dependent on the completeness, precision, and motivation of the individuals collecting and recording that information. Barriers to accurate reporting of AEs include the reluctance of some medical providers (particularly physicians) to report AEs, lack of time needed to report events because of workload pressures, availability and complexity of the ERS systems, and fear about the repercussions of reporting errors in practice. There may also be reporting bias with regards to the type of events reported (e.g., “near miss” events). For these reasons, it is likely that not all AEs will be reported, and that estimates of AE rates may therefore represent an underestimate of true event prevalence.
To address these potential problems, the hospital system involved in this study takes a variety of actions to achieve complete and accurate reporting. The system’s quality assurance department provides extensive training to clinicians and staff in use of the ERS system, actively encourages reporting and the development of a culture of reporting within the hospital system, maintains a well-staffed quality improvement unit that records all events and near misses, investigates reported events, double checks ERS system reports against information contained in electronic clinical medical records, and incentivizes hospital personnel to file AE reports without fear of reprisal.
This retrospective records-based study was conducted at three Midwestern hospitals in the United States that are part of a large integrated healthcare system. All three hospitals conduct inpatient surgeries. Study subjects included all adult (at least 18 years old) patients receiving an inpatient surgical procedure who were admitted and discharged between January 1, 2006 through December 31, 2009. Demographic characteristics of the study subjects are summarized in Table 1.
The three hospitals shared a common ERS, which is administered by the quality control department of the healthcare system. Patients’ de-identified records were available from the system’s information warehouse, which consolidates electronic medical records of patients across the three hospitals. Records were excluded from this study if a subject’s electronic medical record did not contain an indication of the patient’s primary surgical procedure. Electronic records were coded to protect patient identities. The study protocol was approved by the hospital system’s institutional review board.
Hospitals within this system use an ERS that was initially developed in 2004, primarily for quality improvement purposes. All clinical staff within the system receive extensive training on event identification and reporting. All reports of AEs are entered into the ERS system including detailed information about the AE. For this study, we adopted a relatively broad definition of what constitutes an adverse event, capturing events both with and without resulting harm to the patient, and recorded events as well as reported “near misses”. Reported adverse events in this analysis thus encompass both the concepts of “adverse event” and “medical error” as used in the U.S, Institutes of Medicine 1999 report, To Err is Human” .
Data concerning patient’s age, gender, race, ethnicity, insurance status, and admission/discharge dates were collected from the hospital system’s information warehouse along with clinical variables such as duration of hospitalization, primary ICD-9-CM code, and the primary surgical procedure performed during the hospitalization. Related surgical groups were identified using the first two digits of the ICD-9-CM classification system for surgical, diagnostic, and therapeutic procedures. There were a total of 100 surgical groups identified for the analysis. A surgical hospitalization was defined as an episode of care consisting of an admission and discharge and that involved an ICD-9-CM surgical procedure. Four of the 100 surgical groups (ICD-9-CM codes 72, 73, 90 and 94) did not have any surgical procedures performed during the four-year study period, and therefore were excluded from the analysis.
Data obtained from the hospital system’s ERS included the number of reported AEs for a patient during a surgical hospitalization, and the type of AE based on coding schemes inherent within the ERS. Additionally, the ERS system contained a seven-level severity score for each reported AE. We recoded that severity index into three levels of low severity (levels 0–1), moderate severity (levels 2–3), and high severity (levels 4–6). The severity levels used within the system’s ERS are described in Table 2.
The ERS coding consisted of nine categories of AEs (care management, transfusion, clinical support services, falls, invasive procedures, medications, equipment/devices, patient/visitor behavior, and a miscellaneous “other” category), each subdivided into additional more specific codes. For example, AEs in the “care management” category were divided into the following subcategories: omission of care, delay in care, lack of documentation, delay in treatment, and care coordination problems.
Descriptive statistics were compiled summarizing the frequency of surgical hospitalizations, AEs, the number of surgical hospitalizations in which AEs occurred, and the number of surgical procedures, stratified by each of the 96 surgical groups. For brevity of presentation, we only reported the top 15 surgical categories in each analysis. The rate of AEs per 1,000 surgical hospitalizations and AEs per 1,000 surgical procedures were calculated for each of those ICD-9-CM groupings. The percent distribution of types of AEs within each surgical group was also determined, as was the distribution of AE types by severity levels of AEs and of reported AEs by age group. A t-test for Pearson’s correlation coefficient was performed to determine the extent of correlation between the volume of surgeries performed and the reported AE rates within surgical groups. Statistical analyses were performed using Stata statistical software, version 12 (StataCorp, LP, College Station, Texas, USA).
During the four-year study period, there was a total of 82,784 surgical hospitalizations involving 87,119 surgical procedures; an average of 1.05 procedures per surgical hospitalization (Table 3). There were 5,368 distinct surgical hospitalizations in which at least one AE was reported, an average rate of 1 AE reported for every 15.4 surgical hospitalizations (6.5%). There were 6,856 AEs overall, an average of 1.28 AEs per surgical hospitalization, since one hospitalization can involve multiple AEs.
The mean rate of AEs among all surgical procedure groups was 82.8 AEs per 1,000 surgical hospitalizations. But there was considerable variation in the rate of AEs among ICD-9-CM procedural groups (S.D. = 115.8). For example, the 15 surgical categories with the highest rates of AEs averaged 322.8 AEs per 1,000 surgical hospitalizations, compared to a rate of 5.9 AEs per 1,000 surgical hospitalizations among the 15 surgical categories having the lowest AE rates per 1,000 hospitalizations. Surgical categories with the highest rates of AEs included operations on the heart and pericardium (556.7 AEs per 1,000 hospitalizations), valves and septa of the heart (446.1), liver (418.7), and larynx and trachea (371.7) (see Table 3).
Table 4 specifies AE rates among the 15 most commonly performed types of surgery, which included repair and plastic operations on joint structures (ICD-CM code 81), incisions of skin and subcutaneous tissue (code 86), incision and excision of joint structures (code 80), and operations on lens (code 13). Those 15 surgical categories had a comparatively low AE rate (average of 60.6 AEs per 1,000 surgical hospitalizations), leading us to speculate that surgical categories that are performed frequently might generally have lower rates of AEs than types of surgeries that are performed comparatively less often (e.g., because of the greater experience a hospital has in performing such surgeries). However, subsequent analyses performed to test that assumption found a relatively low correlation across all 96 surgical categories (r = −0.056) and no statistically significant relationship (p =0.59) between surgical volume in a particular category and AE rates.
The distribution of specific types of reported AEs also varied considerably across surgical categories (Table 5). Overall, the most common type of surgical AE involved care management (e.g., delay in care, omission of care, lack of documentation), accounting for 20.8% of all AEs, followed by medication-related AEs (19.2%). Among surgical categories with the highest AE rates, medication-related AEs were most common, followed by AEs related to care management. Table 6 summarizes the distribution of types of AEs among the most frequently performed surgical categories. The analysis of severity levels by type of AE indicated that the highest levels of severity were found in AEs related to invasive and surgical procedures (Table 7). Results of the analysis by age groups indicated that AEs involving care management issues increased in relationship to increasing patient age. Also, there was a consistent trend observed between advancing patient age and the occurrence of adverse events involving falls (Table 8).
There has been increasing interest in measuring and reporting the occurrence of adverse events in the United States during the 2000s and 2010s. Many hospitals and health care systems routinely collect this information and use it in quality assurance efforts. While there have been some studies directed at determining the rates of adverse events for particular kinds of surgeries, we believe that this current study provides one of the most comprehensive assessments to date, spanning such areas as determining the rate of AEs among leading ICD-9-CM surgical codes, identifying the surgical categories having the greatest volume of AEs, determining the distribution of AEs by specific AE types, specifying the distribution of AE types by age group, and providing information about the types of surgically-related AEs in which the highest severity AEs occur.
Our analysis has found that there is very wide variation in AE rates across surgical categories, with a rate of 322.8 AEs per 1,000 hospitalizations for the top 15 categories compared to a mean of 82.8 AEs per 1,000 hospitalizations for the set of all 96 available 2-digit ICD-9-CM surgical categories. On average, at least 1 AE was reported for every 15.4 surgical hospitalizations (6.5% of hospitalizations). The variations in AEs could reflect differences in underlying surgical complexity and/or indicate clinical safety-related issues related to a particular surgical category.
The overall rate of 82.8 AEs per 1,000 surgical hospitalizations is somewhat higher than the rate cited in other published studies. The broad definition we adopted of what constituted an “adverse event”, including near misses and events without patient harm, may have influenced that observed rate. Additionally, this health system maintains a sophisticated AE reporting system, and its clinicians and quality assurance personnel are trained to be particularly thorough and comprehensive in the collection, investigation, and reporting of AE data. Results from this facility, therefore, may not necessarily be generalizable to other health systems.
Our experience in utilizing an ERS to derive comparative statistics of AE rates across surgical categories demonstrates the potential usefulness of these methods to help support quality assurance and improvement objectives within a hospital system. For example, in this particular application, knowing that surgical procedures of the heart, pericardium, valves and septa of the heart, larynx and trachea, and liver have resulted in the highest rates of AEs will facilitate the development of special interventions, intensified investigation, and dialogue with affected surgeons and support personnel to develop appropriate responses and countermeasures.
Similarly, our analysis found that orthopedic surgeries, especially joint repair and joint tissue incision and excision are numerically the most common surgical categories in which AEs occur. Identifying and documenting those trends helps to focus attention and resources at that area so that effective improvement programs can be developed. For example, a high volume of adverse events occurring in a particular orthopedic surgery unit could spur the development of enhanced communications techniques or acquisition of new information technology.
The further linking of AEs rates within surgical categories to specific varieties of AEs (e.g., medication-related, falls, or delays in treatment) further refines the ability of quality improvement personnel and surgeons to identify strategies for mitigating AE risks. In this regard, it was interesting to see the extent to which there was a strong relationship between increasing patient age and increasing incidence of AEs in some AE categories (e.g.,, care management and falls) but not in other AE categories (e.g., medications and transfusions). It was also particularly interesting to observe an unexpected trend between increasing patient age and a lower frequency of AEs related to invasive procedures. Additional investigation will be needed to fully understand the reasons underlying those patterns of AE occurrence.
Based on preliminary findings of seemingly low AE rates among many of the surgical categories having a high volume of procedures, we speculated that a high volume of a particular category of surgical procedures might be related to lower AE rates. This speculation was grounded in our knowledge of other studies that have shown an association between surgical volume (a particular surgeon’s volume, or volume within a particular hospital) and clinical outcomes in a variety of settings [17, 18]. We therefore attempted to ascertain whether the volume of procedures within our data set showed a relationship of lower AE risks with increased volume of procedures among surgical categories. No statistically significant associations were detected based upon our preliminary examination using simple correlation analysis techniques. Further inquiry to examine potential relationships between AE rates and surgical procedure volume in particular categories might be warranted.
One of the advantages of the ERS used in this study was the inclusion of a scale for categorizing the severity of adverse events. This potentially allows for identification of the AE types that are most likely to result in severe AEs. The severity scale used by the healthcare system in this study was designed and used for quality assurance purposes only within this system. Not every health care institution has a similar process for grading the severity of a particular AE. Including a severity scale is beneficial because it potentially enables more precise evaluation and response, along with more efficient use of time and resources. There have been some efforts at the national level to create uniform AE scaling techniques, such as the Common Terminology Criteria for Adverse Events severity scale created by the National Cancer Institute . However, in general, there is still a need to better incorporate uniform severity scales into AE reporting systems.
This study involved three hospitals that are part of a single integrated healthcare system. A limitation of this study is that the results from this system might not be representative of other hospitals or health care settings. Because many health care systems do not publicly share data about adverse event occurrence, it is often challenging to determine whether data about adverse events is collected and interpreted in a sufficiently similar way to make the findings generalizable.
It is thus difficult to compare our results against other institutions because there are few uniform standards or coding systems for event reporting that are used across different hospital systems. To enhance patient safety reporting in the future, hospital systems may need to work cooperatively to develop standardized approaches for event reporting that facilitate benchmarking and trending using common data, while protecting the confidential nature of event data. At the national levels a variety of initiatives are underway to aggregate adverse events data to derive more globally applicable information.
However, many national adverse event reporting initiatives -- such as those undertaken by the National Quality Forum, the Agency for Healthcare Research and Quality, the Joint Commission, and the National Surgical Quality Improvement Program -- rely on a relatively small set of common indicators and thus lack the richness, detail, and variety that can often be obtained through use of a customized hospital-based ERS of the type utilized in this study [20–22]. Surgeons need to pay attention to the data that can be obtained by the use of facility or system-specific event reporting systems. For instance, unlike the event reporting system used at the system featured in this study, the NSQIP surgical event reporting initiative does not as yet contain a severity-grading protocol applicable to diverse surgical procedures. The ideal reporting system would feature uniform AE coding and data collection processes that would enable benchmarking with other healthcare systems, but that also would be detailed and comprehensive enough to meet the specific quality assurance needs of a particular institution.
The extreme variations in AE incidence rates may reflect patient safety issues in some clinical units and/or underlying differences in surgical complexity. Hospital systems need to identify units with the highest rates of AE occurrence and AE severity so that remediation and response efforts can be appropriately targeted. Further sub-analysis to determine patterns in the specific type of AE relative to the type of surgical category can be helpful in further refining quality assurance and patient safety efforts. While individual facilities can benefit by having a detailed and customized approach to AE data collection and analysis, it may also be helpful to adopt uniform data concerning AE occurrence among health facilities as a way of benchmarking results with other institutions.
Bratzler DW, Hunt DR: The surgical infection prevention and surgical care improvement projects: national initiatives to improve outcomes for patients having surgery. Clin Infect Dis. 2006, 43: 322-330. 10.1086/505220.
Rowell KS, Turrentine FE, Hutter MH, Khuri SF, Henderson WG: Use of national surgical quality improvement program data as a catalyst for quality improvement. J Am Coll Surg. 2007, 204 (6): 1293-1300. 10.1016/j.jamcollsurg.2007.03.024.
Hall BL, Hamilton BH, Richards K, Bilimoria KY, Cohen ME, Ko CY: Does surgical quality improve in the American College of Surgeons National Surgical Quality Improvement Program: an evaluation of all participating hospitals. Ann Surg. 2009, 250 (3): 363-376.
Farley DO, Haviland A, Haas A, Pham C, Munier WB, Battles JB: How event reporting by US hospitals has changed from 2005 to 2009. BMJ Qual Saf. 2012, 21: 70-77. 10.1136/bmjqs-2011-000114.
Farley DO, Haviland A, Champagne S, Jain AK, Battles JB, Munier WB, Loeb JM: Adverse-event-reporting practices by US hospitals: results of a national survey. Qual Saf Health Care. 2008, 14: 416-423.
Milch CE, Salem DN, Pauker SG, Jundquist TG, Kumar SK, Chen J: Voluntary electronic reporting of medical errors and adverse events: an analysis of 92,547 reports from 26 acute care hospitals. J Gen Intern Med. 2006, 21 (2): 165-170.
Kivlahan C, Sangster W, Nelson K, Buddenbaum J, Lobenstein K: Developing a comprehensive electronic adverse event reporting system in an academic health center. Jnt Comm J Qual Improv. 2002, 28 (11): 583-594.
Paradis AR, Stewart VT, Bayley KB: Excess cost and length of stay associated with voluntary patient safety event reports in hospitals. Am J Med Qual. 2009, 24: 53-60.
Gawande AA, Thomas EJ, Zinner MJ, Brennan TA: The incidence and nature of surgical adverse events in Colorado and Utah in 1992. Surgery. 1999, 126: 66-75. 10.1067/msy.1999.98664.
Zegers M, de Bruijne MC, de Keizer B, Merten H, Groenewegen PP, van der Wal G, Wagner C: The incidence, root-causes, and outcomes of adverse events in surgical units: implication for potential prevention strategies. Patient Saf Surg. 2011, 5: 13-10.1186/1754-9493-5-13.
Thomas EJ, Studdert DM, Burstin HR, Orav EJ, Zeena T, Williams TBS, Elliott J, Mason HK, Weiler PC, Brennan TA: Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000, 38 (3): 261-271. 10.1097/00005650-200003000-00003.
Coldiron B, Fisher AH, Adelman E, Yelverton CB, Balkrishnan R, Feldman MA, Feldman SR: Adverse event reporting: lessons learned from 4 years of Florida office data. Qual Saf Health Care. 2008, 17 (6): 416-423. 10.1136/qshc.2007.024638.
Martinez EA, Shore A, Colantuoni E, Herzer K, Thompson DA, Gurses AP, Marsteller JA, Bauer L, Goeschel CA, Cleary K, Pronovost PJ, Pham JC: Cardiac surgery errors: results from the UK National Reporting and Learning System. Int J Qual Health Care. 2012, 23 (2): 151-158.
Neily J, Mills PD, Eldridge N, Dunn EJ, Samples C, Turner JR, Revere A, DePalma RG, Bagian JP: Incorrect surgical procedures within and outside of the operating room: a follow-up report. Arch Surg. 2011, 146 (11): 1235-1239. 10.1001/archsurg.2011.171.
Schilling PL, Hallstrom BR, Birkmeyer JD, Carpenter JE: Prioritizing perioperative quality improvement in orthopedic surgery. J Bone Joint Surg Am. 2010, 92 (9): 1884-1889. 10.2106/JBJS.I.00735.
To Err is Human: Building a Safer Health System. Edited by: Kohn LT, Corrigan JM, Donaldson MS. 2000, Washington, D.C.: National Academy Press
Birkmeyer JD, Stukel TA, Siewers AE, Goodney PP, Wennberg DE, Lucas FL: Surgeon volume and operative mortality in the United States. N Engl J Med. 2003, 349 (22): 2117-2127. 10.1056/NEJMsa035205.
Schrag D, Cramer LD, Bach PB, Cohen AM, Warren JL, Begg CB: Influence of hospital procedure volume on outcomes following surgery for colon cancer. JAMA. 2000, 284: 3028-3035. 10.1001/jama.284.23.3028.
Trotti A, Colevas AD, Setser A, Basch E: Patient-reported outcomes and the evolution of adverse event reporting in oncology. J Clin Oncol. 2007, 25 (32): 5121-5127. 10.1200/JCO.2007.12.4784.
Michaels RK, Makary MA, Dahab Y, Frassica FJ, Heitmiller E, Rowen LC, Crotreau R, Brem H, Pronovost PJ: Achieving the National Quality Forum’s “Never Events”: prevention of wrong site, wrong procedure, and wrong patient operations. Ann Surg. 2007, 245 (4): 526-532. 10.1097/01.sla.0000251573.52463.d2.
Chang A, Schyve PM, Croteau RJ, O’Leary DS, Loeb JM: The JCAHO patient safety event taxonomy: a standardized terminology and classification schema for near misses and adverse events. Int J Qual Health Care. 2005, 17 (2): 95-105. 10.1093/intqhc/mzi021.
Cima RR, Lackore KA, Nehring SA, Cassivi SD, Donohue JH, Deschamps C, VanSuch M, Naessens JM: How best to measure surgical quality? comparison of the Agency for Healthcare Research and Quality Patient Safety Indicators (AHRQ-PSI) and the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) postoperative adverse events at a single institution. Surgery. 2011, 150 (5): 943-949. 10.1016/j.surg.2011.06.020.
Partial funding for this project was provided through the Fulbright Program (for M. Zeeshan), United States Agency for International Development.
The authors declare that they have no competing interests.
MZ was the primary developer of the study design, conducted most of the statistical analyses, and was the primary author of the manuscript. AD participated in the study design and authoring of the manuscript. ES provided advice on the study’s methodology, data integrity, and helped revise and refine the final manuscript. BL provided assistance of study design and statistical methods, along with review of draft and final manuscripts. All authors read and approved the final manuscript.
About this article
Cite this article
Zeeshan, M.F., Dembe, A.E., Seiber, E.E. et al. Incidence of adverse events in an integrated US healthcare system: a retrospective observational study of 82,784 surgical hospitalizations. Patient Saf Surg 8, 23 (2014). https://doi.org/10.1186/1754-9493-8-23