Quality assessment in surgery: mission impossible?
© Dindo and Clavien; licensee BioMed Central Ltd. 2010
Received: 10 November 2010
Accepted: 21 November 2010
Published: 21 November 2010
Quality in Surgery
Safety and quality have become prominent criteria by which surgical care is evaluated. Physicians and hospitals are increasingly asked for evidence addressing these areas. Such demands arise from better educated patients and more demanding payers. Patients are starting to use such documentation to select their practitioners and the site for their care . In addition, payers are seeking to use such data to direct selected patient population to particular providers. Therefore, health service policy makers are seeking to develop and implement quality indicators that can be appropriately applied to medical practice. However, up to now, such endeavours have failed. There is still a dramatic shortage of quality assessment programs in surgery. In the United States, large databases such as the National Surgical Quality Improvement Program (NSQIP) were established in 1991 in Veteran Affairs Hospitals, used to record surgical outcome. However, only a minority of US hospitals has joined this program. Today, there is still no general concept on how to assess surgical quality for most of the hospitals neither in the United States nor outside.
Quality assessment in surgery requires different components in order to be valuable. First of all, we need to talk the same language. There is still no common sense on how to report surgical outcome. In 2004, we proposed a classification system for surgical complications, which has gained much acceptance in the surgical community with over 400 citations [2, 3]. It certain regions, e.g. in Sweden, the registration of complications according to this classification system has even becomes mandatory in upper-GI surgery.). Another key task in assessing the quality of surgery is to take into account the degree of risk of the patients studied. For example, we may not expect the same results comparing in an elderly obese patient operated urgently for acute cholecystitis vs elective cholecuytectomy in a young patient. Whenever we speak of surgical 'quality', the case-mix must be considered. This last factor is most often poorly reported in the current literature due to the lack of an accepted strategy to adjust for the patients' risk. This severely hampered interpretation of quality reports. Another important issue is the reliability of the published data. Without truthful data, quality assessment is at best misleading. This subject is hardly explored in surgical literature. In a prospective study, we have demonstrated that outcome data that is collected by residents is not reliable . Data collection using dedicated personnel such as in the NSQIP would be advisable but only few centers come with data managers or study nurses. And last but not least, an important factor of quality assessment is a common definition of the term 'quality' itself. In 1980, Donabedian defined quality care as 'that kind of care which is expected to maximize an inclusive measure of patient welfare, after one has taken account of the balance of expected gains and losses that attend the process of care in all its parts . This definition points to another problem: Quality has to be seen from different angles - not only the patient has its demands on the health care system but also governments and insurances. Therefore, the definition of quality may widely differ between patients, the society, the administrators, and the health care policy makers. Taken as a whole, quality assessment remains a challenging task, as we still lack standardized or widely accepted tools to convincingly perform such quality assessment in many areas. As long as those inconsistencies are not solved, quality assessment will be more a mythical creature than a powerful tool to improve quality at reasonable costs.
In the Land of the Rising Sun
Where do we stand?
In recent years, a plethora of papers have been published on quality assessment in surgery. But, did the way of quality assessment and the quality of care itself improve? There is still no consensus on how to adjust for the case mix and on how to define surgical outcome and complications, respectively. We still lack of benchmarks in many surgical fields hampering the reading of surgical outcome data; striking evidence such as the outcome-volume relation is just disregarded remaining without medical or political consequences in many areas and places; reliability of self-reported data might be poor and professional data collectors might not be afforded. - So, let's be honest - we did not come far in the last decades. Quality assessment in surgery is still a neglected subject, and very few seem really to care. We would contend that it is mandatory for all surgeons to understand and properly apply quality tools, so that we can police our own practices before others, such as insurance companies and hospital administrators, will do it for us. We have to make that mission possible.
- Osborne NH, Nicholas LH, Ghaferi AA, Upchurch GR, Dimick JB: J Am Coll Surg. 2010, 210 (1): 87-92. 10.1016/j.jamcollsurg.2009.09.038.View ArticlePubMedGoogle Scholar
- Dindo D, Demartines N, Clavien PA: Classification of surgical complications: a new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann Surg. 2004, 240 (2): 205-213. 10.1097/01.sla.0000133083.54934.ae.PubMed CentralView ArticlePubMedGoogle Scholar
- Clavien PA, Barkun J, de Oliveira ML, Vauthey JN, Dindo D, Schulick RD, de Santibañes E, Pekolj J, Slankamenac K, Bassi C, Graf R, Vonlanthen R, Padbury R, Cameron JL, Makuuchi M: The Clavien-Dindo classification of surgical complications: five-year experience. Ann Surg. 2009, 250 (2): 187-96. 10.1097/SLA.0b013e3181b13ca2.View ArticlePubMedGoogle Scholar
- Dindo D, Hahnloser D, Clavien PA: Quality assessment in surgery: riding a lame horse. Ann Surg. 2010, 251 (4): 766-71. 10.1097/SLA.0b013e3181d0d211.View ArticlePubMedGoogle Scholar
- Donabedian A: The definition of quality and approaches to its assessment. Explorations in quality assessment and monitoring. 1980, Ann Arbor/Michigan: Health Administration Press, 1:Google Scholar
- van Heek NT, Kuhlmann KF, Scholten RJ, de Castro SM, Busch OR, van Gulik TM, Obertop H, Gouma DJ: Ann Surg. 2005, 242 (6): 781-90. 10.1097/01.sla.0000188462.00249.36.PubMed CentralView ArticlePubMedGoogle Scholar
- Ptok H, Marusch F, Kuhn R, Gastinger I, Lippert H: Eur J Surg Oncol. 2007, 33 (7): 854-61. 10.1016/j.ejso.2006.12.020.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.