EJCTS Click here for details of sales representative
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Personal Folders
Right arrow Download to citation manager
Right arrow Author home page(s):
Ruggero De Paulis
Right arrow Permission Requests
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by De Paulis, R.
Right arrow Search for Related Content
PubMed
Right arrow Articles by De Paulis, R.
Related Collections
Right arrow Cardiac - other
Right arrow Coronary disease

Eur J Cardiothorac Surg 2003;23:607-608
© 2003 Elsevier Science NL


Editorial comment

On the fine balance between the completeness of clinical data and the effective use of outcomes data

Ruggero De Paulis*

Cattedra di Cardiochirurgia, Università di Roma Tor Vergata, European Hospital, via Portuense 700, 00149 Rome, Italy

Received 18 December 2002; accepted 20 December 2002.

* Tel.: +39-6-659-759; fax: +39-6-6597-5724
e-mail: depauli{at}tin.it

Key Words: Coronary artery bypass surgery • Discharge abstract data • 30-Day mortality

There is no doubt that the publication of performance data of different cardiac surgery units is an effort toward an improvement of the quality of care to better serve the final consumer (i.e. the patient). Quality comparison is in fact mostly intended to stimulate internal quality improvement efforts by physicians and health care providers but is also used as a mean to control and contain costs. Nonetheless, several implications are related to such reports and interpretation of the data are often not univocal and subject to debate. The responsibilities of such reports are important because they can affect future decisions making at several levels. While these studies are expected to positively influence the delivered quality of care as demonstrated in some of the pioneering studies in this field [1], on the other hand they could negatively influence the decision whether or not operating on sicker or elderly patients, with restriction from surgical activities for resident in teaching hospitals, or the decrease of operating privileges for less experienced, low-volume surgeons. Health care providers of good performing hospitals would probably use such information to attract more patients or use it as a benchmark for obtaining more resources and financial support. Conversely, publications of data of poor performing hospitals would probably have a negative impact on citizens confidence and on the professional reputation of the people involved. In this respect this type of studies needs to be very accurate: the exactness and completeness of the collected data, the quality control of the collected data, the quality control of the study database, the definitions of co-morbidities and the risk stratification are among the most critical aspects that should be explored thoroughly. After the reports is published, it is difficult that the reader would go into such technical details but his attention would rather be focused on the outcome analysis.

Crude mortality rate often served as indicator of quality of care but it is of limited value without knowing the risk profile of the patients [2,3]. Non-risk stratified data are incorrect and misleading and their publication should strongly be avoided. Analysis of the EuroSCORE database [4] on 19 030 European patients showed that a great number of cardiac factors contribute to surgical mortality. In the absence of any risk factor, the baseline mortality for isolated coronary artery bypass grafting was found to decrease from 3.4 to 0.4% implicating that the absolute risk of the processes and structure of care is almost absent. Therefore, the profound impact of patients risk profile on the outcome should guide any study aimed at predicting mortality or at assessing quality of care.

In the context of monitoring quality of care, Agabiti et al. in this issue of the Journal report an elegant study on the use of an hospital information system (HIS) for screening cardiac surgery units with different performances. Discharge abstracts were used to collect data as they are readily available, have a low cost, and cover a great number of patients.

This study has the merit of being one of the first attempt in Italy to demonstrate the inherent potentiality of administrative data. It is also evident how the authors have used at their best the data that were available. However, HIS data have not been validated and might not be sufficiently sound as the quality of the discharge abstract data might vary from the different centres [5]. The fact that the percentage of the reported complications does not correlate with the hospital stay is unusual and is probably an example of under- or over-reporting. Therefore, complications rate should not be used to validate the hypothesis of different quality of care. Furthermore, because of the source of the data, some of the risk factors that are usually present in most of the clinical data sets which served for risk-adjusted outcomes programs [610] could not be considered. In particular, the authors did not include the impact of some preoperative risk factors among others like previous cardiac surgery, neurological dysfunction, cardiogenic shock, New York Heart Association status, ejection fraction or operative factors like urgent or emergent operation that have proved to be strongly linked with cardiac surgical mortality. Finally, their risk model was derived from a relatively small group of patients and reapplied to the same population without validation. It is already well evident that inclusion of some risk factors (models 2 and 3) significantly reduced the difference among hospital A and the other hospitals. Would these differences be further modified by including all risk factors? A final consideration would be the appropriate timing of such reports. Apart from verifying the methodology of the HIS as a screening tool, what is the value of publishing data 5 years after their collection? At this stage the published data might not serve as a stimulus for improving the quality of delivered care. In fact, health providers seems to be the most responsive to the performance data. A recent survey on reporting systems evaluated in peer review publication [11] demonstrated that patients and individual corporation rarely seek for such information and seldom use it or trust it while physicians are often sceptical and do not usually discuss it with their patients. Conversely, hospitals were found to implement process improvements especially if located in competitive environments, and used the performance data for ameliorating coding, educating staff and improving outcomes.

Quality control studies are also needed in response to the cost-containment issues that is of growing importance independently from the type of health care financing system. Nowadays decision making on technology and resource as well as human force utilization are no longer in the hands of the physicians. Non-medical decisions could therefore affect the quality of care delivered by a single or by a group of physicians. Indicators of good quality of care should therefore be clearly described so that the additional cost of a given procedure could be appropriately defended. Similarly, expensive and ineffective interventions could be more readily avoided. In this light the important role of the physician in guiding any cardiac outcomes reporting program should be underlined. A recent pilot study demonstrated how a physician governed cardiac outcome registry was successful in ‘balancing the informational needs of the medical community with those of regulatory bodies’ [12].

There is an increased need for reliable information about the quality of delivered care. Despite some criticisms these data should be actively pursued for their continuous positive impact on internal quality control analysis. However, an even strenuous effort should be directed in assuring that the methods and the data used to generate such reports were independently evaluated and validated.


    References
 Top
 References
 

  1. Hannan E.L., Kilburn H., Racz M., Shields E., Chassin M.R. Improving the outcomes of coronary artery bypass surgery in New York State. J Am Med Assoc 1994;271:761-766.[Abstract/Free Full Text]
  2. Greenfiled S., Aronow H.U., Elashoff R.M., Watanabe D. Flaws in mortality data: the hazards of ignoring comorbid disease. J Am Med Assoc 1988;260:2253-2255.[Abstract/Free Full Text]
  3. Green J., Winfeld N., Sharkey P., Passman L.J. The importance of the severity of illness in assessing hospital mortality. J Am Med Assoc 1990;263:241-246.[Abstract/Free Full Text]
  4. Roques F., Nashef S.A.M., Gauducheau M.E., de Vincentis C., Baudet E., Cortina J., David M., Faichney A., Gabrielle F., Gams E., Harjula A., Jones M.T., Pinna Pintor P., Salamon R., Thulin L. Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19 030 patients. Eur J Cardiothorac Surg 1999;15:816-823.
  5. Iezzoni L.I. Using risk-adjusted outcomes to assess clinical practice. An overview of issues pertaining to risk adjustment. Ann Thorac Surg 1994;58:1822-1826.[Abstract]
  6. Parsonnet V., Dean D., Bernstein A.D. A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation 1989;79(Suppl. I):3-12.
  7. Higgins T.L., Estefanous F.G., Loop F.D., Beck G.J., Blun J.M., Paranandi L. Stratification of morbidity and mortality outcome by preoperative risk factors in coronary artery bypass patients. J Am Med Assoc 1992;267:2344-2348.[Abstract/Free Full Text]
  8. O'Connor G.T., Plume S.K., Olmstead ., et al. Multivariate prediction of in-hospital mortality associated with coronary artery bypass graft surgery. Circulation 1992;85:2110-2118.[Abstract/Free Full Text]
  9. Hannan E.L., Kilburn H., Jr, O'Donnell J.F. Adult open heart surgery in New York state: an analysis of risk factors and hospital mortality rates. J Am Med Assoc 1990;264:2768-2774.[Abstract/Free Full Text]
  10. Hammermeister K.E., Johnson R., Marshall G., Grover F. Continuous assessment and improvement in quality of care. A model from the Department of Veterans Affairs Cardiac Surgery. Ann Surg 1994;219:281-290.[Medline]
  11. Marshall M.N., Shekelle P.G., Leatherman S., Brook R.H. The public release of performance data. What do we expect to gain? A review of the evidence. J Am Med Assoc 2000:1866-1874.
  12. Goss R.J., Whitten R.W., Phillips R.C., Johnston G.G., Hofer B.O., Mansfield P.B., Tidwell S.L., Spertus J.A., LoGerfo J.P. Washington state's model of physician leadership in cardiac outcomes reporting. Ann Thorac Surg 2000;70:671-695.[Abstract/Free Full Text]




This Article
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Personal Folders
Right arrow Download to citation manager
Right arrow Author home page(s):
Ruggero De Paulis
Right arrow Permission Requests
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by De Paulis, R.
Right arrow Search for Related Content
PubMed
Right arrow Articles by De Paulis, R.
Related Collections
Right arrow Cardiac - other
Right arrow Coronary disease


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
ANN THORAC SURG ASIAN CARDIOVASC THORAC ANN EUR J CARDIOTHORAC SURG
J THORAC CARDIOVASC SURG ICVTS ALL CTSNet JOURNALS