|
|
||||||||
Eur J Cardiothorac Surg 2000;18:703-710
© 2000 Elsevier Science NL
a Department of Anaesthesiology and Intensive Care, Kuopio University Hospital, FIN-70210 Kuopio, Finland
b Department of Internal Medicine, Kuopio University Hospital, FIN-70210 Kuopio, Finland
c Department of Surgery, Kuopio University Hospital, FIN-70210 Kuopio, Finland
Received 5 May 2000; received in revised form 9 August 2000; accepted 19 September 2000.
Corresponding author. Tel.: +358-17-173311; fax:+358-17-173377
e-mail: otto.pitkanen{at}kuh.fi
| Abstract |
|---|
|
|
|---|
Key Words: Cardiac surgery Risk stratification Mortality Morbidity Length of intensive care unit stay
| 1. Introduction |
|---|
|
|
|---|
Most of the risk indexes are based on logistic regression analysis. They are either risk scores based on the odds ratios of variables in the logistic regression analysis or the indexes can also be risk-equations that produce a definite probability of mortality or morbidity [13,10,12]. Risk indexes are most valid in patient populations where the preoperative patient characteristics and treatment protocols are comparable with those of the original environments. That is why a model should not be used elsewhere as such, before its validity has been tested in the local patient material [8]. Recently, early mortality in cardiac surgery has been studied in a EuroSCORE multicenter study conducted in eight European countries [10,14]. The EuroSCORE is intended for external and general application. However, we are not aware of any study evaluating the performance of the EuroSCORE in other patient populations.
Our purpose was to first derive a valid risk prediction model for local use in our hospital. Secondly, since the performance of the recently published EuroSCORE [10,14] has not been tested in our patient material, we compared its performance and that of our newly derived model for predicting mortality and morbidity in our patient population.
| 2. Materials and methods |
|---|
|
|
|---|
Predictive models were developed by logistic regression analyses. Firstly, the retrospective database of 4592 patients was utilized. Two thirds of the patients (n=3061) were randomized to a derivation database, which was used to derive predictive models. The remaining one third (n=1531; retrospective validation database) was used as an independent database for validation of the models. Secondly, the models were validated also in a prospectively collected database (n=821; prospective validation database). Three outcome states were defined as follows: mortality, morbidity as described above, and length of stay (LOS) in the ICU for more than 2 days (ICU LOS>2 days).
Three models to predict three outcome states were derived in the randomized retrospective derivation database (n=3061) in two steps as follows. First, univariate analyses were performed in order to find out those predictive variables that were associated with the outcome states. Chi-square test or Fisher's exact test as appropriate were performed if the categorized predictive variables occurred at least in 0.5% of cases in the sample. Unpaired t-test was used to study for the differences of continuous variables. Predictive variables with a P-value of less than 0.20 in the univariate analyses were potentially eligible into logistic regression analysis. Second, the correlation between those variables that were significant in the univariate analyses was tested by Pearson's correlation (continuous variables) or Spearman's rank order correlation (categorized or nominal variables). Because selection of variables that correlate with each other may result in multicollinearity and overfitting of the model, only one clinically relevant variable was chosen in case of correlation (P>0.05). A total of 17 variables describing the chronic health of the patient, 16 describing the preoperative status and examinations and 14 concerning the type and priority of the operation were screened in univariate analyses. The corresponding number of variables entered in the backward stepwise logistic regression analyses were 12, 16 and 13, respectively.
The significant variables (P<0.05) after backward stepwise elimination formed the final predictive model including eight variables predicting mortality, 14 variables predicting morbidity, and 12 variables predicting the length of intensive care unit stay2 days.
All three models explaining mortality, morbidity or ICU LOS>2 days were validated both in the retrospective (n=1531) an in the prospective validation (n=821) databases. Model calibration (precision) was evaluated by the HosmerLemeshow goodness-of-fit statistics [15]. The discrimination abilities (accuracy) of the predictive models and the EuroSCORE were assessed with the area under the receiver-operating characteristic (ROC) curve [16].
The difference in the EuroSCORE between patients with and without mortality, morbidity and ICU LOS>2 days was tested by the non-parametric MannWhitney U-test. Differences in patient characteristics, type and priority of operation, outcome variables and the predicted risks between the prospective and retrospective validation databases was performed by chi-square test, Fisher's exact test, unpaired t-test or MannWhitney U-test as appropriate. Statistical significance was defined as P<0.05. The results are given as mean±SD unless indicated otherwise. All the statistical procedures including randomization and ROC analyses were performed by SPSS 9.0 statistical package (SPSS Inc., Chicago, IL).
| 3. Results |
|---|
|
|
|---|
|
|
|
|
|
|
| 4. Discussion |
|---|
|
|
|---|
The unadjusted operative mortality among all our cardiac surgery patients (2.0 and 1.1% in the retrospective and prospective databases, respectively) and also among our patients with pure CABG (1.2 and 0.9% in the retrospective and prospective databases, respectively) was lower or equal as compared to previous reports [6,10,12,17,18]. The incidence of morbidity among our patients was 22 and 18% in the retrospective and prospective databases, respectively. Similar figures for morbidity have been published by Tuman et al., although the definitions for morbidity were somewhat different [5]. In our study 6.5 and 4.8% of CABG patients (in the retrospective and prospective databases, respectively) had prolonged ICU LOS (>2 days), whereas Wong et al. [9] reported that 17% of CABG patients stayed more than 48 h in the ICU after fast-track protocol.
There were differences in the patient material between the periods of the two databases, i.e. from 19921996 to 19981999. The patients in the more recent database were older, the proportion of female patients was higher and there were less chronic renal failure and pure CABG operations. Also the predicted risk for mortality was higher. However, in our more recent, i.e. prospective database the ICU LOS was shorter. This may reflect a change in our routine postoperative care towards a fast-track practice or better response to given case. A similar trend toward an increasing proportion of high-risk patients with simultaneous decrease in ICU LOS has been previously reported from North America [8,12,19].
The multivariate predictors of outcome, such as age, gender, chronic co-morbidities, left ventricular ejection fraction, priority and type of operation in our model were quite the same as previously published [13,8,17]. The predictors we utilized can be regarded as objective and reproducible indicators of outcome with the exception of New York Heart Association (NYHA) class which varies somewhat according to the assessor. Also diuretic therapy as a risk factor may be dependent on physician and institutional preferences. ICU LOS reflects the overall use of resources and has been predicted also in other studies [4,6,9]. The time limit chosen for our study was based on the median ICU LOS in the derivation database and is the same as in a previous report [9].
The performance, i.e. discrimination and calibration, of our models in predicting mortality, morbidity or prolonged ICU LOS was comparable to other risk indexes that have been created for cardiac surgery patients [3,68,10]. In the study by Wong et al. [9] the discrimination abilities of models predicting ICU stay lasting two days or longer were somewhat better (area under the ROC curve 0.85) than those in our model (0.750.81). Our models were all based on preoperative factors, while the models by Wong et al. [9] included also postoperative factors such as inotrope use or use of intra-aortic balloon pump thereby increasing the predictive ability of their models. In spite of the differences in patient characteristics and outcome between the two periods of 19921996 and 19981999, the models derived from 19921996 data were accurate enough in the more recent validation database from 19981999. However, predictive models should be episodically updated and recalibrated to ensure their optimal performance because there tends to be evolution in medical and surgical techniques along time [8,11].
Both our model and the EuroSCORE were not very accurate in predicting morbidity. This may be due to the numerous conditions defined as factors for morbidity. The models might have performed better in the prediction of one isolated event rather than 13 events.
Our models are equations that provide an estimated risk of death, morbidity or prolonged ICU LOS for each patient. The EuroSCORE is a simple additive score designed to provide the physician and the patient a simple tool to estimate the risk of death. It is an estimated percentage probability of death and very close to the operative mortality observed in the pilot program.
The EuroSCORE was divided into three risk groups [10]. The thresholds for these risk groups were based on the equal size of those three groups. In our material the proportion of patients with low EuroSCORE was higher (4047%), and correspondingly, the proportion of patients with high EuroSCORE was lower (1823%) than in the original validation database of the EuroSCORE. This finding suggests that patients in our study had, on the average, lower EuroSCOREs than the patients in the original EuroSCORE data. Further, our patients were less severely ill having lower risk of death than the European cardiac surgical patients in general. Nevertheless, the observed mortality rates in our validation databases were lower than in the EuroSCORE study in each of the three risk categories (0.30.6 vs. 0.8%, 0.61.3 vs. 3% and 3.27.8 vs. 11.2% in low, medium and high risk categories, respectively). Thus, it may be argued that the outcome and presumably the quality of care provided in our institution might have been better among our patient material than among that of the EuroSCORE study. Whether or not this was due to some differences in the operation-related factors between our study and the EuroSCORE study, remains uncertain. In the EuroSCORE study, there were less patients undergoing pure CABG operation, but on the other hand, more elective operations and slightly less urgent operations than in our study.
In spite of the differences in the patient characteristics between our databases and that of the EuroSCORE, the latter performed quite well in our databases. The discrimination ability of the EuroSCORE was comparable with that of our models. In our prospective validation database, 25% of patients with a EuroSCORE of 13 or higher died (Fig. 1). The association between mortality and EuroSCORE values was much less clear in patients with EuroSCORE values 1112 or lower. In contrast, the incidence of morbidity and prolonged ICU LOS seemed to increase with the increasing score. However, in the highest categories the correlation was less evident. This could be explained by the fact that these categories included only small numbers of patients.
An advantage of our model is the low number of variables needed in the risk calculation. Our models contained variables from eight to 14, while the number of variables required for calculation of the EuroSCORE is 17. The number of variables in our models seems appropriate because including too many variables in risk indexes not only increases cost and errors but also may result in statistical overfitting and instability [8]. A part of the variables included in our models and in the EuroSCORE (age, gender, previous stroke, arteriosclerosis in lower limbs, renal failure, left ventricle ejection fraction, unstable angina, type and priority of operation) were the same, but some of them were differently defined as predictive factors in the regression equations. For instance, age and left ventricle ejection fraction were handled as continuous variable in our study (Table 2) while in the EuroSCORE study age was divided into five years intervals and ejection fraction into two classes. In addition, our definition for neurologic dysfunction was not as exact as in the EuroSCORE study (our study: previous hemiplegia/hemiparesis or cerebellar infarct and EuroSCORE study: disease severely affecting ambulation or day-to-day functioning), and correspondingly, the definitions for ASO (our study: anamnestic or angiographic occlusion of lower limb arteries and EuroSCORE study: claudication, carotid occlusion or 50% stenosis, previous or planned intervention on the abdominal aorta, limb arteries or carotids) and renal failure (our study serum creatinine120 µmol/l and the EuroSCORE study: serum creatinine200 µmol/l preoperatively) were also different. Therefore, the weights (odds ratios) for the variables in our study are not comparable with the EuroSCORE study. In addition, the different weights may be due to different frequencies of these variables in the derivation databases and the differences in patient material and outcome [10,14]. These factors may also explain the slightly unstable relationship between the observed outcome states in our material and the EuroSCORE and the skewed distribution of patients into three EuroSCORE risk categories in our databases. Due to these differences the comparison of our local models and the EuroSCORE should be undertaken with caution.
The local models and the EuroSCORE may not be mutually exclusive, rather they could be collected and used to supplement each other. However, before any predictive index is used in intra-institutional outcome prediction or quality control, its performance should be carefully evaluated in each institution. In our institution the EuroSCORE performed quite accurately. Therefore our finding does not support derivation of a local model for every cardiac surgery center. In addition to quite correct prediction of risk of death, our local model provided also a well calibrated estimation of probability of prolonged ICU stay. Thus it may have additive value especially for our local resource allocation purposes.
If the discrimination and calibration of a predictive index have proved to be appropriate, it can be used in selection of patients for operative treatment in borderline cases and to help physicians to prepare for oncoming complications [18]. Accurate prediction of ICU LOS or length of hospital stay may guide in allocating resources. Morbidity, mortality, and the ICU LOS can be predicted quite reliably on the grounds of preoperative information and the type of operation. Whether the models would be more precise, if intraoperative predictors were added [20], has to be tested in future studies. If the information needed in such predictive models could be stored into database as a part of the normal documentation during the treatment process by using patient data management systems, the index would be easily obtained and more applicable in clinical situations. However, it is to be stressed that clinicians have to be very cautious when applying any predictive indexes to individual patients [17].
In conclusion, while our models seem to provide a fine-tuned method in resource allocation and quality assurance purposes in local use in our hospital, the EuroSCORE may be appropriate in categorizing patients undergoing cardiac surgery in clinical trials and in interinstitutional comparisons.
| Acknowledgments |
|---|
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
N. Motomura, H. Miyata, H. Tsukihara, M. Okada, S. Takamoto, and Japan Cardiovascular Surgery Database Organization First Report on 30-day and Operative Mortality in Risk Model of Isolated Coronary Artery Bypass Grafting in Japan Ann. Thorac. Surg., December 1, 2008; 86(6): 1866 - 1872. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. F Ludman Assessing the risks of percutaneous coronary intervention: do we have an equivalent of the EuroSCORE? Heart, November 1, 2008; 94(11): 1366 - 1369. [Full Text] [PDF] |
||||
![]() |
P. D'Errigo, F. Seccareccia, S. Rosato, V. Manno, G. Badoni, D. Fusco, C. A. Perucci, and the Research Group of the Italian CABG Outcome Pro Comparison between an empirically derived model and the EuroSCORE system in the evaluation of hospital performance: the example of the Italian CABG Outcome Project Eur. J. Cardiothorac. Surg., March 1, 2008; 33(3): 325 - 333. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Patila, S. Kukkonen, A. Vento, V. Pettila, and R. Suojaranta-Ylinen Relation of the Sequential Organ Failure Assessment Score to Morbidity and Mortality After Cardiac Surgery Ann. Thorac. Surg., December 1, 2006; 82(6): 2072 - 2078. [Abstract] [Full Text] [PDF] |
||||
![]() |
C.-J. Jakobsen, P. Torp, and E. Sloth Assessment of left ventricular ejection fraction may invalidate the reliability of EuroSCORE. Eur. J. Cardiothorac. Surg., June 1, 2006; 29(6): 978 - 982. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. K. Toumpoulis, C. E. Anagnostopoulos, S. K. Toumpoulis, J. J. DeRose Jr, and D. G. Swistel EuroSCORE Predicts Long-Term Mortality After Heart Valve Surgery Ann. Thorac. Surg., June 1, 2005; 79(6): 1902 - 1908. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. K. Toumpoulis, C. E. Anagnostopoulos, D. G. Swistel, and J. J. DeRose Jr Does EuroSCORE predict length of stay and specific postoperative complications after cardiac surgery? Eur. J. Cardiothorac. Surg., January 1, 2005; 27(1): 128 - 133. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Zingone, A. Pappalardo, and L. Dreas Logistic versus additive EuroSCORE. A comparative assessment of the two models in an independent population sample Eur. J. Cardiothorac. Surg., December 1, 2004; 26(6): 1134 - 1140. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Nilsson, L. Algotsson, P. Hoglund, C. Luhrs, and J. Brandt EuroSCORE Predicts Intensive Care Unit Stay and Costs of Open Heart Surgery Ann. Thorac. Surg., November 1, 2004; 78(5): 1528 - 1534. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Karthik, A. K. Srinivasan, A. D. Grayson, M. Jackson, D. A.C. Sharpe, D. J.M. Keenan, B. Bridgewater, and B. M. Fabri Limitations of additive EuroSCORE for measuring risk stratified mortality in combined coronary and valve surgery{star} Eur. J. Cardiothorac. Surg., August 1, 2004; 26(2): 318 - 322. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Gogbashian, A. Sedrakyan, and T. Treasure EuroSCORE: a systematic review of international performance Eur. J. Cardiothorac. Surg., May 1, 2004; 25(5): 695 - 700. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. V.H.P. Huijskes, P. M.J. Rosseel, and J. G.P. Tijssen Outcome prediction in coronary artery bypass grafting and valve surgery in the Netherlands: development of the Amphiascore and its comparison with the Euroscore Eur. J. Cardiothorac. Surg., November 1, 2003; 24(5): 741 - 749. [Abstract] [Full Text] [PDF] |
||||
![]() |
F Roques, P Michel, A.R Goldstone, and S.A.M Nashef The logistic EuroSCORE Eur. Heart J., May 1, 2003; 24(9): 882 - 882. [Full Text] [PDF] |
||||
![]() |
T. S. Kurki, O. Jarvinen, M. J. Kataja, J. Laurikka, and M. Tarkka Performance of three preoperative risk indices; CABDEAL, EuroSCORE and Cleveland models in a prospective coronary bypass database Eur. J. Cardiothorac. Surg., March 1, 2002; 21(3): 406 - 410. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Kawachi, A. Nakashima, Y. Toshima, K. Arinaga, and H. Kawano Risk stratification analysis of operative mortality in heart and thoracic aorta surgery: comparison between Parsonnet and EuroSCORE additive model Eur. J. Cardiothorac. Surg., November 1, 2001; 20(5): 961 - 966. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |