|
|
||||||||
Eur J Cardiothorac Surg 1999;16:424-428
© 1999 Elsevier Science NL
Clinical Effectiveness Unit, The Royal College of Surgeons of England, London, UK
Corresponding author. St George's Hospital, Blackshaw Road, London SW17 0QT, UK. Tel.: +44-181-725-3565; fax: +44-181-725-2049
e-mail: ajmurday{at}sghms.ac.uk
| Abstract |
|---|
|
|
|---|
Key Words: Heart transplantation Predictive modelling Risk factors
| 1. Introduction |
|---|
|
|
|---|
| 2. Materials and methods |
|---|
|
|
|---|
2.2. Outcome variable and patient population
Thirty-day graft survival was chosen as the model end-point (event: death or retransplantation). The 30-day end point was used because much of the previous work done by others (which formed the basis of this work) used a similar outcome. In addition, the primary goal of the model was to predict early graft failure. All adult patients in the cohort (registrations on the national waiting list since April 1995) who had undergone transplantation by December 1996 form the population for this analysis. Paediatric transplants (recipients aged 15 or less) were excluded because of differing risk profiles [1]. There were no other exclusions.
2.3. Selection of predictor variables
A subjective approach [2] was used to select risk factors for inclusion in the model. In a subjective approach variables are typically selected by a panel as opposed to objective methods that involve mathematical reduction of numerous data items collected on a large number of patients. To incorporate some objectivity, predictor variables were chosen from the published literature. Using MEDLINE, papers documenting risk factors for early failure after heart transplantation between 1986 and 1996 were identified. Risk factors were accepted into the model if they met the following criteria relative risk for graft failure should equal or exceed 1.2, risk factor can be categorised into two groups, risk factor was preferably obtained through multivariate analysis, association should be biologically plausible, source of data and methods used should be adequately described and appropriate, and the risk factor should be easily and routinely collected in the UK. These criteria were not absolute a subjective element remained in the variable section. For example, although size is widely believed to be an important factor in matching donors to recipients, statistical data to support this are lacking. Young et al. [3] have demonstrated an interaction between sex and size with small female donors posing the greatest risk. We extrapolated from these data, combined with widely accepted matching criteria that size mismatch (small donor large recipient) is an adverse factor, and therefore included it in the model. Drug abuse was included because of epidemiological and experimental studies suggesting myocardial toxicity of cocaine [4] although there were no supporting clinical studies. Numerical data were collapsed into categorical groups as defined in the literature. Variables included in the model are listed in Table 1.
|
|
| 3. Results |
|---|
|
|
|---|
3.2. Risk distribution and survival
At least one risk factor was reported in 262 (70%) donors and 290 (78%) recipients. The commonest risk factors were recipient age >50 years (58%), female donor (39%), high pulmonary vascular resistance (PVR) (31%), ischaemic time more than 3.5 h (24%), donor age >45 years (22%), and circulatory support (14%). The median number of factors per transplant was 2 (interquartile range 13) (Fig. 1).
The distribution of transplants across the risk groups and the corresponding 30-day graft survival is shown in Table 2. There is separation of risk groups, although with some overlap of 70% confidence margins. The use of post-operative organ support was used as a surrogate marker for internal validity; this increased significantly as risk increased (Table 3).
|
|
| 4. Discussion |
|---|
|
|
|---|
4.1. Choice of model
A subjective approach to variable selection was chosen because the number of transplants was inadequate for meaningful formal analysis. For reliable modelling, it has been suggested that no more than n/10 predictors should be examined to fit a multiple regression model where n is the number of events [6]. This cohort had 44 events and using these criteria would allow for only four predictors. Relaxing the criteria to allow one predictor per every three events would allow for 14 predictors but would likely compromise reliability of the model. We therefore decided a priori to model the data into four risk groups as an objective approach to variable selection was not appropriate. The subjective technique has the advantage of being able to force variables into the model, especially uncommon variables thought to be relevant, but which on their own would not achieve statistical significance. The variable selection was based on published literature thus maintaining some objectivity.
The model successfully stratifies survival by the four risk groups. While we believe that the confidence intervals would be narrower with a larger sample size, it would be unrealistic to assume that four risk groups will explain all variation in mortality. The major disadvantage of the model is reduced discrimination (the ability of a model to separate patients with different responses [6]), especially among the high risk group which includes half of our transplants. A model with better discrimination would fragment high risk transplants into smaller sub-groups. Some more complex models we tested had better discrimination but at the price of reduced predictive ability. Complex models would also defeat the objective of this work, which was to derive a simple model. Loss of discrimination is a price to pay for model simplicity. For the purpose of transplantation outcomes and daily clinical practice, discrimination into four groups is probably adequate. More sophisticated models are required where increased discrimination is necessary.
There are few published data available on risk stratification in heart transplantation. Most of the work in this area has been from the cardiac transplant research database (CTRD) [79], a collaboration of over 40 transplant centres in United States and Canada. Risk profiles have been constructed for major post-transplant events [10]. The clinical application of their models is not straightforward hence the development of software to assist specific patient prediction [10]. There are however limitations to the direct extension of the CTRD model to a British or European population. The CTRD cohort is a selected sample of the larger transplant units in the North America; the results may therefore not be representative of global or North American practice. For example, centres not approved by Medicare did not contribute to the initial report [7], resulting in a systematic exclusion of the majority of heart transplant centres in the United States, many of which are low volume centres (as Medicare approval is partly dependent on centre volume [11]). Centres not in the CTRD study had an average of 13 transplants per year compared to 24 in the CTRD group. Low centre volume is associated with poorer outcomes [11] and risk profiles in excluded centres could differ. The CTRD therefore represents practice in the high volume US centres and generalisation may be inappropriate.
Another factor limiting generalisation of North American data to European centres is that data from the UK [12] and France [13] have shown that the practice and outcome of heart transplantation differs from that reported in the United States. Several factors have been suggested as contributing to the superior survival reported in North America [12,14], but regardless of the underlying reasons, such discrepancy threatens reliable and valid extension of prognostic models derived on US patients to their UK counterparts. Although risk factors are likely to be similar in a European cohort (several of the factors included in this model were based on American data), the predicted outcome will not be the same (unless the differential outcomes are purely due to case-mix). A need therefore exists to define risk profiles for British and European populations.
4.2. Strengths and limitations of model
The major strength of this model lies in its representativeness and simplicity. The study does not exclude any transplant centres or transplanted patients in the UK. It therefore characterises the entire national cardiac transplant experience within the study period; no sources of variation, known or unknown, are excluded and all centres (and hence patients) are included regardless of their output or outcomes. The model is simple and can easily be applied in clinical and non-clinical situations.
There are limitations of this study. The sample size, although a relatively large sample from the transplant perspective, is small for modelling purposes. We believe that with a larger sample, it will be possible to derive a more sensitive discriminatory risk classification (through multivariate modelling) and that the estimates will be more precise. The sample size was however beyond the investigators control. The 30-day outcome as a surgical outcome generally underestimates peri-procedural risk [15], an effect more pronounced in transplantation, as the hazard continues well beyond 30 days [7]. Finally, being a multi-centre study with no control on clinical practice, heterogeneity in practice and outcome is inevitable. Inclusion of all patients and centres was however necessary to permit generalisation of the results.
Several assumptions are inherent in the model only factors included in the model can contribute to risk, risk factors are additive with no interactions, factors have equal weighting, and for numerical data, risk increases only when categorical boundaries are crossed. All these assumptions are violated to some degree and the ability of the model to still discriminate implies some degree of robustness. The assumption of equal weighting imposes the strongest restriction on the data and further work will be directed towards weighting of variables.
It is expected that with further refinement this model will be sufficiently robust to assist in decision making and enable risk stratified outcome evaluation, but at present the model remains exploratory. There are several potential applications of simple models for risk stratification. Simple stratification of individual recipients enables doctors and patients to have realistic ideas of the likely risk [16] thereby forming the basis for truly informed consent [10]. For example, our data suggest that a recipient with 3 risk factors will expect, on average, a 5382% probability of survival to 1 year depending on the quality of the donor heart. Stratification can aid the clinical decision making process of recipient and donor selection and the matching donors to recipients [10]. Some donor-recipient risk profiles may imply the risk of transplantation exceeds the risk on the waiting list (such as the allocation of a marginal donor heart to a patient at low risk of death on the waiting list) and in some very high risk patients, the risk of transplantation may be considered too excessive for acceptance on the waiting list. Stratification also enables results from different centres to be more accurately compared thus enabling doctors to effectively audit their practice. Finally, health purchasers and decision makers need reliably stratified outcome data to guide decision making [16]. Risk stratification has obvious advantages and uses, but models can only be reliably applied to populations similar to that from which they were derived. We have described our attempts to derive such a model from national data. Although there are several limitations to our approach, the model does have some discriminatory ability; and we suggest similar approaches may be used when modelling small samples in other areas of cardiac surgery. This model is preliminary further work will be directed towards validation and refinement of the model through formal mathematical modelling.
| Acknowledgments |
|---|
| Footnotes |
|---|
| Appendix A |
|---|
|
|
|---|
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. Martin, M. P. Siegenthaler, O. Friesewinkel, T. Fader, A. van de Loo, G. Trummer, M. Berchtold-Herz, and F. Beyersdorf Implantable left ventricular assist device for treatment of pulmonary hypertension in candidates for orthotopic heart transplantation--a preliminary study Eur. J. Cardiothorac. Surg., June 1, 2004; 25(6): 971 - 977. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Poloniecki, C. Sismanidis, M. Bland, and P. Jones Retrospective cohort study of false alarm rates associated with a series of heart operations: the case for hospital mortality monitoring groups BMJ, February 14, 2004; 328(7436): 375. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Anyanwu and T. Treasure Prognosis after heart transplantation BMJ, March 8, 2003; 326(7388): 509 - 510. [Full Text] [PDF] |
||||
![]() |
A C Anyanwu, C A Rogers, and A J Murday Intrathoracic organ transplantation in the United Kingdom 1995-99: results from the UK cardiothoracic transplant audit Heart, May 1, 2002; 87(5): 449 - 454. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |