|
|
||||||||
Eur J Cardiothorac Surg 2004;25:591-596
© 2004 Elsevier Science NL
a Departments of Cardiothoracic Surgery, The Cardiothoracic Centre Liverpool, Thomas Drive, Liverpool L14 3PE, UK
b Research and Development, The Cardiothoracic Centre Liverpool, Thomas Drive, Liverpool L14 3PE, UK
Received 11 October 2003; received in revised form 1 December 2003; accepted 15 December 2003.
* Corresponding author. Tel.: +44-151-293-2336; fax: +44-151-288-2371
e-mail: tony.grayson{at}ctc.nhs.uk
| Abstract |
|---|
|
|
|---|
Key Words: Training Coronary artery bypass grafting Mortality Morbidity Propensity score
| 1. Introduction |
|---|
|
|
|---|
Several studies have been published recently examining the impact of training on outcomes in cardiac surgery. These have however been on relatively small numbers, around 3000 procedures [24]. Jenkins and colleagues, in a study involving 6037 cardiac surgery operations, published in 2001 their experience of surgical training and concluded that with appropriate case selection, training in cardiac surgery can achieve good results [5].
We aimed to assess the effect of training in coronary artery bypass graft (CABG) surgery at our institution on in-hospital outcomes and mid-term survival, while adjusting for differences in patient and disease characteristics.
| 2. Methods |
|---|
|
|
|---|
All data were collected prospectively during the patient admission as part of routine clinical practice. Methods of data collection and definitions have been previously published [6] and are available from www.nwheartaudit.nhs.uk. Data were collected on the following variables: age, sex, body mass index, urgency of operation, angina class, smoking, diabetes, hypercholesterolaemia, hypertension, previous myocardial infarctions, peripheral vascular disease, cerebrovascular disease, respiratory disease, renal dysfunction, prior cardiac surgery, prior gastrointestinal surgery, as well as the extent of coronary disease, and left ventricular ejection fraction. The Procedure details collected during the operation included name and grade of first operator, number of grafts, off-pump surgery and use of the left internal mammary artery (LIMA).
During a junior surgeons training at the centre, they would be expected to perform tasks such as suturing anastomoses or harvesting the LIMA on a regular basis before taking on cases as first operator. All cases were a trainee was first operator would be closely assisted (sometimes in the form of guidance) by the Consultant in charge of the case. However, a trainee in their final year of training would gradually be given more independence during the procedure. It is important to stress that at all times; a Consultant cardiac surgeon would be available in case of difficulties.
The in-hospital outcome measures for this study were mortality, stroke, peri-operative myocardial infarction, acute renal failure, deep sternal wound infection, re-exploration for bleeding, atrial arrhythmia, gastrointestinal complications, and duration of mechanical ventilation. Follow-up data included mid-term mortality.
In-hospital mortality was defined as death within the same hospital admission regardless of cause. All patients transferred from the base hospital to another hospital were followed up to confirm their status at discharge. Post-operative stroke was defined as a new focal neurological deficit and comatose states occurring post-operatively that persisted for >24 h after its onset and was noted before discharge. We excluded confused states, transient events and intellectual impairment from our study to avoid any subjective bias. Post-operative myocardial infarction was defined as a new Q-wave post-operatively in two or more contiguous leads on an electrocardiogram or significant rise in post-operative cardiac enzymes combined with haemodynamic and echocardiographic signs of myocardial infarction. Acute renal failure was defined as patients requiring post-operative dialysis support. Re-exploration for bleeding was defined as bleeding that required surgical re-operation after initial departure from the operating theatre. Criteria for defining deep sternal wound infection were in accord with the published evidence-based guidelines by the Centres for Disease Control and Prevention [7]. Post-operative atrial arrhythmia was defined as the occurrence of new atrial arrhythmia in the absence of pre-operative persistent or paroxysmal atrial arrhythmias. Definitions for gastrointestinal complications were in line with The Society of Cardiothoracic Surgeons of Great Britain and Ireland minimum dataset and included gastrointestinal bleeding, pancreatitis, ischaemic bowel, and perforation [8].
2.2. Patient follow-up
Patient records were linked to the National Strategic Tracing Service (NSTS), which records all deaths in the United Kingdom. To establish current vital status, patients were matched to the NSTS based on patient name, National Health Service unique number, date of birth, gender, and postcode.
2.3. Statistical methods
Due to non-normality of data, continuous variables are shown as median with 25th and 75th percentiles. Categorical variables are shown as a percentage. Comparisons were made with Wilcoxon rank sum tests and
2-square tests as appropriate. The European System for Cardiac Operative Risk Evaluation (EuroSCORE) was calculated to assess overall differences in patient case-mix [9]. Logistic regression was used to adjust in-hospital outcomes for differences in patient and disease characteristics (treatment selection bias) [10]. Deaths occurring as a function of time were described using the product limit methodology of Kaplan and Meier [11]. Cox proportional hazards analysis was used to calculate adjusted hazard ratios (HR) and to risk adjust the KaplanMeier survival curves [12].
Treatment selection bias was controlled for by constructing a propensity score, otherwise known as a balancing score [13]. The propensity score was the probability of undergoing CABG led by a trainee surgeon, and was constructed from core patient characteristics and the additive EuroSCORE (C-statistic=0.79) [14]. Once the propensity score is constructed for each patient, there are three ways of using the score for comparisons: matching, stratification, and multivariable adjustment. We decided to use multivariable adjustment because matching would have reduced the study size and stratification can be difficult to interpret. The propensity score is then included along with the comparison variable (trainee or Consultant) in a multivariable analyses of outcome producing adjusted odds ratios as shown in Table 5. The propensity score adjusts for the treatment selection bias, which is evident in Table 2, between one group vs another. An example of the calculation of the propensity score is given at the bottom of Table 5. Using a propensity score as the sole means for adjusting outcomes was preferable due to the low number of events in our study and provides better adjustment for those factors driving treatment selection; the overall effect is more complete risk adjustment [13]. In all cases a P-value <0.05 was considered significant. All statistical analysis was performed retrospectively with SAS for Windows Version 8.2.
|
|
| 3. Results |
|---|
|
|
|---|
Overall, there were 17 trainee surgeons during the study, which led on average 32 procedures (minimum 8 and maximum 119). For trainee surgeons who led less than 50, between 50 and 100, and more than 100 procedures, the respective in-hospital mortality was 0, 0.5, and 1.7% (P<0.05). This increase in mortality was explained by an increase in risk, according to the EuroSCORE for the three groups, which was 1.2, 1.8, and 2.8%, respectively (P<0.05). The relationship between year of training and in-hospital mortality is shown in Table 1.
|
Operative details on off-pump surgery and the use of LIMA, along with the number of grafts are shown in Table 3.
|
|
|
|
| 4. Discussion |
|---|
|
|
|---|
There is a general belief among clinicians that trainee surgeons are associated with increased morbidity and a prolonged hospital stay, and therefore increased hospital costs. Due to this, junior surgeons are often given easier cases during their training, while the Consultants more often than not deal with the more complex procedures [3]. Stoica and co-workers point out that when two patients have the same EuroSCORE, the Consultant is more likely to choose to operate on the patient with less favourable anatomy or with other co-morbid factors not included in the EuroSCORE [2].
Our study demonstrates the clear process of case selection with the patient characteristics between trainee and Consultant surgeons being vastly different in many areas. CABG procedures performed by trainee surgeons were less likely to be female, triple-vessel disease, poor ejection fraction, redo and emergency cases. Also, co-morbid factors were significantly less frequent in trainee cases, producing a significantly lower risk score as measured by EuroSCORE. On average one additional graft was required during the procedure for Consultant surgeons, which again confirms the complex nature of the operations they choose to perform.
This obvious difference in case-mix leads to crude outcomes being significantly lower in procedures led by trainee surgeons compared to Consultants. This leads to erroneous conclusions, such as trainee operating had an apparent protective effect [2]. Does this mean trainee surgeons are better at performing CABG? The straightforward answer is not at all. In fact such crude comparisons are misleading, and could quite easily mask poor performance in our junior surgeons.
The planned publication of crude mortality rates in CABG in the United Kingdom [15] adds further complexity to the question of training as Consultants will become more and more inclined to lower the number of procedures under their care that they allow trainee surgeons to lead, as a handful of deaths could have serious consequences. Also, with increased scrutiny of surgical performance and need for accountability not only in the United Kingdom but across the world, it is important to regularly audit performance among trainee surgeons, while taking into account differences in case-mix.
Surgical training in cardiac surgery is increasingly demonstrated as safe [25,16]. Jenkins and colleagues concluded that with the appropriate selection of cases, the performance of trainees is good [5]. The Department of Veterans Affairs cooperative study on valvular heart disease, found that the operative mortality of trainee cases was not significantly higher after adjusting for risk factors [16]. Training in off-pump CABG, a technique which is becoming increasingly more popular [17], has also been shown to be safe with acceptable results [18,19]. In our series, we have found that 26.3% of trainee cases are performed without cardiopulmonary bypass.
In this large, recent series of CABG patients, we have shown that after adjusting for case-mix, with careful case selection, training does not adversely affect the early and mid-term outcomes of CABG. In-hospital morbidity and mortality results were similar between Consultant and trainee surgeons, but more importantly, the adjusted survival at 4-years was also not significantly different. This highlights that the quality of surgery provided are similar, as long as adequate training and supervision are given to trainees.
Our study has also highlighted that the in-hospital mortality rates increase with the number of cases performed by trainee surgeons, which is closely linked to the year of training. This increase in mortality is due to an increase in the complexity of the cases that a trainee takes on as first operator over time. At no time does the mortality exceed what is expected according to the patients risk profile, as measured by the EuroSCORE.
There are several limitations in our study. Firstly it is an observational report; however, we have adjusted for differences in patient characteristics by using a propensity score, which was included in the multivariable analyses. Propensity score adjustment is no substitute for a properly designed randomised control trial (RCT), on the other hand, retrospective comparisons with propensity score adjustment are more versatile and may be more widely acceptable than RCTs.
Another limitation is the fact that the trainee results will probably reflect part of the Consultants performance due to the assistance they would have given to the junior surgeon. Unfortunately we cannot quantify the full extent of involvement by the Consultants in this retrospective data, although this is now something we are collecting prospectively since carrying out this study.
A final limitation is that we have only examined survival as a mid-term outcome. Other mid-term results, such as recurrence of angina, additional revascularisation (either surgical or percutaneous), and quality of life were not available at the time of this study, but will be of interest in the future.
In conclusion, after accounting for differences in patient characteristics, training under Consultant supervision in coronary artery bypass surgery is safe with acceptable short- and mid-term results.
| Acknowledgments |
|---|
| Footnotes |
|---|
| Appendix A. Conference discussion |
|---|
|
|
|---|
One is, how do you define an outlier, that is, when does a cardiothoracic surgical trainee not meet your expectation? And secondly, what action do you take if you find someone outside the "loop"?
Mr Oo: We all have to face those kinds of questions. We just presented the workload and the actual results and what is actually going on the ground during that period. So we didn't look into the issue of outliers at the time, but obviously this kind of tool will help us in the future in identifying outliers in early stage training so that that will help for their future training, intensive training, or maybe to change their specialty.
Dr Buxton: Mr Chairman, we have the same issues, and we haven't defined how to handle those particular problems, but they are difficult.
Dr S. Hagl (Heidelberg, Germany): You showed us the mortality over time in form of a late follow-up. Do you have other data on that? I mean, do you have, let's say, seen infarctions, reinfarctions, readmissions to hospitals for angina?
Mr Oo: This is what I mentioned in the future works and the limitation of the study.
Dr Hagl: But you don't have it at the moment?
Mr Oo: We don't have it at the moment, that's right. And obviously we need to take into consideration also the time period where you have a mixture of trainees and a mixture of surgeons; the change period will change over.
Mr B. Bridgewater (Manchester, UK): I have some concerns about this sort of study. This is a retrospective analysis of prospectively collected data, and one of the things that happens in real life is that if a trainee is getting into some mischief with a case the consultant will take over, and the way the data will then be collected, I assume, is that it will go down as a consultant case rather than a trainee case. For this study to have any meaning, I think the data needs to be analysed on an intention to treat basis. Have you any comments on that?
Mr Oo: We always face this process during training, because at any given stages, we have, say, six trainees with different stages, so year one and year two trainees will need more assistance compared to year four, year five and year six trainees. So this study is encouraging us to train more and showing this is safe, and then also shows us the trainers have selected the cases well and train the juniors well to achieve similar results. And I admit there will be always difficulty and then get the study completely right and hundred percent sure that it is specific.
Dr H. Dasmahapatra (Calcutta, India): It is nice to see that your trainees are doing a better job. But my one question is, does your study involve OPCAB or conventional cardiopulmonary bypass and CABG?
Mr Oo: I can tell you out of these 559 patients, which constitute about 9.9% of the coronary work done in the period, and of that 9.9, 26.3% were OPCAB.
Dr Dasmahapatra: And have you compared the data of OPCAB, trainee surgeons and the consultant surgeons, their results?
Mr Oo: We can't discuss that at the moment because we haven't looked into detailed analysis of OPCAB because the numbers would be lower.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
C.-H. Yap, N. Andrianopoulos, D. T. Dinh, B. Billah, A. Rosalion, J. A. Smith, G. C. Shardey, P. D. Skillington, J. Tatoulis, M. Mohajeri, et al. Short- and midterm outcomes of coronary artery bypass surgery performed by surgeons in training. J. Thorac. Cardiovasc. Surg., May 1, 2009; 137(5): 1088 - 1092. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. K. Haan, S. Milford-Beland, S. O'Brien, D. Mark, M. Dullum, T. B. Ferguson, and E. D. Peterson Impact of Residency Status on Perfusion Times and Outcomes for Coronary Artery Bypass Graft Surgery Ann. Thorac. Surg., June 1, 2007; 83(6): 2103 - 2110. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Livesey Is public access to surgeon-specific data affecting practice adversely? Heart, June 1, 2007; 93(6): 652 - 653. [Abstract] [Full Text] [PDF] |
||||
![]() |
N Chaudhuri, A D Grayson, R Grainger, N K Mediratta, M H Carr, A S Soorae, and R D Page Effect of training on patient outcomes following lobectomy Thorax, April 1, 2006; 61(4): 327 - 330. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Asimakopoulos, A. P. Karagounis, O. Valencia, D. Rose, G. Niranjan, and V. Chandrasekaran How Safe Is It to Train Residents to Perform Off-Pump Coronary Artery Bypass Surgery? Ann. Thorac. Surg., February 1, 2006; 81(2): 568 - 572. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Alexiou, G. Doukas, M. Oc, B. Oc, L. Hadjinikolaou, and T. J. Spyt Effect of Training in Mitral Valve Repair Surgery on the Early and Late Outcome Ann. Thorac. Surg., July 1, 2005; 80(1): 183 - 188. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |