|
|
||||||||
Review |
a CJOB Cardiothoracic Department, The Alfred Hospital, Commercial Road, Prahran 3181, Victoria, Australia
b Murdoch Children's Research Institute, Royal Children's Hospital, Flemington Road, Parkville 3045, Australia
c Department of Epidemiology and Preventive Medicine, Monash University, Central & Eastern Clinical School, The Alfred Hospital, Melbourne 3004, Australia
Received 29 October 2007; received in revised form 6 March 2008; accepted 19 March 2008.
* Corresponding author. Tel.: +61 3 9276 2000; fax: +61 3 9276 2317. (Email: s.marasco{at}alfred.org.au).
| Abstract |
|---|
|
|
|---|
Key Words: Meta-analysis Neurologic manifestations Coronary artery bypass Off-pump
| 1. Introduction |
|---|
|
|
|---|
In addition, off-pump coronary revascularisation involves less handling of the often atheromatous ascending aorta. This reduces the incidence of microemboli that have been shown to occur at the time of application and particularly with release of the aortic cross-clamp or side-biting clamp [4].
Until recently, no systematic review was able to demonstrate stroke reduction with off-pump coronary revascularisation. However, a meta-analysis recently published by Sedrakyan and colleagues [5] was able to demonstrate a 50% relative risk reduction of stroke using off-pump techniques compared to on-pump coronary artery bypass graft (CABG) surgery. Because the incidence of stroke is very low following CABG (generally under 1%), it has been difficult to demonstrate a significant reduction in stroke incidence after off-pump surgery in individual trials [6]. For this reason, investigators have looked to more subtle neurological changes following surgery such as neurocognitive decline. However, even these results have varied widely between individual trials. No previous systematic review has specifically analysed the results of neurocognitive outcomes following off-pump versus on-pump CABG. The purpose of this meta-analysis therefore was to assess these outcomes.
| 2. Methods |
|---|
|
|
|---|
2.1 Search strategy
All published prospective randomised controlled trials assessing neurocognitive outcomes after off-pump versus on-pump coronary revascularisation were considered. Studies were compiled from systematic literature searches of databases including Cochrane (reviews and registry of controlled trials), Medline and PsycINFO for the last twenty years up until September 2007.
The search strategy included the terms off-pump coronary revascularisation, off-pump coronary artery bypass, randomised controlled trial, controlled clinical trial and combinations of neurocognitive outcomes, neurocognitive tests and brain function. All studies were then reviewed to determine if they had included neurocognitive outcomes as an endpoint. A search of other reviews of coronary revascularisation techniques was also conducted, checking reference lists of these articles also for further relevant studies. The search was also repeated at regular intervals during this systematic review to ensure any new publications were captured. The search strategy included all languages. The search was conducted by both the first and second authors who also reviewed the papers and culled the list according to the entry criteria of this search.
2.2 Inclusion and exclusion criteria
Prospective randomised trials comparing off-pump versus on-pump coronary artery revascularisation were included, whereby patients were randomly assigned to either off-pump or on-pump CABG. All patient populations were considered eligible. Neurocognitive testing as an endpoint in the study was a prerequisite. All language publications were considered eligible.
Exclusions were made where the trials were found to be not truly randomised, where brain function assessments were performed using magnetic resonance imaging or cerebral microemboli markers as opposed to neuropsychological testing. Also excluded were studies not conforming to the recommended consensus statement on neurocognitive outcomes testing and reporting after cardiac surgery [8].
Where there was insufficient data reported on the neurocognitive tests to obtain means and standard deviations, the corresponding authors of those papers were contacted.
2.3 Data extraction
A standard neurocognitive test battery was used in the eight included studies, conforming to the consensus statement of neurocognitive testing after cardiac surgery [8]. Not all papers reported all tests, rather a selection of tests to assess each cognitive domain. However, some papers had data missing (e.g. baseline figures which were not published, or data which was represented graphically only), and all of these primary authors were contacted to request this information.
After completing the search strategy as outlined above, the relevant data were extracted from the identified papers by two reviewers working together (SFM, LNS).
2.4 Endpoints
The endpoints used in this meta-analysis were short term (less than or equal to 3 months) and long-term (greater or equal to 6 months) neurocognitive performance of cardiac surgery patients, after undergoing off-pump or on-pump CABG. Where authors had tested patients at two time points within the first three postoperative months, the later time point was used.
2.5 Statistical analysis
The outcomes were analysed as continuous variables and the mean and standard deviations were available for all data used. The weighted mean difference was calculated for each outcome. The meta-analysis was performed using Review Manager (RevMan) Version 4.2 for Windows. (Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2003). Heterogeneity was explored by calculating the I
2 statistic to quantify the degree of heterogeneity across the trials that could not be attributed to chance alone. For each analysis, the fixed effect (precision weighted) or random effects (Der-Simonian and Laird) model was chosen depending on the degree of heterogeneity. Statistical significance was defined as two-sided p
< 0.05. Publication bias was assessed using funnel plots.
Post hoc sample size analysis showed that there were sufficient numbers to detect a 6% difference in test results (averaged across all five neurocognitive tests) with a power of 0.8 and type II error of <0.05.
| 3. Results |
|---|
|
|
|---|
Twenty-four studies were initially identified for possible inclusion in the meta-analysis [9–32]. Corresponding authors were contacted where further clarification of study design (randomisation techniques, or duplication of data) were required, and where there was insufficient reporting and further data was required for inclusion into the meta-analysis. Of the 10 authors contacted, seven replied and two were able to forward further data to enable inclusion in the meta-analysis [25,31]. Of the 24 studies initially identified for possible inclusion in the meta-analysis, 16 were rejected and are listed in Table 1 [9–24]. The primary endpoints in those trials and the reasons for exclusion are also listed.
|
|
|
The results of the Rey Auditory Verbal Learning test (Fig. 1 ) show no significant differences between those patients who underwent off-pump or on-pump coronary revascularisation either at baseline, in the first 3 months postoperatively or between 6 and 12 months postoperatively. There was also no significant change between baseline and the two postoperative time points in either group. No significant heterogeneity was noted at baseline or at the less than 3 months testing. However, there was significant heterogeneity noted at the late neurocognitive testing (6–12 months) with an I 2 of 79.8% (p = 0.002). Re-analysis using a random effects model did not alter the lack of effect of treatment seen with the fixed effects model.
|
|
|
|
|
| 4. Discussion |
|---|
|
|
|---|
Trail A tends to be a good indicator of general cerebral function and problems with this test indicate reduction in basic attention and speed of processing whereas Trail B is more specific to neuroanatomical areas. Thus it is not uncommon to see a discrepancy between the two tests whereby the patient performs better in Trail A due to its more superficial assessment of attention, but performs worse in Trail B because of its more in-depth assessment of this cognitive domain. Further, the sample size in Trail A was smaller than Trail B although a post hoc sample size analysis showed that both tests had enough numbers to detect clinically significant differences (if we take the standard definition that a 20% decline is considered clinically significant).
The only other neurocognitive test which showed some difference between groups was the Digit Symbol test which assesses information processing speed. However, in that analysis the groups were not balanced at baseline, and there was also significant heterogeneity within groups. Re-analysis of the data for that test using a random effects model to account for the large amount of heterogeneity showed no significant differences between groups at any time point.
Our findings confirm the results of most of the individual trials included in the meta-analysis which showed only modest or no differences between groups. The studies by Baker et al. [25], Lund et al. [29], Ernest et al. [31], and Vedin et al. [32] were unable to show any significant differences between off-pump and on-pump CABG groups with neurocognitive testing. Zamvar et al. [26] found significantly worse neurocognitive outcomes in the on-pump CABG group using a definition of neurocognitive impairment as a deterioration of 1SD or more in two or more tests. Nine neuropsychometric tests were administered to all patients in that study of 60 patients. The two largest studies included in this meta-analysis both found some improvements in the off-pump groups [27,30]. The definition of neurocognitive decline is crucial in these types of studies. Lee et al. [28] reported that, compared to baseline, off-pump CABG patients performed better on the Rey Auditory Verbal Learning Test at both the early and late follow-up times. However, when cognitive decline was defined as a 20% decline in 20% of the tests, then there was no difference between groups at either time frame.
The most recent prospective randomised trial on this topic by Motallebzadeh et al. [24] used a composite neurocognitive score to demonstrate better neurocognitive function in the off-pump group at the time of discharge but found no differences between groups at 6 weeks or 6 months postoperatively. We were able to include their unpublished data in our meta-analysis and found no difference in the overall results but a large increase in the heterogeneity. Due to publication restrictions on their unpublished data, we are unable to include it in the meta-analysis presented here.
The recommended core neuropsychological battery of tests lists the Rey Auditory Verbal Learning test, Trail A, Trail B, and the Grooved Pegboard test [8]. All of these tests were included in this meta-analysis. Thus the results reported here give a valid overall assessment of postoperative neurocognitive dysfunction.
One of the main discriminators in assessing the validity of meta-analyses is the degree of heterogeneity in the pooled results. Heterogeneity describes the level of variation in the individual trials. In these meta-analyses, there was no significant heterogeneity at baseline. Significant heterogeneity was seen mainly in the early outcomes (i.e. in the first 3 months postoperatively). This may be due to widely different times of testing within this 3-month window. The times of testing varied from 1 week to 3 months postoperatively in the studies included. It has been suggested that testing during this timeframe is not meaningful because postoperative neurobehavioural dysfunction is highest in the immediate postoperative period and then declines [8]. This would largely account for the significant amount of heterogeneity seen in the results at this time period. Furthermore, a recent study of neurocognitive function after off-pump CABG has shown that older, anxious patients and those with new onset atrial fibrillation are more likely to have a worse neurocognitive score after surgery [33]. These types of confounding factors could also explain the level of heterogeneity seen, particularly in the early postoperative results.
The cognitive function of candidates for CABG has also been compared to healthy controls and published norms [34]. This has shown that preoperative patients with coronary artery disease have significantly reduced cognitive test scores compared to both healthy controls (matched by age, gender and education) and published norms. Again this may be due to anxiety or depression which has been suggested and refuted by a number of studies [34–36]. Other causative factors have been suggested such as the cardiac disease itself, or associated unrecognised cerebrovascular disease [37,38]. Because mood disturbance has been repeatedly associated with poor neurocognitive performance, concurrent assessment of mood has been recommended in the consensus statement on assessment of neurobehavioural outcomes after cardiac surgery [8]. Despite this, only four of the included studies reported performing a specific assessment of mood [28,30–32].
In general, all of the trials analysed for this meta-analysis were of good quality. However, it appears that in all but one of the studies, an aortic side-biting clamp was used in at least some patients in the off-pump group. This is disappointing as it is well known that manipulation of the aorta is associated with cerebral emboli, and therefore the purported benefits of off-pump surgery (no aortic cannulation, no jet perfusion from the cannula tip, and no aortic cross-clamp) may have been lost [4]. None of the studies reported what percentage of patients had the side-biting clamp applied to the aorta so it is difficult to assess the magnitude of this as a confounding factor. Only one study specifically mentioned that the side-biting clamp was not used in the off-pump group [31]. Another study specifically mentioned that the side-biting clamp was used for every proximal anastomosis in the study which presumably refers to both the off-pump and on-pump groups [29].
Another confounding factor which should be taken into account in such studies is the effect of practice on the test results [39]. This can lead to the phenomenon of regression toward the mean whereby extreme baseline scores tend to become less extreme after repeated testing in the absence of any true change. The statistical phenomenon of regression toward the mean has been found to adversely affect multiple different definitions of cognitive decline. In particular, definitions based on standard deviation (SD):postoperative decline in a subject's performance of more than 1SD of the group's scores before the operation; and the 20% method: decline of more than 20% of the subject's score before the operation, have been shown to be susceptible to this phenomenon [40]. Thus, it has been recommended that group mean scores be analysed as this allows the application of parametric statistical methods which are free from the influence of regression toward the mean. That is why we have followed this approach in this meta-analysis, using group mean data rather than analysing changes from baseline.
Other causes of improvements from baseline scores have been postulated however. It is conceivable that improvements could be a result of the coronary revascularisation, improved cardiac output and improved cerebral blood flow. However, it would be very difficult to demonstrate which of these phenomena would be more responsible for improvements in any particular study. Interestingly it has been shown that after one year postoperatively, cognitive function begins to decline again returning to preoperative levels at 5 years [41].
In terms of the post hoc sample size analysis we have performed, if we use the 20% decline in test result as a clinically significant cut-off, we can see that this meta-analysis has sufficient power to detect much smaller changes. On average, we had sufficient numbers to detect a 6% difference in test results with a power of 0.8 and type II error of <0.05.
In concluding that we have been unable to find any clinically relevant neurocognitive benefits to off-pump surgery, we have also assessed the clinical relevance of the limits of our confidence intervals. We have compared our results to published results of the minimum clinically important difference (MCID) [42]. This is defined as the smallest difference in result which can be perceived by the patient and is therefore clinically relevant. Unfortunately this score has not been published in a cohort of cardiac surgery patients to our knowledge. However, by comparing our confidence intervals to the published MCID for both the Grooved Pegboard and Digit Symbol tests in a group of epilepsy patients, we note that our confidence intervals lie well within the MCID for both of these tests.
There has been a recent move away from off-pump surgery because of lack of evidence of benefits. When off-pump surgery was initially developed in 1990s, the proposed benefits were numerous. Interestingly the impetus for off-pump surgery seemed to be largely driven by industry rather than the consumer. After an initially enthusiastic reception by surgeons, the lack of evidence substantiating these proposed benefits has tempered the use of this technique. Further, the patients who are most suitable for this type of surgery (single or double vessel disease) are referred less and less by cardiologists because these patients are also eminently suitable for stenting and other percutaneous interventional techniques.
Other reviews have looked at other endpoints comparing off-pump to on-pump CABGs and found few significant differences. A recent scientific statement from the American Heart Association reports that the current findings consistently favouring off-pump CABG surgery are less bleeding and fewer requirements for blood transfusion. There is little evidence of other significant benefits. In contrast, on-pump CABG is less technically demanding and has a shorter learning curve [43]. That statement was published in 2005 and at that time there was no systematic review based on randomised trials to show a substantial stroke reduction in off-pump versus on-pump CABG.
However, in 2006 a meta-analysis looking at stroke as the main endpoint was published which showed that off-pump CABG is associated with a 50% reduction in the relative risk of stroke (RR 0.50; 95% CI, 0.27–0.93) [5]. Stroke was reported in 27 trials and evaluated in 3062 patients. That paper also found a 30% reduction in atrial fibrillation (RR 0.70; 95% CI, 0.57–0.84) and a 48% reduction in wound infection (RR 0.52; 95% CI, 0.37–0.74).
A meta-analysis looking specifically at cognitive decline after off-pump versus on-pump CABG was published during the preparation of this manuscript. Interestingly they did not include two RCTs we have included in this manuscript with unpublished data from the authors [44]. Two papers they did include however, we chose to exclude due to failure to conform to the consensus statement of cognitive testing after CABG [10] and reporting of cognitive outcomes as the number of deteriorations per group (susceptible to regression toward the mean) without reporting group means [11]. (We were unable to obtain raw data from the last author). Despite the less rigorous inclusion criteria, the meta-analysis by Tagaki et al. also failed to find any significant differences between groups within 2 weeks or at 6–12 months.
In conclusion, this meta-analysis comparing neurocognitive outcomes between patients undergoing off-pump versus on-pump CABGs has found that there is no clinically relevant difference between groups either early (less than 3 months) or late (6–12 months) after surgery. Future studies examining this outcome should aim to employ a technique of no aortic handling at all to minimise confounding factors. Neurocognitive testing and reporting of results should follow the guidelines suggested by the consensus statement, and detailed data should be included in publications rather than summarised data [8]. A multicentre prospective randomised clinical trial is currently underway aiming to enrol 2200 patients into either off-pump or on-pump arms [45]. The secondary outcomes in that trial include neurocognitive testing at baseline and at one year. If follow-up rates are good, this trial will hopefully add important data to our current knowledge of neurocognitive outcomes after off-pump CABG.
| Acknowledgments |
|---|
No funding was sought for this study.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
D. Chu, F. G. Bakaeen, T. K. Dao, S. A. LeMaire, J. S. Coselli, and J. Huh On-Pump Versus Off-Pump Coronary Artery Bypass Grafting in a Cohort of 63,000 Patients. Ann. Thorac. Surg., June 1, 2009; 87(6): 1820 - 1827. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |