cc11462 1364-8535 Research <p>Endotoxemia and mortality prediction in ICU and other settings: underlying risk and co-detection of gram negative bacteremia are confounders</p> HurleyCJamesjamesh@bhs.org.au GuidetBertrandbertrand.guidet@sat.aphp.fr OffenstadtGeorgesgeorges.offenstadt@sat.aphp.fr MauryEriceric.maury@sat.ap-hop-paris.fr

Rural Health Academic Center, Melbourne Medical School, 'Dunvegan' 806 Mair St., University of Melbourne, Ballarat, Victoria 3350, Australia

Division of Internal Medicine, Ballarat Health Services, 101 Drummond St., N, Ballarat, 3350, Victoria, Australia

Réanimation médicale, Assistance Publique - Hôpitaux de Paris, Hôpital Saint-Antoine, 184 rue du Faubourg Saint Antoine, Paris, F-75012, France

UPMC Université Paris 06, 4 Place Jussieu, Paris, 75005, France

Inserm, Unité de Recherche en Épidémiologie Systèmes d'Information et Modélisation (U707), Paris, F-75012, France

Critical Care 1364-8535 2012 16 4 R148 http://ccforum.com/content/16/4/R148 10.1186/cc1146222871090
4520123072012782012782012 2012Hurley et al.; licensee BioMed Central Ltd.This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Introduction

The interdependence between endotoxemia, gram negative (GN) bacteremia and mortality has been extensively studied. Underlying patient risk and GN bacteremia types are possible confounders of the relationship.

Methods

Published studies with ≥10 patients in either ICU or non-ICU settings, endotoxemia detection by limulus assay, reporting mortality proportions and ≥1 GN bacteremia were included. Summary odds ratios (OR) for mortality were derived across all studies by meta-analysis for the following contrasts: sub-groups with either endotoxemia (group three), GN bacteremia (group two) or both (group one) each versus the group with neither detected (group four; reference group). The mortality proportion for group four is the proxy measure of study level risk within L'Abbé plots.

Results

Thirty-five studies were found. Among nine studies in an ICU setting, the OR for mortality was borderline (OR <2) or non-significantly increased for groups two (GN bacteremia alone) and three (endotoxemia alone) and patient group one (GN bacteremia and endotoxemia co-detected) each versus patient group four (neither endotoxemia nor GN bacteremia detected). The ORs were markedly higher for group one versus group four (OR 6.9; 95% confidence interval (CI), 4.4 -to 11.0 when derived from non-ICU studies. The distributions of Pseudomonas aeruginosa and Escherichia coli bacteremias among groups one versus two are significantly unequal.

Conclusions

The co-detection of GN bacteremia and endotoxemia is predictive of increased mortality risk versus the detection of neither but only in studies undertaken in a non-ICU setting. Variation in GN bacteremia species types and underlying risk are likely unrecognized confounders in the individual studies.

Introduction

The prognostic value of endotoxemia detection has been studied in more than forty studies 1234567891011121314151617181920212223242526272829303132333435363738394041. Conflicting conclusions became apparent from the earliest studies undertaken 242541.

The prognostic value remains unresolved despite 17 large studies including more than 2,000 patients 112124252627293031323335363738394041. On the one hand, in six studies endotoxemia was predictive of septicaemia onset or severe illness 1121243840 and hospital mortality 112426 among studies of hospitalized patients unrestricted to an ICU setting. On the other hand, 13 studies including eight among patients restricted to ICU settings found the detection of endotoxemia either did not predict organ dysfunction or mortality 25273031333941, predicted mortality but not organ dysfunction 35, predicted organ dysfunction but not mortality 29323738, or predicted mortality only when the level of endotoxemia was combined within a lipo-polysaccharide cytokine score 36. In only three 112124 of these 17 studies did the mortality difference between the groups positive versus negative for endotoxemia exceed 20 percentage points.

Several additional clinical observations indicate that the inter-relation between endotoxemia, gram negative (GN) bacteremia and outcome is not simple 424344. Less than two thirds of patients with GN bacteremia have endotoxemia detected and vice versa 42. The concordance with GN bacteremia varies with GN bacteremia species type 43. The structure function activity of lipid-A, the biologically active component of endotoxin differs for different GN bacteria 45. Furthermore, the impact of underlying risk of death is a key factor in the clinical setting 4647 but is difficult to investigate in laboratory studies 4849505152. These factors illustrate the 'disconnect' between attempts to study sepsis in animal models versus the clinical setting 50. The objective here is to evaluate the GN bacteremia species type and underlying patient risk as possible confounding factors of the prognostic value of endotoxemia as detected using the limulus assay in published clinical studies of patients across a broad spectrum of risk.

Materials and methods

Data sources

A computerized search of PUBMED (including Medline) was undertaken using the following key words in the title or abstract; 'endotoxemia', 'limulus' and was restricted to studies in humans. This search was supplemented by a hand-search for studies reporting mortality outcome data in relation to endotoxemia detection and detection of GN bacteremia with blood culture for patient groups at risk of GN bacteremia. This search has been performed repeatedly over two decades 44 up to April 2012 as detailed previously 4344. A call for data was published 53 and authors were contacted for additional data to enable inclusion. The flow chart of the literature search strategy and study accrual and disposition is detailed in Figure 1.

<p>Figure 1</p>

Flow diagram of study selection within the meta-analysis

Flow diagram of study selection within the meta-analysis.

Study selection

The inclusion and exclusion criteria and numbers of studies excluded are detailed in Figure 1. The following inclusion criteria were used; (1) limulus assay used for endotoxemia detection, (2) at least one patient with GN bacteremia, (3) at least ten patients in the study, (4) at least five patients in group four, (5) no anti-endotoxin intervention in use and (6) data was extractable into a 2 × 2 × 2 contingency table format in relation to the co-detection of GN bacteremia and endotoxemia and mortality proportions.

Data extraction

The patients in all studies were classified into one of four groups as follows: both endotoxemia and GN bacteremia detected (group one), only GN bacteremia detected (group two), only endotoxemia detected (group three), and neither detected (group four). For each of the four groups, the proportion of deaths and denominator data were extracted as a 2 × 2 × 2 contingency table format. Additional data extracted were the type of patient population, whether the study was undertaken in an ICU or another setting and the bacterial species of GN bacteremia isolates.

Data analysis

There are three objectives of this analysis. Firstly, to determine the prognostic value associated with the detection of GN bacteremia and endotoxemia, each when detected in isolation (groups two and three, respectively) and when co-detected (group one) versus patients for whom neither was detected (group four). This was done by deriving summary odds ratios (OR) and 95% confidence intervals (CIs) using random effects meta-analysis 54 together with an assessment of inter-study statistical heterogeneity using the I2 test for group one, group two and group three each versus group four among the included studies 55. This was repeated for the sub-groups of studies that included studies of adult patients with sepsis in an ICU setting (defined here as high risk studies) versus studies in other settings (low risk studies). Secondly, to visually compare individual study results using forest and L'Abbé plots 56 the proportion of deaths in groups one, two and three each versus the proportion of deaths in group four as representing the reference group for underlying risk for each study. The line of equality (x = y) is displayed as a visual aid to asses dispersion of the individual study results within each L'Abbé plot. Thirdly, to asses the uniformity in distributions of key GN bacteremia species type among group one and two among those studies for which this information was available. Ethics approval was not required for this study.

Results

Thirty-five studies 1234567891011121314151617181920212223242526272829303132333435 were found of which 14 studies were supplemented with data provided by personal communication (Table 1). The survival outcome was reported for a total of 3,235 patients among these 35 studies of which 432 (13%), 272 (8%), 1,091 (34%) and 1,440 (44%) were in groups one to four, respectively. Patient inclusion for nine of the studies was based on various criteria for sepsis in adult patients in an ICU setting. A total of 26 of the 35 studies were published within the 1980s and 1990s. The largest study 35 provided mortality data stratified in relation to endotoxemia detection at two breakpoints.

<p>Table 1</p>

The included studies.

Study [reference]

Patient population and location

Numbers of patients with fatal outcome/Number tested



Group 1

Group 2

Group 3

Group 4


Gnb+

Gnb+

Gnb-

Gnb-

Etx+

Etx-

Etx+

Etx-


Pre-defined patient groups: Pediatric


Ahmed et al. 2004 1

Diarrheal illness, hospitalized

3/9

1/1

1/12

1/19

Casey et al. 1992 2

Pediatric cardiac surgery, ICU

0/1

ND

0/15

0/8

Cooperstock, 1985 3

Suspected sepsis, hospitalized

0/10

0/1

0/6

0/26

Klein et al. 1988 4

Malnourished children, hospitalized

ND

0/1

0/7

0/8

Shenep et al. 1988 5

Suspected sepsis, hospitalized

2/9

0/1

1/3

0/13


Pre-defined patient groups: Surgery and peri-procedural


Bailey et al. 1976 6

Obstructive jaundice, hospitalized

1/1

ND

0/12

0/11

Berger et al. 1995 7a

Post-colonoscopy, unspecified location

0/1

ND

0/20

0/11

Foulis et al. 1982 8f

Acute pancreatitis, hospitalized

1/1

ND

2/12

1/13

Lau et al. 1996 9a

Acute cholangitis, hospitalized

1/8

0/3

0/20

0/9

Lumsden et al. 1989 10

Percutaneous biliary drainage, hospitalized

0/1

ND

0/13

0/7


Pre-defined patient groups: Specified infections


Brandtzaeg et al. 1989 11a

Meningococcal disease, hospitalized

9/24

0/11

ND

0/7

Brandtzaeg et al. 1996 12a

Meningococcal disease, hospitalized

21/40

0/19

1/4

3/26

Butler et al. 1973 13b

Plague, hospitalized

1/2

ND

0/7

0/1

Butler et al. 1976 14b

Plague, hospitalized

0/3

0/2

ND

0/5

Magliulo et al. 1976 15c

Salmonellosis, hospitalized

0/1

ND

0/9

0/12

Magliulo et al. 1976 15c, d

Typhoid, hospitalized

0/8

0/4

0/1

0/1

Adinolfi et al. 1987 16d

Typhoid, hospitalized

0/7

0/7

0/2

0/5

Suyasa et al. 1995 17d

Typhoid, hospitalized

1/4

1/6

ND

0/9


Pre-defined patient groups: Oncology and transplant patients


Bion et al. 1994 18

Elective liver transplantation, ICU

0/1

0/1

1/31

4/19

Engervall et al. 1997 19a

Febrile, oncology (80% neutropenic), hospitalized

1/2

0/4

0/4

0/14

Hynninen et al. 1995 20

Febrile, oncology (43% neutropenic), hospitalized

0/3

1/24

ND

10/96

Yoshida et al. 1994 21a

Febrile, oncology (63% neutropenic), hospitalized

14/21

1/9

11/35

8/71


Pre-defined patient groups: Other


Byl et al. 2001 22a

Suspected sepsis, hospitalized

2/8

0/4

0/3

1/12

Giamarellos et al. 1999 23a

Acute pyelonephritis, hospitalized

1/3

0/9

0/4

0/9

Levin et al. 1972 24

Suspected sepsis, hospitalized

14/20

4/14

7/16

27/168

Stumacher et al. 1973 25

Suspected bacteremia, hospitalized

6/28

15/37

2/18

4/34

Van Langervelde et al. 2000 26a

Febrile hospital admissions, hospitalized

7/24

0/24

9/76

16/324


Adult patients in ICU with sepsis as contemporaneously defined


Bates et al. 1998 27a

Sepsis syndrome, multi-center cohort, hospitalized

5/10

12/39

42/109

59/198

Billard et al. 1994 28

Septic shock, ICU

5/6

ND

1/4

4/8

Danner et al. 1991 29a

Clinically defined septic shock, ICU

4/11

0/8

8/32

12/49

Dofferhoff et al. 1992 30

Clinically defined severe sepsis, ICU

2/4

0/2

0/6

1/6

Goldie et al. 1995 31a

Sepsis syndrome, ICU

5/9

2/3

36/83

18/38

Guidet et al. 1994 32a

Sepsis syndrome, ICU

13/24

4/9

14/20

18/40

Strutz et al. 1999 33

Sepsis syndrome, ICU

1/5

3/5

5/8

4/10

Wortel et al. 1992 34e

Sepsis syndrome, multi-center cohort, ICU

6/8

4/5

2/3

13/25

Opal et al. 1999 35

(Low; >20 pg/ml) a, f

Sepsis syndrome, multi-center cohort, ICU

12/51

7/21

78/255

32/128

Opal et al. 1999 35

(High; >660 pg/ml) a, f

Sepsis syndrome, multi-center cohort, ICU

21/63

84/241

aData for these studies 79111219212223262729313235 provided by personal communication; btwo studies of plague were aggregated for this analysis 1314; cthis study stratified into two sub-studies of typhoid and salmonellosis 15; dthree small studies of typhoid were aggregated for this analysis 151617; eonly the patients randomized to receive placebo from this study 34. fthe mortality proportion data for patients with endotoxemia detected from this study 35 has been stratified at two breakpoints, 20 and 660 pg/ml. Etx, endotoxemia; GNB, Gram negative bacteremia; ND, no data.

The species types of GN bacteremia isolates were identified for 31 of the 35 studies [See Additional file 1]. Among the mono-microbial GN bacteremias, there were 174 (26%), 134 (22%), 74 (12%), and 94 (15%) bacteremias with Escherichia coli, Enterobacteriaceae other than E. coli (for example, Klebsiella species, Enterobacter species), Pseudomonas aeruginosa, and Neisseria meningitides, respectively. After excluding studies restricted to specified infections, there were 497 GN bacteremias with species type known among which there was an uneven distribution of E. coli versus P. aeruginosa identified among the GN bacteremias of group one versus group two; E. coli was less common in group one than in group two (92 of 303 (30%) versus 82 of 194 (42%), P = 0.007; chi-square test). By contrast, P. aeruginosa was more common in group one than in group two (53 of 303 (17%) versus 23 of 194 (12%), P = 0.09; chi-square test). This reciprocal mal-distribution was also apparent among the nine studies of adults with sepsis in an ICU setting (data not shown).

<p>Additional file 1</p>

GN bacteremia types and distributions.

Click here for file

Meta-analysis

The summary OR for death for group one, group two and group three each, respectively, versus group four, are presented in Table 2 for all studies and for the subsets of ICU and non-ICU studies. With only the nine studies undertaken in an ICU considered, the summary ORs were all either not significant or borderline (OR <2).

<p>Table 2</p>

Summary odds ratios derived from studies stratified by underlying mortality risk.

Strata of studies

Groups 1 (Endotoxemia and GN bacteremia detected) versus groups 4 (neither detected)

Groups 2 (GN bacteremia alone detected) versus groups 4 (neither detected)

Groups 3 (Endotoxemia alone detected) versus groups 4 (neither detected)




Number of studies

Odds ratio

(95% CI)

I2 a

%

Odds ratio

(95% CI)

I2 a

%

Odds ratio

(95% CI)

I2 a

%


ICU studies

9

1.5

0%

1.2

0%

1.4

0%

1.01 to 2.1

0.74 to 2.0

1.09 to 1.8

non-ICU studies

26

6.9

0%

1.5

0%

1.9

0%

4.4 to 11.0

0.78 to 2.7

1.2 to 2.9


All studies

35

3.1

42%

1.3

0%

1.5

0%

2.0 to 4.8

0.89 to 1.9

1.2 to 1.8

aI2 is the measure of heterogeneity in odds ratio between studies with 0% equivalent to no heterogeneity. CI, confidence interval; GN, gram negative.

With the 26 studies undertaken outside of an ICU setting considered, the summary OR for groups one (co-detection of endotoxemia with GN bacteremia) versus group four was 6.9 (4.4 to 11.0) whereas the summary OR for groups two (GN bacteremia alone) and three (endotoxemia alone) versus group four (neither) were not significant or borderline (OR <2).

With all 35 studies considered together, the calculated heterogeneity was moderate (I2 = 42%) in association with the OR derived for group one (co-detection of endotoxemia with GN bacteremia) versus group four from all studies whereas the calculated heterogeneity in association with all the other ORs was minimal (I2 = 0%).

L'Abbé and forest plots

The individual study ORs together with the summary ORs are presented in forest plots for group one (Figure 2), group two (Figure 3) and group three (Figure 4) all in relation to group four. The corresponding L'Abbé plots are shown in Figure 5a, b, and Figure 5c, respectively.

<p>Figure 2</p>

Forest plot of odds ratios for mortality for Groups 1 (Endotoxemia and GN bacteremia detected) versus groups 4 (neither detected)

Forest plot of odds ratios for mortality for Groups 1 (Endotoxemia and GN bacteremia detected) versus groups 4 (neither detected). Study specific and summary odds ratios (and 95% confidence intervals) derived from all 35 studies with studies sorted into those conducted in an ICU or non-ICU setting. Arrowheads indicate 95% confidence intervals that extend out of range. GN, gram negative.

<p>Figure 3</p>

Forest plot of odds ratios for mortality for Groups 2 (GN bacteremia alone) versus groups 4 (neither detected)

Forest plot of odds ratios for mortality for Groups 2 (GN bacteremia alone) versus groups 4 (neither detected). Study specific and summary odds ratios (and 95% confidence intervals) derived from all 35 studies with studies sorted into those conducted in an ICU or non-ICU setting. Arrowheads indicate 95% confidence intervals that extend out of range. GN, gram negative.

<p>Figure 4</p>

Forest plot of odds ratios for mortality for Groups 3 (Endotoxemia alone) versus groups 4 (neither detected)

Forest plot of odds ratios for mortality for Groups 3 (Endotoxemia alone) versus groups 4 (neither detected). Study specific and summary odds ratios (and 95% confidence intervals) derived from all 35 studies with studies sorted into those conducted in an ICU or non-ICU setting. Arrowheads indicate 95% confidence intervals that extend out of range.

<p>Figure 5</p>

L'Abbé plots of study specific mortality rates

L'Abbé plots of study specific mortality rates. Each figure shows mortality rates for studies undertaken in an ICU (triangles) or non-ICU (circles) setting with symbols proportional to group size with the line of no difference (y = x; dotted line) shown for visual reference purposes. Shown are Groups 1 (endotoxemia and GN bacteremia detected) versus groups 4 (neither detected) (Figure 5a - top), Groups 2 (GN bacteremia alone) versus groups 4 (neither detected) (Figure 5b - middle), and Groups 3 (endotoxemia alone) versus groups 4 (neither detected) (Figure 5c - bottom). GN, gram negative.

The group four mortality proportion exceeded 15% for all studies of adult patients with sepsis in an ICU setting (high risk studies) whereas all but one of the other studies (low risk studies) had a group four mortality proportion <15%. The overall dispersion in the mortality proportions away from the line of identity is most apparent in the plot of group one versus group four (Figure 5a), in that for 17 of the 35 studies the mortality proportion in group one was ≥20 percentage points higher in group one versus group four. By contrast, there were only three and five studies in which the mortality proportion for group two or group three, respectively, differed by ≥20 percentage points versus the mortality in group four (Figure 5b and Figure 5c).

When all the included studies here are dichotomized into patient groups positive for endotoxemia (that is, groups one and three aggregated) versus negative (that is, groups two and four aggregated), there were only five studies for which a difference in mortality proportions of ≥20% was apparent in the dichotomy (data not shown) 511122124. None of these five studies were restricted to populations of ICU patients, four had either an unusually high proportion of bacteremias with P. aeruginosa (7 of 30; 21, 7 of 34; 24) or N. meningitidis (35 of 35; 11, 59 of 59; 12) among the GN bacteremias and the fifth was a pediatric study 5 with 26 patients of which six had bacteremias with either Hemophilus influenzae, Campylobacter species or N. meningitidis.

Discussion

This reappraisal of this somewhat dated and disparate literature was undertaken to clarify the following as possible confounding variables toward the prognostic value of endotoxemia: ICU versus non-ICU setting, underlying patient risk, and the species types and distributions of GN bacteremia isolates within the studies. It uses L'Abbe plots to address these questions and adds 20 studies 12346789101213141516171819223335 with 9 received as personal communications, not included in a previous meta-analyses 57.

There are four findings from this analysis. The mortality risk in each of groups one (co-detection of endotoxemia with GN bacteremia), groups two (GN bacteremia alone) and groups three (endotoxemia alone) versus group four (neither) are generally either non-significant, or borderline (OR <2) when derived from only the nine studies in an ICU setting. However, when the 26 non-ICU studies are considered, the risks versus group four are similar to those derived from studies in an ICU setting with the exception of groups one (co-detection of endotoxemia with GN bacteremia), which is markedly increased. Note that these ORs for mortality risk as estimated here are all less than those found in the previous analysis that contained fewer studies 57.

Second, the I2 associated with each summary OR are all 0% with the exception of that associated with the OR for group one versus group four derived from all 35 studies. With this latter exception, this absence of heterogeneity is surprising given the diversity of patient groups, underlying risk, and numbers and settings of these studies that have been conducted and published over a period exceeding three decades.

Third, the underlying patient risk, as reflected in the group four mortality proportion, was higher for studies of patients with sepsis in ICU settings versus studies in other settings (Figure 5a, b, and Figure 5c), as might be expected. However, with the notable exception of the co-detection of group one (endotoxemia with GN bacteremia), the additional risk for each of group two (GN bacteremia alone) and group three (endotoxemia alone) versus group four (neither) is generally similar in the ICU versus the non-ICU setting.

Finally, there are important differences in the prevalence and species types of GN bacteremias among these studies. Of the patients included within the studies of this meta-analysis (not counting GN bacteremias from studies of specified infections or studies in which the species types of GN bacteremia was not stated), 21% had GN bacteremia detected (group one and group two) of which 33% were E. coli whereas only 16% were P. aeruginosa. However, there are reciprocal differences in the frequency of P. aeruginosa versus E. coli among the bacteremias of groups one and two. The reciprocal distribution is a consequence of differences in endotoxemia detection rates, being more common for GN bacteremias with P. aeruginosa versus E. coli. This reciprocal distribution for different GN bacteremia species types is apparent among a broader collection of studies that used the limulus assay 43. Likewise, among 57 GN bacteremias found in a therapeutic trial in patients with septic shock selected on the basis of a positive detection of endotoxemia using the limulus assay, 15 versus only 12 of the GN bacteremias were P. aeruginosa versus E. coli, respectively 58.

The relative frequencies of bacteremias with P. aeruginosa versus bacteremias with E. coli among the studies are of interest for two reasons. The mortality risk for these two common bacteremias differs 59. For example, in the literature experience over thirty years to 2004, the mortality associated with P. aeruginosa bacteremia was typically 32% versus the mortality associated with E. coli bacteremia which was typically 19% 60. The basis for this higher mortality risk is multi-factorial with patient 4761 and treatment 6263 factors contributing. Also of interest are the structural differences in lipid-A, the biologically active component of endotoxin (lipopolysaccharide, LPS) 45, specific for P. aeruginosa versus E. coli. The different lipid-A structures of P. aeruginosa versus E. coli confer potency differences which are apparent in vitro 6465, and in vivo 66. While the clinical significance of these potency differences is unclear, the resulting unequal distributions of bacteremias among groups one and two uncovered here may confound the apparent relationship between endotoxemia and mortality risk.

Limitations

This overview is based on a summation of disparate observational studies in an attempt to identify confounders underlying the disparate observations regarding endotoxemia and mortality risk in the literature. This analysis is unable to identify the mechanism for any increased risk. Many relevant patient specific details such as age and co-morbidities for the patients of the four groups in each study were not available. In this analysis, a variable proportion of blood cultures that were classified as negative for GN bacteria would have yielded gram positive bacteremias or fungemias. The detection of endotoxemia in association with blood culture isolates other than GN bacteremias is a commonly reported finding 2541. In this respect, the prognostic impact of blood stream infections other than GN bacteremias in relation to the co-detection with endotoxemia has not been addressed here. Moreover, the origin of endotoxemia for patients in group three is uncertain and the possibility of endotoxin originating from other sources, such as gut barrier breakdown, as is presumed to occur for non-septic forms of shock, needs to be considered 67. Also, it needs to be noted that endotoxemia and GN bacteremia are each either episodic or dynamic 68 phenomena and the criteria for a positive detection of each will have differed among the studies.

The additional mortality associated the co-detection of endotoxemia and GN bacteremia (group one) was less apparent in the studies of patients at high versus low underlying risk (Table 1). This finding here at a group level of analysis resembles other recent findings at an individual patient level of analysis among bacteremias of all species types occurring in an ICU setting 46. However, this inference requires caution for three reasons.

Firstly, it needs to be clarified as to whether the increased risk is absolute 47 or relative 46.

Second, the proportion of GN bacteremia types that are other than E. coli is more variable in studies outside of the ICU setting. In particular, there were five non-ICU studies 511122124 with an unusually high proportion of isolates other than E. coli among the GN bacteremias.

Third, it should be cautioned that the L'Abbé plots are useful merely as simple graphical methods to facilitate visual comparisons of the group mortality proportion over the range of underlying risk as found in individual studies within a meta-analysis 56. The issues underlying the statistical testing for variation in either additional risk or treatment effect in relation to underlying risk are not simple 6970. In particular, where linear regression has been used within L'Abbe plots to explore heterogeneity over a range of underlying risk in other contexts, regression to the mean is an important consideration as noted among treatment studies of mild hypertension 71.

In this analysis, group four, which is usually the largest group in each study, serves not only as the reference group for each study in the derivation of the ORs (Table 2) but also as a surrogate marker for the underlying mortality risk within each study (Figures 5a, b, and Figure 5c). However, this proportion will be an imprecise marker in small studies and studies with less restrictive patient selection. As a consequence of this imprecision, proportion estimates from small studies will have reference and comparator groups that by chance will be either more or less extreme than the average and hence, the accompanying comparator or reference group, respectively, will tend to be closer to the mean 72. This regression to the mean will cause these outlier studies to have a disproportionate impact on the overall relationship with underlying risk and will tend to inflate any deviation of a derived regression relationship with underlying risk away from the null. In the analysis here however, linear regression has not been used and the studies that trended away from the null in the L'Abbe plots were generally neither the smaller studies nor the studies with high event rates among group four.

There were insufficient studies that had used assays other than the limulus assay, or patient groups that had received anti-endotoxin antibodies to include these studies so as to enable a study of these variables by meta-regression. Only seven studies 11121314151617 were limited to specific GN bacteremia species types. Also, many relevant study level details, such as method of blood culture used and antibiotic therapy protocols were not available. Anti-endotoxin antibodies are detectable in patients with severe sepsis and septic shock and the kinetics of these antibodies over time differs between survivors and non-survivors 73. However, the impact of these anti-endotoxin antibodies on both the detection of endotoxemia and possibly also on patient outcome within the studies examined here is uncertain. A more detailed examination adjusting for relevant prognostic variables contributing to underlying patient level risk and also the inter-relation between various GN bacteria known to have differing lipid-A structures would require an individual patient data meta-analysis.

With these findings, it is now possible to re-appraise the relationship between endotoxemia detection and mortality risk as observed in the broader literature. With the patient populations dichotomized into endotoxemia positive versus negative, only five 511122124 of the 35 studies included in this analysis found differences in mortality proportions exceeding 20 percentage points (data not shown) and in all five of these studies there was an unusually high proportion of isolates other than E. coli (for example, P. aeruginosa or N. meningitidis) among the GN bacteremias and none of these five studies were restricted to ICU populations. There were a further four large studies in an ICU setting 36373839 that had not been included in this analysis as the mortality proportions were not extractable into a 2 × 2 × 2 contingency table format or used endotoxemia assays other than the limulus assay. None of these four additional studies found differences in mortality proportions exceeding 15 percentage points between endotoxemia positive versus negative patients. While one study had E. coli accounting for two of the four GN bacteremias 38, the GN bacteremia species types were not stated in the other three studies. One large non-ICU study did not report mortality as an outcome 40.

While some of the studies were conducted more than thirty years ago, they remain of interest due to the unresolved conflicting conclusions that continue to emerge. These large studies are difficult and expensive to undertake. An understanding of the previous uncertainties would assist in the planning of any further studies to be undertaken.

The extent to which the species type and prevalence of GN bacteremia confounds the relationship between the detection of endotoxemia and outcome and in the evaluation of anti-endotoxin and other adjuvant therapies for sepsis warrants further consideration 747576.

Conclusions

The underlying patient risk and the GN bacteremia species types within a study may be unrecognized confounders in the interpretation of the predictive value of endotoxemia. This may not only help to resolve conflicting observations in the clinical literature but may also help to bridge the 'disconnect' with animal models of sepsis. Clarification will help toward defining the exact role of endotoxemia within the pathogenesis of GN sepsis and the evaluation of anti-endotoxin and other adjuvant therapies for sepsis.

Key messages

• There are conflicting conclusions regarding the prognostic value of endotoxemia detection among more than forty studies in various ICU and non-ICU settings.

• Using the limulus assay for endotoxemia detection, less than two thirds of patients with GN bacteremia have endotoxemia detected and vice versa.

• The mortality risk in association with the detection of endotoxemia or GN bacteremia either alone or together versus the detection of neither is generally either non-significant or borderline (OR <2) when derived from only the nine studies in an ICU setting.

• The co-detection of GN bacteremia and endotoxemia is most predictive of increased mortality risk versus the detection of neither but only in studies undertaken outside of an ICU setting.

• Variation in GN bacteremia species types and underlying risk are likely unrecognized confounders in the individual studies.

Abbreviations

CI: confidence interval; GN: gram negative; LPS: lipopolysaccharide; ND: no data; OR: odds ratio.

Competing interests

The authors declare that they have no competing interests. Financial support was provided by The University of Melbourne. The funder had no role in the design, analysis or writing of this study or in its submission for publication.

Authors' contributions

JCH contributed to the study design, literature search, data analysis, writing and final approval of the manuscript for submission. BG, GO and EM contributed to the literature search, provision of original data and final approval of the submission. All authors read and approved the final manuscript.

Acknowledgements

We thank Dr P Brandtzaeg, Ulleval Hospital, Norway; Dr D Berger, Ulm University, Germany; Dr B Byl, Erasme University Hospital, Belgium, Mr JYM Lau, Chinese University of Hong Kong; Dr P Engervall, Karolinska Hospital, Sweden; Dr M Yoshida, Jichi Medical School, Japan; Prof Steven M Opal, MD, Infectious Disease Division, The Alpert Medical School of Brown University, Providence, Rhode Island; Prof J Van Dissel, Leiden University Medical Center, The Netherlands; Dr D Bates, Brigham and Women's Hospital, United States; Dr R Danner, NIH, Bethesda United States; Dr KCH Fearon, Royal Infirmary, Edinburgh; Dr EJ Giamarellos-Bourboulis, Attikon University Hospital, Greece; and Dr J Prins, Academic Medical Center, The Netherlands; for the clarification of previously published data. This manuscript has been submitted in partial fulfilment for the degree of Doctor of Medical Science at The University of Melbourne.

<p>Detection of endotoxin in sera from children hospitalized for treatment of diarrhea in Bangladesh</p>AhmedTAzamMAArmedNJamilKMHassanFOguraNTamuraHYokochiTJ Endotoxin Res20041022322815373965<p>Circulating endotoxin and tumor necrosis factor during pediatric cardiac surgery</p>CaseyWFHauserGJHannallahRSMidgleyFMKhanWNCrit Care Med1992201090109610.1097/00003246-199208000-000041643887<p>Plasma limulus gelation assay in infants and children: correlation with gram negative bacterial infection and evidence for "intestinal endotoxemia"</p>CooperstockMRiegleLProg Clin Biol Res19851893293454048212<p>Endotoxemia in protein-energy malnutrition</p>KleinKFuchsGJKulapongsPMertzGSuskindRMOlsonREJ Pediatr Gastroenterol Nutr1988722522810.1097/00005176-198803000-000123127570<p>Serial quantitation of endotoxemia and bacteremia during therapy for gram-negative bacterial sepsis</p>ShenepJLFlynnPMBarrettFFStidhamGLWestenkirchnerDFJ Infect Dis198815756556810.1093/infdis/157.3.5653343526<p>Endotoxin, bile salts and renal function in obstructive jaundice</p>BaileyMEBr J Surg19766377477810.1002/bjs.1800631011791436<p>Endotoxemia and mediator release during colonoscopy</p>BergerDBoelkeEStanescuAButtenschoenKVasilescuCSeidelmannMBegerHGEndoscopy19952767167510.1055/s-2007-10057858903980<p>Endotoxaemia and complement activation in acute pancreatitis in man</p>FoulisAKMurrayWRGallowayDMcCartneyACLangEVeitchJWhaleyKGut19822365666110.1136/gut.23.8.65614191387095560<p>Endoscopic drainage aborts endotoxaemia in acute cholangitis</p>LauJYChungSCLeungJWLingTKYungMYLiAKBr J Surg19968318118410.1002/bjs.18008302108689158<p>Endotoxemia during percutaneous manipulation of the obstructed biliary tree</p>LumsdenABHendersonJMAlspaughJAm J Surg1989158212410.1016/0002-9610(89)90308-52742045<p>Plasma endotoxin as a predictor of multiple organ failure and death in systemic meningococcal disease</p>BrandtzaegPKierulfPGaustadPSkulbergABruunJNHalvorsenSSorensenEJ Infect Dis198915919520410.1093/infdis/159.2.1952492587<p>The excessive complement activation in fulminant meningococcal septicemia is predominantly caused by alternate pathway activation</p>BrandtzaegPHogasenKKierulfPMollnesTEJ Infect Dis199617364765510.1093/infdis/173.3.6478627028<p>Bubonic plague: detection of endotoxemia with the limulus test</p>ButlerTLevinJCuDQWalkerRIAnn Intern Med1973796426464584566<p><it>Yersinia pestis </it>infection in Vietnam. II. Quantitative blood cultures and detection of endotoxin in the cerebrospinal fluid of patients with meningitis</p>ButlerTLevinJLinhNNChauDMAdickmanMArnoldKJ Infect Dis197613349349910.1093/infdis/133.5.4931262715<p>Clinical experience in detecting endotoxemia with the limulus test in typhoid fever and other <it>Salmonella </it>infections</p>MagliuloEScevolaDFumarolaDVaccaroRBertottoABurberiSInfection19764212410.1007/BF01638343977132<p>Presence of endotoxemia and its relationship to liver dysfunction in patients with typhoid fever</p>AdinolfiLEUtiliRGaetaGBPernaPRuggieroGInfection19871535936210.1007/BF016477403692608<p>Plasma endotoxin in typhoid fever</p>SuyasaIGRekaIGInadaKSudaHKojimaMMushiakiKOkamotoSYoshidaMKobe J Med Sci1995411751868929638<p>Selective decontamination of the digestive tract reduces gram-negative pulmonary colonization but not systemic endotoxemia in patients undergoing elective liver transplantation</p>BionJFBadgerICrosbyHAHutchingsPKongKLBakerJHuttonPMcMasterPBuckelsJAElliottTSCrit Care Med19942240498124972<p>Endotoxemia in febrile patients with hematological malignancies. Relationship of type of bacteremia, clinical findings and serum cytokine pattern</p>EngervallPGranstromMAnderssonBKalinMBjorkholmMInfection1997252710.1007/BF021134989039529<p>Plasma endotoxin and cytokine levels in neutropenic and non-neutropenic bacteremic patients</p>HynninenMValtonenMVaaraMMarkkanenHKuuselaPSaxenHTakkunenOEur J Clin Micro Infect Dis1995141039104510.1007/BF01590936<p>Diagnostic and prognostic significance of plasma endotoxin determination in febrile patients with haematological malignancies</p>YoshidaMObayashiTTamuraHTanakaSKawaiTSakamotoSMiuraYEur J Cancer199430A1451478155385<p>Ceftazidime- and imipenem-induced endotoxin release during treatment of gram-negative infections</p>BylBClevenberghPKentosAJacobsFMarchantAVincentJLThysJPEur J Clin Microbiol Infect Dis20012080480710.1007/s10096010060911783697<p>Impact of cefuroxime administration on endotoxin (LPS) and tumour necrosis factor-a (TNF-a) blood levels in patients suffering from acute pyelonephritis: a preliminary report</p>Giamarellos-BourboulisEJPerdiosJLelekisMEoconomouETsouroulasPGiamarellouHInt J Antimicrob Agents19991111511910.1016/S0924-8579(98)00106-X10221414<p>Gram-negative sepsis: detection of endotoxemia with the limulus test. With studies of associated changes in blood coagulation, serum lipids and complement</p>LevinJPooreTEYoungNSMargolisSZauberNPTownesASBellWRAnn Intern Med197276175021550<p>Limitations of the usefulness of the limulus assay for endotoxin</p>StumacherRJKovnatMJMcCabeWRN Engl J Med19732881261126410.1056/NEJM1973061428824024574106<p>Endotoxin, cytokines, and procalcitonin in febrile patients admitted to the hospital: identification of subjects at high risk of mortality</p>van LangeveldePJoopKvan LoonJFrolichMGroeneveldPHPWestendorpRGJvan DisselJTClin Infect Dis2000311343134810.1086/31748011096000<p>Limulus amebocyte lysate assay for detection of endotoxin in patients with sepsis syndrome. AMCC Sepsis Project Working Group</p>BatesDWParsonnetJKetchumPANovitskyTJSandsKHibberdPLGramanPSLankenPNClin Infect Dis19982758259110.1086/5147139770160<p>Endotoxemia in human septic shock: relation to gastric intra-mucosal pH</p>BillardJ-LBerthier-BerradaSPageYGéryPVermeschRPageDRosABertrandMBertrandJCCrit Care Med199422A113<p>Endotoxemia in human septic shock</p>DannerRLElinRJHosseiniJMWesleyRAReillyJMParillloJEChest19919916917510.1378/chest.99.1.1691984950<p>Patterns of cytokines, plasma endotoxin, plasminogen activator inhibitor, and acute phase proteins during the treatment of severe sepsis in humans</p>DofferhoffASBomVJde Vries-HospersHGvan IngenJvd MeerJHazenbergBPMulderPOWeitsJCrit Care Med19922018519210.1097/00003246-199202000-000071371097<p>Natural cytokine antagonists and endogenous anti-endotoxin core antibodies in sepsis syndrome</p>GoldieASFearonKCRossJABarclayGRJacksonREGrantISRamsayGBlythASHowieJCJAMA199527417217710.1001/jama.1995.035300200900387596007<p>Endotoxemia and bacteremia in patients with sepsis syndrome in the intensive care unit</p>GuidetBBarakettVVassalTPetitJCOffenstadtGChest19941061194120110.1378/chest.106.4.11947924495<p>Relationship of antibodies to endotoxin core to mortality in medical patients with sepsis syndrome</p>StrutzFHellerGKrasemannKKroneBMullerGAIntensive Care Med19992543544410.1007/s00134005087710401935<p>Effectiveness of a human monoclonal anti-endotoxin antibody (HA-1A) in Gram-negative sepsis: relationship to endotoxin and cytokine levels</p>WortelCHvon der MohlenMAvan DeventerSJSprungCLJastremskiMLubbersMJSmithCRAllenIEten CateJWJ Infect Dis19921661367137410.1093/infdis/166.6.13671431255<p>Relationship between plasma levels of lipopolysaccharide (LPS) and LPS-binding protein in patients with severe sepsis and septic shock</p>OpalSMScannonPJVincentJLWhiteMCarrollSFPalardyJEParejoNAPribbleJPLemkeJHJ Infect Dis19991801584158910.1086/31509310515819<p>Plasma cytokine and endotoxin levels correlate with survival in patients with the sepsis syndrome</p>CaseyLCBalkRABoneRCAnn Intern Med19931197717788379598<p>A rapid quantitative assay to detect circulating endotoxin can predict the development of multiorgan dysfunction</p>KollefMHEisenbergPRChest199711217318010.1378/chest.112.1.1739228373<p>Diagnostic and prognostic implications of endotoxemia in critical illness: results of the MEDIC study</p>MarshallJCFosterDVincentJLCookDJCohenJDellingerRPOpalSAbrahamEBrettSJSmithTMehtaSDerzkoARomaschinAJ Infect Dis200419052753410.1086/42225415243928<p>Endotoxaemia in patients with severe sepsis or septic shock</p>VenetCZeniFViallonARossAPainPGeryPPageDVermeschRBertrandMRanconFBertrandJCIntensive Care Med20002653854410.1007/s00134005120110923727<p>Endotoxemia: an early predictor of septicemia in febrile patients</p>van DeventerSJHBullerHRten CateJWSturkAPauwWLancet198816056082894546<p>Lack of clinical usefulness of the limulus test in the diagnosis of endotoxemia</p>ElinRJRobinsonRALevineASWolffSMN Engl J Med197529352152410.1056/NEJM1975091129311021152876<p>Does gram negative bacteremia occur without endotoxemia? A meta-analysis using hierarchical summary ROC curves</p>HurleyJCEur J Clin Microbiol Infect Dis20102920721510.1007/s10096-009-0841-220084488<p>The detection of endotoxemia with Gram negative bacteremia is bacterial species dependent: A meta-analysis of clinical studies</p>HurleyJCJ Clin Microbiol2009473826383110.1128/JCM.01189-09278662119794055<p>Endotoxemia: methods of detection and clinical correlates</p>HurleyJCClin Micro Rev199582682921728597621402<p>Sensing gram-negative bacterial lipopolysaccharides: a human disease determinant?</p>MunfordRSInfect Immun20087645446510.1128/IAI.00939-07222345518086818<p>Risk of mortality with blood stream infection is higher in the less severely ill at admission</p>KimPWPerlTMKeelaghanEFLangenbergPPerencevichENHarrisADSongXRoghmannMCAm J Respir Crit Care Med200517161662015591469<p>Gram negative bacteremia. II Clinical laboratory and therapeutic observations</p>McCabeWRJacksonGGArch Intern Med196211085686410.1001/archinte.1962.03620240038007<p>Risk and the efficacy of antiinflammatory agents: retrospective and confirmatory studies of sepsis</p>EichackerPQParentCKalilAEspositoCCuiXBanksSMGertenbergerEPFitzYDannerRLNatansonCAm J Respir Crit Care Med20021661197120510.1164/rccm.200204-302OC12403688<p>Animal models of sepsis: why does preclinical efficacy fail to translate to the clinical setting?</p>DysonASingerMCrit Care Med200937S30S3710.1097/CCM.0b013e3181922bd319104223<p>The disconnect between animal models of sepsis and human sepsis</p>RittirschDHoeselLMWardPAJ Leukoc Biol20078113714317020929<p>The value of animal models in the development of new drugs for the treatment of the sepsis syndrome</p>MichieHRJ Antimicrob Chemother199841suppl 1474910.1093/jac/41.suppl_1.479630374<p>Animal models of sepsis and shock: a review and lessons learned</p>DeitchEAShock199891119734290<p>Endotoxemia and gram-negative bacteremias predictors of outcome in sepsis: a call for data</p>HurleyJCJ Endotox Res20017467<p>Metan: fixed and random effects-meta-analysis</p>HarrisRJBradburnMJDeeksJJHarbordRMAltmamnDGSterneJACStata J20088328<p>Measuring inconsistency in meta-analyses</p>HigginsJPThompsonSGDeeksJJAltmanDGBMJ200332755756010.1136/bmj.327.7414.55719285912958120<p>Meta-analysis in clinical research</p>L'AbbeKADetskyASO'RourkeKAnn Intern Med19871072242333300460<p>Endotoxemia and Gram-negative bacteremia as predictors of outcome in sepsis: a meta-analysis using ROC curves</p>HurleyJCJ Endotoxin Res2003927127914577843<p>Treatment of gram-negative septic shock with an immunoglobulin preparation: a prospective, randomized clinical trial</p>SchedelIDreikhausenUNentwigBHöckenschniederMRauthmannDBalikciogluSColdeweyRDeicherHCrit Care Med1991191104111310.1097/00003246-199109000-000031884609<p>A three-year study of positive blood cultures, with emphasis on prognosis</p>RobertsFJGeereIWColdmanARev Infect Dis19911334462017629<p>New method of classifying infections in critically ill patients</p>CohenJCristofaroPCarletJOpalSCrit Care Med20013215101526<p>Etiologic organisms as independent predictors of death and morbidity associated with bloodstream infections</p>MillerPJWenzelRPJ Infect Dis198715647147710.1093/infdis/156.3.4713611832<p>Bloodstream infections caused by antibiotic-resistant gram-negative bacilli: risk factors for mortality and impact of inappropriate initial antimicrobial therapy on outcome</p>KangCIKimSHParkWBLeeKDKimHBKimECOhMDChoeKWAntimicrob Agents Chemother20054976076610.1128/AAC.49.2.760-766.200554723315673761<p><it>Pseudomonas aeruginosa </it>bloodstream infection: importance of appropriate initial antimicrobial treatment</p>MicekSTLloydAERitchieDJReichleyRMFraserVJKollefMHAntimicrob Agents Chemother2005491306131110.1128/AAC.49.4.1306-1311.2005106861815793102<p>Endotoxin evaluation of eleven lipopolysaccharides by whole blood assay does not always correlate with Limulus amebocyte lysate assay</p>DehusOHartungTHermannCJ Endotoxin Res20061217118010.1179/096805106X10215616719988<p>Studies on the sensitivity and specificity of the Limulus amebocyte lysate test and rabbit pyrogen assays</p>DevleeschouwerMJCornilMFDonyJAppl Environ Microbiol198550150915112387893911908<p><it>Pseudomonas aeruginosa </it>compared with <it>Escherichia coli </it>produces less endotoxemia but more cardiovascular dysfunction and mortality in a canine model of septic shock</p>DannerRLNatansonCElinRJHosseiniJMBanksSMacVittieTJParrilloJEChest1990981480148710.1378/chest.98.6.14802245691<p>The bacterial factor in traumatic shock</p>FineJFrankEDRavinHARutenbergSHSchweinburgFBN Engl J Med195926021422010.1056/NEJM19590129260050513622952<p>Daily variation in endotoxin levels is associated with increased organ failure in critically ill patients</p>KleinDJDerzkoAFosterDSeelyAJBrunetFRomaschinADMarshallJCShock20072852452917589381<p>Analysing the relationship between treatment effect and underlying risk in meta-analysis: comparison and development of approaches</p>SharpSJThompsonSGStat Med2000193251327410.1002/1097-0258(20001215)19:23<3251::AID-SIM625>3.0.CO;2-211113958<p>Exploring heterogeneity in meta-analysis: is the L'Abbé plotuUseful?</p>SongFJ Clin Epidemiol199958717723<p>Risks and benefits of treating mild hypertension: a misleading meta-analysis?</p>EggerMDavey SmithGJ Hypertension19951381381510.1097/00004872-199507000-00014<p>Regression to the mean: what it is and how to deal with it</p>BarnettAGvan der PolsJCDobsonAJInt J Epidemiol20053421522015333621<p>Circulating endotoxin and antiendotoxin antibodies during severe sepsis and septic shock</p>MauryEBlanchardHSChauvinPGuglielminottiJAlzieuMGuidetBOffenstadtGJ Crit Care20031811512010.1053/jcrc.2003.5000412800122<p>Anti-endotoxin monoclonal antibodies</p>WarrenHSDannerRLMunfordRSN Engl J Med19923261153115710.1056/NEJM1992042332617111552919<p>Endotoxin as a drug target</p>OpalSGluckTCrit Care Med200331S57S6410.1097/00003246-200301001-0000912544978<p>Reappraisal of the role of endotoxin in the sepsis syndrome</p>HurleyJCLancet19933411133113510.1016/0140-6736(93)93139-R8097815