Paperonium

← Back to the plain-language case

Abstract reports a 31% fall in endotoxin activity on the prudent diet; Results report 38%

Gastroenterology (2012) Β· doi:10.1053/j.gastro.2012.01.034 Β· PMC3978718

Summary

This short crossover study fed 8 healthy inpatients a Western-style diet and a prudent-style diet for 1 month each and measured plasma endotoxin activity before and after each diet. The abstract says the prudent-style diet reduced endotoxin activity by 31%. The Results paragraph that cites Figure 1 says the decrease was 38%. Both passages describe the same subjects, assay and before/after comparison, and both give the same +71% for the Western-style diet. Rounding cannot produce a 7-point gap. The paper prints no group means for endotoxin activity, only the individual-subject plots in Figure 1. Reading those plots by eye gives a 37.5% fall in the group mean, which supports the Results figure. The abstract's 31% matches no single summary method that also gives +71% for the Western diet. The abstract is the number most likely to be quoted, so the size of the prudent-diet effect is now ambiguous in the literature. The direction of the effect, the Western-diet result and the paper's conclusions are unaffected.

What the paper reports

Abstract:

Placing 8 healthy subjects on a Western-style diet for 1 month induced a 71% increase in plasma levels of endotoxin activity (endotoxemia), whereas a prudent-style diet reduced levels by 31%.

Main text, Results paragraph (the paragraph that cites Figure 1 and Table 1):

Our study shows that 4 weeks of feeding a Western-style diet induced highly significant increases (by 71%) in plasma endotoxin activity levels, in contrast to a major decrease (by 38%) after the prudent-style diet (Figure 1) (P < .001).

Main text, same paragraph:

Baseline endotoxin activity levels were about identical

Main text, study description. This shows that both passages concern one group of subjects and one design:

Briefly, 8 healthy subjects were fed a Western-style and a β€œprudent-style” diet for 1 month as inpatients hospitalized in a metabolic ward in a crossover study separated by a 1-month washout period.

Figure 1 legend:

Data from 8 individual subjects shown as endotoxin activity units for the Western-style diet (WD) and the prudent-style diet (PD). Paired t tests were used to compare effects of the diets on endotoxin activity levels. The Mann–Whitney sum test was used to compare effects of the 2 diets on endotoxin activity levels.

In the Figure 1 image, panels A (Western diet, before vs after) and B (prudent diet, before vs after) are labelled "P≀.05". Panel D, which compares the two diets after the intervention, is labelled "P≀.001". Neither the text nor the figure gives a group mean, SD or percentage for endotoxin activity. Table 1 gives cytokine concentrations only, as before and after means with a "Change (%)" column.

What the paper's own numbers show

Method. The paper reports the endotoxin results only as two percentages and as individual-subject lines in Figure 1, panels A and B (8 subjects each). I read each subject's before and after values off the enlarged figure image by eye. Each reading is uncertain by about Β±0.005 activity units. These readings are approximations, not the authors' data. From them I computed the percentage change in four standard ways: - the change in the group mean (mean after / mean before βˆ’ 1); - the mean of each subject's own percentage change; - the geometric mean of the after/before ratios; - the change in the median.

To carry the reading error through, I added independent uniform Β±0.005 noise to every point, repeated this 20,000 times and took the 2.5–97.5 percentile band of each statistic. As a check on which method the authors used elsewhere, I recomputed Table 1's cytokine percentages from its rounded means. All calculations are in recompute.py.txt.

Quantity Location Reported Recomputed
Prudent diet, change in endotoxin activity Abstract βˆ’31% β€” (same quantity as the next row)
Prudent diet, change in endotoxin activity Results paragraph citing Fig. 1 βˆ’38% β€”
Gap between the two printed values Abstract vs Results β€” 7 percentage points (23% of the abstract value); post/baseline ratio 0.69 vs 0.62
Western diet, change in endotoxin activity Abstract and Results +71% (both) β€”
Prudent diet, group mean before β†’ after Fig. 1B (read by eye) not reported 0.115 β†’ 0.072 units
Western diet, group mean before β†’ after Fig. 1A (read by eye) not reported 0.120 β†’ 0.207 units
Prudent diet, change of group means Fig. 1B βˆ’31% / βˆ’38% βˆ’37.5% (band βˆ’39.5 to βˆ’35.4)
Western diet, change of group means Fig. 1A +71% +72.2% (band +69.0 to +75.5)
Prudent diet, mean of per-subject % changes Fig. 1B β€” βˆ’33.3% (band βˆ’35.9 to βˆ’30.4)
Western diet, mean of per-subject % changes Fig. 1A β€” +80.2% (band +75.6 to +85.3)
Prudent / Western, geometric mean ratio Fig. 1A–B β€” βˆ’35.7% (βˆ’38.4 to βˆ’33.1) / +71.3% (+66.9 to +75.9)
Prudent / Western, change of medians Fig. 1A–B β€” βˆ’28.7% (βˆ’33.5 to βˆ’24.1) / +78.3% (+71.8 to +85.5)
Within-diet paired t test, PD / WD Results text; Fig. 1A–B labels "P < .001" (text); "P≀.05" (figure) p β‰ˆ 0.020 / 0.017 (from figure readings)
Table 1, PD cytokines: TNF-Ξ±, MCP-1, IL-6, IL-8 Table 1 βˆ’17, βˆ’9, βˆ’11, βˆ’28% βˆ’16.0, βˆ’8.7, βˆ’12.5, βˆ’26.3% (change of rounded means)
Table 1, WD cytokines: TNF-Ξ±, MCP-1, IL-6, IL-8 Table 1 βˆ’1, βˆ’9, βˆ’2, βˆ’13% 0.0, βˆ’9.1, 0.0, βˆ’11.8% (change of rounded means)

Three findings stand out: - The change in the group mean, read off Figure 1, reproduces both the Results' βˆ’38% and the shared +71%. - The geometric mean ratio also gives values close to βˆ’38% and +71%. - The only methods whose bands reach βˆ’31% are the mean of per-subject changes and the change of medians. Both give +78% to +80% for the Western diet, not the +71% printed beside the 31% in the abstract.

Table 1's printed percentages agree, within the rounding of its means, with the change-of-means method. This fits the 38% value, although rounded means cannot rule out other methods.

Figure

Abstract and Results excerpts giving different prudent-diet decreases for the same comparison

The two passages that report the prudent-diet result, as printed in the archived article. In orange are the paper's values: the abstract gives a 31% decrease and the Results paragraph citing Figure 1 gives a 38% decrease. Both concern the same 8 subjects, the same neutrophil-priming assay and the same before/after comparison, and both pair the value with an identical +71% for the Western-style diet. The footer gives the change of group means computed in recompute.py.txt from Figure 1 values read by eye.

Percent change in endotoxin activity under four summary methods, compared with the printed values

Percentage change in endotoxin activity recomputed from the individual values in Figure 1, read by eye (blue dots), under four summary methods. The bars show the 2.5–97.5 percentile range when each reading is perturbed by Β±0.005 units. The dashed orange lines are the printed values: βˆ’31% (abstract), βˆ’38% (Results) and +71% (both). The left cluster is the prudent diet and the right cluster the Western diet, on one shared axis. The change of group means and the geometric mean ratio match βˆ’38% and +71% together. No method matches βˆ’31% and +71% together.

Why it matters

The abstract is where readers, reviews and meta-analyses usually take effect sizes from. Here it gives a prudent-diet reduction (31%, ratio 0.69) that differs from the body (38%, ratio 0.62) by 7 percentage points, or about 23% of the abstract value. A reader who compares the two diets gets a different contrast depending on the source: a post-diet ratio of 1.71/0.69 β‰ˆ 2.48 between diets if the abstract is right, against 1.71/0.62 β‰ˆ 2.76 if the body is right. Because the paper prints no group means or SDs for endotoxin activity, a reader cannot tell from the article which value is correct. Anyone sizing a follow-up study or pooling this result has to choose between two figures the paper gives for the same quantity.

The error is limited in scope: - The Western-diet +71%, the result named in the title, is the same in both places. - The prudent diet lowers endotoxin activity in both statements. - The cytokine results in Table 1 and the paper's qualitative interpretation do not depend on which value is correct.

A smaller, related point concerns the P value. The Results sentence attaches "P < .001" to the within-diet changes. The Figure 1 panels for those changes (A and B) are labelled "P≀.05", and the figure readings give paired-t p-values of about 0.02. The "P≀.001" label appears only on panel D, the between-diet comparison after the intervention. The Results sentence may be citing the panel D value. As written, though, it reads as applying to the within-diet changes.

Explanations considered

Status

As of 2026-10-23:

Suggested correction

The authors could state which value is correct for the change in plasma endotoxin activity after the prudent-style diet. They could also give the group mean (SD) endotoxin activity before and after each diet, and say how the percentage change was calculated (for example, change of group means or mean of per-subject changes). If the Results value is correct, the abstract would read: "…whereas a prudent-style diet reduced levels by 38%." If the abstract value is correct, the Results sentence would need the same correction. The authors could also say which comparison the "P < .001" in the Results sentence refers to, since Figure 1 labels the within-diet changes "P≀.05" and only the between-diet comparison after the intervention "P≀.001".