Paperonium

← Back to the plain-language case

Settlement ANOVA reports F(12,80) = 0.771 with p < 0.001; that F gives p = 0.68

Proc Biol Sci (2025) · doi:10.1098/rspb.2025.0729 · PMC12187397

Summary

The Results report the host × tile interaction for zygote settlement as "ANOVA, F12,80 = 0.771, p < 0.001". The degrees of freedom match the stated 4 × 5 crossed design with n = 5 tiles per combination. On (12, 80) df, however, F = 0.771 has an upper-tail p of 0.678, and p < 0.001 would need F ≥ 3.16. Supplementary Table S6 prints the same F, and that F equals the table's own mean-square ratio (11000 / 14271), so the inconsistent entry is the p-value, not the F. The same table also prints p < 0.001 for the tile main effect, F(4,80) = 1.638, which gives p = 0.173. This is the only reported omnibus test of the settlement experiment, and the abstract and Discussion describe an "interactive effect" of host- and benthic-associated microbiota on settlement.

What the paper reports

All quotations are verbatim from the article as archived in PMC (checked with src/show.py), except the Table S6 excerpt, which is from the electronic supplementary material.

Methods, "Effect of disruption of host and benthic microbiota on zygote settlement", second paragraph:

Zygotes, released and fertilized by the macroalgal individuals used in the host experiment described above, were introduced to the tiles in an experimental design in which all host and tile treatments were crossed (20 treatment combinations; n = 5 tiles and females per treatment combination).

Methods, "Statistical analyses":

to test for the effect of host and tile microbial disruption on zygote settlement we used a two-factor ANOVA (host and tile factors, fixed, crossed, 4 and 5 levels, respectively) using the GAD package in R (v.4.0.3).

Post hoc contrasts (emmeans R package) were used to examine significant main effects or interactions, as appropriate.

Results, "Effect of microbial disruption on settlement of zygotes", first sentence:

Disruption to the host- and tile-associated microbiota caused significant, but complex and interactive, effects on the settlement of Hormosira’s zygotes (ANOVA, F12,80 = 0.771, p < 0.001, electronic supplementary material, table S6, figure 4).

Same section, second paragraph:

Furthermore, post hoc tests showed that all tiles where the microbiota was disrupted by autoclaving had significantly lower levels of settlement (by approximately 7%) than those that were not autoclaved, which was generally consistent across all host treatments (electronic supplementary material, table S6).

Abstract:

Disruption of host- and benthic-associated microbiota, in combination, caused a significant decrease in settlement of H. banksii zygotes, with the combined disruption having the greatest impact on settlement success. Our results demonstrate the importance of host-associated microbiota in macroalgal reproduction and an interactive effect of host- and benthic-associated microbiota on settlement

Discussion, first paragraph:

Furthermore, microbiota associated with both the adult host and the benthic substratum had a strong interactive effect on zygote settlement and morphogenesis.

Electronic supplementary material (rspb20250729_si_001.docx), Supplementary Table 6, ANOVA rows (columns Df | Sum of Sq | Mean Sq | F | P-value):

Host Treatment | 3 | 34724483 | 11574828 | 811.063 | <0.001
Tile Treatment | 4 | 93486 | 23371 | 1.638 | <0.001
Host Treatment * Tile Treatment | 12 | 132002 | 11000 | 0.771 | <0.001
Residual | 80 | 1213050 | 14271 | |

What the paper's own numbers show

Method. I derived the degrees of freedom from the design stated in the Methods (4 host levels × 5 tile levels × 5 tiles = 100 observations) and compared them with the printed df. I then computed the upper-tail p-value of each printed F on its printed df with scipy.stats.f. For each row of Table S6 I also checked SS / df against the printed mean square and MS / MSresidual against the printed F. Every number below is printed by recompute.py.txt.

Quantity Location Reported Recomputed from the paper's own numbers
df of the host × tile interaction; residual df Results; Table S6; design in Methods 12; 80 (4 − 1)(5 − 1) = 12; 100 − 20 = 80 (match)
p for host × tile, F(12,80) = 0.771 Results, settlement; Table S6 < 0.001 0.678 (upper tail); lower tail 0.322
F(12,80) needed for p < 0.001 (for p < 0.05) derived — ≥ 3.162 (≥ 1.875)
Host × tile F from Table S6 mean squares Table S6 0.771 11000 / 14271 = 0.771 (match)
p for tile, F(4,80) = 1.638 Table S6 < 0.001 0.173; p < 0.001 would need F ≥ 5.123
Tile F from Table S6 mean squares Table S6 1.638 23371 / 14271 = 1.638 (match)
p for host, F(3,80) = 811.063 Table S6 < 0.001 9 × 10-60 (consistent)
Residual mean square Table S6 14271 1213050 / 80 = 15163.1 (the printed value equals SS / 85.00)
F and p with residual MS = SS / 80 derived from Table S6 — host × tile F = 0.725, p = 0.723; tile F = 1.541, p = 0.198; host F = 763.4, p = 1 × 10-58
Same F = 0.771 on the other df of this design derived — (3,80): p = 0.514; (4,80): p = 0.547; (19,80): p = 0.733
Reproductive output, F(3,96) = 812.7 Results, reproductive output p < 0.001 df match 4 groups × 25; p = 4.5 × 10-68 (consistent)

The df, the F values and the mean squares of Table S6 agree with one another, so the F of 0.771 is what the tabulated sums of squares produce. The entries that do not fit are the p-values for the interaction and for the tile main effect. An F of 0.771 lies below the mean of the F(12,80) distribution (1.026) and below its median (0.953); it is a value expected when the interaction has no effect at all. The residual mean square printed in Table S6 does not equal its own SS / df. Using SS / 80 makes the residual larger and both F values smaller, so it widens the gap rather than closing it.

Figure

For the host × tile and tile terms the printed p < 0.001 lies about three orders of magnitude below the p recomputed from the printed F and df

Figure 1. p-values on one log axis for the three terms of the settlement ANOVA in Table S6. Orange squares with leftward arrows are the printed values, all "< 0.001" (upper bounds). Filled blue circles are the upper-tail p-values recomputed from the printed F and df. Open blue circles use the residual mean square recomputed as SS / 80 = 15163.1 in place of the printed 14271. The dashed line marks α = 0.05 and the dotted line 0.001. For the host term the recomputed p (9 × 10-60) is off the left edge of the axis and agrees with the printed bound. For the host × tile interaction (p = 0.678) and the tile main effect (p = 0.173) the recomputed values lie above 0.05 whichever residual mean square is used.

F = 0.771 sits in the bulk of the F(12,80) distribution, far below the value p < 0.001 requires

Figure 2. Density of the F(12, 80) distribution, which is the reference distribution for the host × tile test when there is no interaction. The orange line is the printed F = 0.771; the shaded area to its right, 0.678, is the recomputed p-value. The dashed blue line at 3.16 is the smallest F that would give p < 0.001 on these df. The figure shows that the printed F is an unremarkable value under the null hypothesis of no interaction, not one in the extreme tail.

Why it matters

Explanations considered

Status

Suggested correction

The authors may wish to re-run the two-factor settlement ANOVA from the archived data and report the full table. If the sums of squares in Table S6 are correct, the first Results sentence on settlement would read, for example,

(ANOVA, host × tile F12,80 = 0.771, p = 0.68; host F3,80 = 811.1, p < 0.001; tile F4,80 = 1.64, p = 0.17)

with the P-value column of Table S6 corrected to match (and the residual mean square to SS / 80 = 15163, with F values recomputed from it). The abstract's and Discussion's statements of an "interactive effect" of host- and benthic-associated microbiota on settlement, and the post hoc interpretation of tile and interaction contrasts, would then need to be revised in line with the corrected test. If instead the reported p-values are confirmed, the F values, mean squares and sums of squares for the tile and interaction terms would need correcting. The authors may also wish to check the mean squares and F in Supplementary Table 5 and the "table S2" citation in the settlement Results.