Paperonium

← Back to the plain-language case

Testosterone–volume regressions report F(1,88) values that give p ā‰ˆ 0.08, not the stated 0.005 and 0.007

Hum Brain Mapp (2025) Ā· doi:10.1002/hbm.70356 Ā· PMC12442050

Summary

The Results report that testosterone significantly predicts larger Right Lobule I–IV and Right Crus II volumes: "adjusted R2 = 1, F(1,88) = 3.15, … p = 0.005" and "adjusted R2 = 0.1, F(1,88) = 3.09, … p = 0.007", with testosterone said to explain "approximately 14% of the variance". These numbers cannot all be true. Each model has a single predictor, and for such a model F(1,88) = 3.15 and 3.09 give p = 0.079 and 0.082, above the paper's own threshold of 0.05, and imply R2 ā‰ˆ 0.035 (adjusted ā‰ˆ 0.023). An adjusted R2 of 1 is impossible with any finite F, and Figure 9 labels the same models with yet other values (R2 = 0.185 and 0.128, both p = 0.005). This is the paper's only significant hormone–structure result, and the Discussion builds on it, so as published the result cannot be checked.

What the paper reports

Results, section "Sex Steroid Hormones Are Associated With Lobular Cerebellar Volume", only paragraph (the PMC text flattens the superscript in "R 2"):

The regression results indicated that only T levels were significantly associated with volume in the Right I–IV and Right Crus II (Figure 9). These results indicate that higher T levels are significantly associated with larger volumes in the Right I–IV (adjusted R 2 = 1, F(1,88) = 3.15, beta = 1.49E-06, p = 0.005) and Right Crus II (adjusted R 2 = 0.1, F(1,88) = 3.09, beta = 4.18E-06, p = 0.007) regions. The T hormone can explain approximately 14% of the variance in the volumes of these regions. No significant results were found for other hormones.

Methods, "Structural Data Statistical Analysis", third paragraph:

For these analyses, ROI volumes were normalized to each subject's TIV, generating a percentage to account for individual differences in brain size. Each model included hormone level as the independent variable and the TIV-normalized volume of the ROI as the dependent variable. Statistical significance was assessed using p < 0.05.

Methods, "Participants":

A total of 138 participants (mean age = 57 ± 13.3 years, range = 35–86; 54% female) were included.

Figure 9 legend:

Linear regression analysis of testosterone levels predicting cerebellar subregion volumes in Right I–IV and Right Crus II.

Figure 9 panel labels (text inside the figure image, HBM-46-e70356-g001.jpg, read from the image): "R² = 0.185, p = 0.005" (Right I–IV) and "R² = 0.128, p = 0.005" (Right Crus II). The y-axes are labelled "Right I-IV (mm³)" and "Right Crus II (mm³)".

Discussion, fifth paragraph:

Interestingly, testosterone also showed a significant relationship with cerebellar structure, with higher levels predicting larger volumes in Lobules I–IV and Right Crus II in our sample. This suggests that testosterone may contribute to cerebellar preservation during aging, potentially supporting the maintenance of motor and cognitive functions (Volman et al. 2011).

Discussion, sixth paragraph:

Moreover, the ability of testosterone to predict larger cerebellar volumes in Right I–IV and Right Crus II underscores its potential as a biomarker for brain health and aging (Moffat 2005; Andersen et al. 2011; Yeap and Flicker 2022).

What the paper's own numbers show

Method. Methods state that each hormone–volume model has hormone level as its only predictor. For an ordinary least-squares regression with an intercept and one predictor, the overall F(1, n āˆ’ 2) equals the squared t statistic of the slope, so the model p value and the slope p value are the same number. The model also satisfies R2 = F / (F + df2) and adjusted R2 = 1 āˆ’ (1 āˆ’ R2)(n āˆ’ 1)/(n āˆ’ 2), which for df2 = 88 reduces to (F āˆ’ 1)/(F + 88). With df2 = 88, n = 90. I computed p from the upper tail of the F(1,88) distribution (scipy), then derived R2 and adjusted R2 from F, and worked backwards from each reported p and R2 to the F it would need. Every number below is printed by recompute.py.txt.

Quantity Location Reported Recomputed from the paper's own numbers
p, Right I–IV Results 0.005 0.079 from F(1,88) = 3.15
p, Right Crus II Results 0.007 0.082 from F(1,88) = 3.09
Critical F at the paper's α = 0.05 Methods (p < 0.05) — F(1,88) = 3.95; both reported F values fall below it
F needed for the reported p Results 3.15 / 3.09 8.29 (for p = 0.005) / 7.63 (for p = 0.007)
Adjusted R2, Right I–IV Results 1 0.024 (R2 = 0.035); adjusted R2 = (F āˆ’ 1)/(F + 88) < 1 for every finite F
Adjusted R2, Right Crus II Results 0.1 0.023 (R2 = 0.034); an adjusted R2 of 0.1 would need F(1,88) = 10.89 (p = 0.0014)
Variance explained by testosterone Results "approximately 14%" 3.5% and 3.4%; R2 = 0.14 would need F(1,88) = 14.33 (p = 0.00028)
R2 and p, Right I–IV Figure 9 R² = 0.185, p = 0.005 at df (1,88), R² = 0.185 gives F = 19.98, p = 2.3 Ɨ 10āˆ’5
R2 and p, Right Crus II Figure 9 R² = 0.128, p = 0.005 at df (1,88), R² = 0.128 gives F = 12.92, p = 0.00054; the same p for two different R² at the same n is not possible
Sample size of the models Methods vs Results 138 participants; df2 = 88 df2 = 88 means n = 90; n = 138 would give df2 = 136

Three sets of values describe the same two regressions, and no two of them agree: the F values (p ā‰ˆ 0.08, R2 ā‰ˆ 0.03), the text's p values and adjusted R2 (p = 0.005 and 0.007; adjusted R2 1 and 0.1; "14%"), and Figure 9's labels (R2 0.185 and 0.128, both p = 0.005). Only the F values fall short of significance. The others place the association anywhere from p = 0.007 down to p ā‰ˆ 2 Ɨ 10āˆ’5. The 90 versus 138 gap is not counted as an error here (see Explanations considered).

Figure

The reported p values lie below the paper's 0.05 threshold; the p values implied by the reported F(1,88) lie above it

Figure 1. P values for the two testosterone–volume regressions, on a log scale. Filled orange circles are the p values given in the Results text (0.005 and 0.007); open orange circles are the p values printed on the Figure 9 panels (0.005 for both). Blue diamonds are the p values that the reported F(1,88) = 3.15 and 3.09 imply for a one-predictor regression (0.079 and 0.082). The dashed line marks the paper's significance threshold, p = 0.05. The reported and recomputed values sit on opposite sides of it, 16 and 12 times apart. The log scale is used because p values span orders of magnitude; the plot does not otherwise rescale the difference.

The reported adjusted R-squared of 1, the text's 14% and Figure 9's R-squared values all lie well above the R-squared implied by the reported F values

Figure 2. Proportion of variance explained for the same two models, on a linear axis from 0 to 1. Filled orange circles are values in the Results text (adjusted R2 = 1 and 0.1; "approximately 14%", shown on both R2 rows because the text gives one figure for both regions). Open orange circles are the R2 labels on Figure 9 (0.185 and 0.128). Blue diamonds are the R2 and adjusted R2 implied by the reported F(1,88) values (0.035 and 0.024 for Right I–IV; 0.034 and 0.023 for Right Crus II). The dotted line at 1 is the largest value R2 can take, which an adjusted R2 reaches only with a perfect fit. Small vertical offsets within a row only keep markers from overlapping.

Why it matters

Explanations considered

Status

Suggested correction

The authors could re-run the two testosterone–volume regressions and report, for each, the analysed n, R2, adjusted R2, F with its degrees of freedom, the slope with its standard error and units, and the p value, all from the same model output. If the corrected statistics confirm p < 0.05, the passage in section 3.3.2 should be replaced with those values, the Figure 9 labels made consistent with them (or labelled as a separate raw-volume model, if that is what they show), and the "approximately 14%" changed to the R2 actually obtained. If the F values of 3.15 and 3.09 are correct, the associations are not significant at the paper's α = 0.05 (p = 0.079 and 0.082). In that case the Results sentence "only T levels were significantly associated with volume" should be withdrawn, along with the Discussion statements that testosterone "showed a significant relationship with cerebellar structure" and "underscores its potential as a biomarker", and the structural part of the closing claims. It would also help to state why the models have df2 = 88 when 138 participants were included, and to correct the EMA group size in the abstract (38) to match the Methods (48).