Paperonium

← Back to the plain-language case

Two p-values for the recent-adversity estimates disagree with their own confidence intervals and forest plot

Psychol Med (2026) Β· doi:10.1017/S0033291726104632 Β· PMC13161794

Summary

The abstract and Results give two adjusted odds ratios for recent adversity from the joint-exposure model, which the paper names as its primary inferential model: aOR 1.91 (95% CI 1.47–2.49) without parental support, with p = .011, and aOR 1.76 (95% CI 1.17–2.65) with parental support, with p < .001. Recomputed from each printed aOR and CI, the p-values are about 1.5 Γ— 10βˆ’6 and .0067. The paper's own forest plot for the same model prints "< .001" and "0.007", which agrees with the recomputation and not with the text. Both estimates stay significant at .05, so no conclusion is reversed. But the abstract presents the weaker of the two associations as the better established one.

What the paper reports

Abstract, Results:

Elevated odds from recent adversities (aOR = 1.91, 95% CI 1.47–2.49, p = .011) attenuated by parental support (aOR = 1.76, 95% CI 1.17–2.65, p < .001).

Results, "Temporal effects of adverse life events and parental support buffer", second paragraph (final model):

Compared to adolescents with no recent adversity and no parental support, those who experienced recent adversity but had no parental support had significantly higher PE odds (aOR = 1.91, 95% CI 1.47–2.49, p = .011). Among those with high parental support, recent adversity remained associated with elevated odds of PEs compared with those with no recent adversity and high parental support, although the magnitude of association was modestly attenuated (aOR = 1.76, 95% CI 1.17–2.65, p < .001).

Results, "Multivariable logistic regression modeling", first paragraph:

The joint exposure model demonstrated slightly improved explanatory value and is presented as the primary inferential model.

Methods, "Statistical analysis":

Adjusted odds ratios (aORs) with 95% confidence intervals were reported, and robust standard errors were applied.

Discussion, "Temporal effect of adversity and parental support buffer":

However, the magnitude of association was modestly attenuated in the presence of parental support (aOR 1.76 vs 1.91), suggesting partial buffering.

Forest plot of the joint-exposure model (an image, so not checked with the text tool; read from both the PMC and the publisher copies). The rows are "Adversities within 30 days and no parental support", printed as 1.92 (1.47 - 2.50), p < .001, and "Adversities within 30 days with parental support", printed as 1.76 (1.17 - 2.65), p 0.007.

What the paper's own numbers show

Method. For a logistic-regression aOR with a 95% Wald CI, SE(ln aOR) = (ln U βˆ’ ln L) / (2 Γ— 1.96), z = ln(aOR) / SE, and the two-sided p = 2 Γ— (1 βˆ’ Ξ¦(|z|)). The paper used robust standard errors. The same robust SE gives both the CI and the p-value, so the check needs no other input. To allow for the two-decimal rounding of the CI, I also computed p for every CI whose bounds round to the printed ones. As a calibration, I applied the same method to eleven other estimates printed in the text. Their printed p-values agree with the recomputed ones to rounding, apart from one smaller side issue noted below. Every number below is printed by recompute.py.txt.

Quantity Location Reported Recomputed from the paper's own numbers
p, recent adversity without parental support Abstract; Results aOR 1.91 (1.47–2.49), p = .011 SE 0.134, z = 4.81, p = 1.5 Γ— 10βˆ’6. The range over CI rounding is 1.1 to 1.8 Γ— 10βˆ’6.
p, recent adversity with parental support Abstract; Results aOR 1.76 (1.17–2.65), p < .001 SE 0.209, z = 2.71, p = .0067. The range over CI rounding is .0062 to .0072.
Same two estimates in the joint-model forest plot Forest plot image 1.92 (1.47–2.50), p < .001; 1.76 (1.17–2.65), p = 0.007 z = 4.82, p = 1.5 Γ— 10βˆ’6; z = 2.71, p = .0067. Both agree with the plot.
CI that p = .011 would need, given aOR 1.91 derived 1.47–2.49 SE 0.254 (1.89 times the printed CI's SE); 95% CI 1.16–3.15
Widest CI that p < .001 allows, given aOR 1.76 derived 1.17–2.65 SE below 0.172; 95% CI no wider than 1.26–2.46
Recent adversity, main-effects model Results 1.86 (1.49–2.34), p < .001 z = 5.39, p = 7 Γ— 10βˆ’8. Consistent.
Undisclosed gender, SDQ ≀ 16 Abstract; Results 4.36 (1.50–12.66), p = .007 p = .0068. Consistent.
Home safety, final model Abstract; Results 0.81 (0.66–0.99), p = .038 p = .040 to .042. Consistent within CI rounding.
Financial hardship, final model Results 1.38 (1.07–1.79), p = .013 p = .013 to .014. Consistent.
Low wellbeing, high school support Results 0.77 (0.61–0.98), p = .031 p = .031 to .033. Consistent.
Side issue: high wellbeing, low school support Results 0.73 (0.57–0.95), p = .008 p = .016 to .019. The forest plot prints 0.74 (0.57–0.96), p = .019.

The log-scale midpoint of each printed CI matches its aOR: the geometric means are 1.913 and 1.761. So each aOR and its CI form a consistent pair. Only the p-values disagree with them, and they disagree in opposite directions. The printed p = .011 understates the evidence for the no-support estimate by a factor of about 7,000. The printed p < .001 overstates the evidence for the supported estimate: its own CI gives about .007. No CI that rounds to 1.17–2.65 can produce p < .001, because that p would need a lower bound of at least 1.26.

Figure

Printed and recomputed p-values for the two recent-adversity estimates

Figure 1. Two-sided p-values on a log scale, with stronger evidence to the right. Orange squares show the p-values printed in the abstract and Results. The arrow marks that "p < .001" is an upper bound. Blue circles show the p-values recomputed from the printed aOR and 95% CI with a log-scale Wald test. The short blue line is the range over all CIs that round to the printed bounds; for the second estimate it is narrower than the marker. Dashed lines mark p = .05 and p = .001. For the estimate without parental support, the printed .011 lies more than three orders of magnitude from the recomputed 1.5 Γ— 10βˆ’6. For the estimate with parental support, the printed "< .001" lies on the wrong side of .001 from the recomputed .0067. The paper's own forest plot prints p < .001 and p = 0.007 for these two rows, in line with the blue values.

Printed 95% CIs and the CIs the printed p-values would require

Figure 2. Adjusted odds ratios on a log scale. The thin vertical line is aOR = 1. Orange shows the printed aOR and 95% CI. Blue shows the 95% CI that the printed p-value would require, with the aOR held fixed. For p = .011, the interval around 1.91 would have to be 1.16–3.15, nearly twice as wide on the log scale as the printed 1.47–2.49. For p < .001, the interval around 1.76 could be no wider than 1.26–2.46, but the printed interval is 1.17–2.65. The printed CIs therefore cannot carry the printed p-values.

Why it matters

Explanations considered

Status

Suggested correction

In the abstract, replace

Elevated odds from recent adversities (aOR = 1.91, 95% CI 1.47–2.49, p = .011) attenuated by parental support (aOR = 1.76, 95% CI 1.17–2.65, p < .001).

with

Elevated odds from recent adversities (aOR = 1.91, 95% CI 1.47–2.49, p < .001) attenuated by parental support (aOR = 1.76, 95% CI 1.17–2.65, p = .007).

and make the same two changes in the second paragraph of the Results section "Temporal effects of adverse life events and parental support buffer". These are the values in the paper's own forest plot for the joint-exposure model. The authors may also wish to check: