Paperonium

← Back to the plain-language case

Abstract reports p<0.001 for the matched cystic fibrosis versus rheumatoid arthritis comparison; Table 4 gives p=0.055

Eur Respir J (2023) Β· doi:10.1183/13993003.00174-2023 Β· PMC10600351

Summary

The abstract reports the propensity-matched comparison of major adverse cardiac events (MACE) between people with cystic fibrosis (CF) and people with rheumatoid arthritis (RA) as HR 1.21 (95% CI 1.00–1.48) with p<0.001. Table 4 gives the same HR and CI for this comparison, with p=0.055. Back-calculating from the printed HR and CI gives p = 0.057, or 0.047–0.068 if the rounded values vary within their rounding ranges. That agrees with Table 4 and rules out p<0.001, which would need a CI of about 1.08–1.36. The only p<0.001 in the RA row of Table 4 belongs to the unadjusted analysis (HR 0.75), so the abstract presents a borderline, non-significant comparison as highly significant. The Results and Discussion also describe CF risk as "greater than" RA risk. The paper's main finding, a higher MACE risk in CF than in matched general-population comparators (HR 1.65, p<0.001), is not affected.

What the paper reports

Abstract, Results:

In propensity score-matched analyses, PwCF had higher risk of MACE than matched general population comparators (hazard ratio (HR) 1.65, 95% CI 1.40–1.95; p<0.001) and an equivalent or higher relative risk compared with other inflammatory conditions considered β€œhigh risk” for cardiovascular disease, including systemic lupus erythematosus (HR 0.95, 95% CI 0.82–1.09; p=0.44), rheumatoid arthritis (HR 1.21, 95% CI 1.00–1.48; p<0.001) and HIV (HR 0.93, 95% CI 0.82–1.06; p=0.29).

Table 4, "Rheumatoid arthritis" row. The columns are: unadjusted analysis (CF | events | non-CF | events | HR (95% CI) | p-value), then propensity score-matched analysis (the same six columns):

Rheumatoid arthritis | 6265 | 227 | 97 198 | 4547 | 0.75 (0.66–0.86) | <0.001 | 5901 | 223 | 5901 | 177 | 1.21 (1.00–1.48) | 0.055

Table 4 footer:

Propensity score matching based on known cardiac risk factors (age, sex, diabetes, hypertension, hypercholesterolaemia, family history of heart disease, smoking and chronic kidney disease).

Methods, "Statistical analysis":

After propensity score matching, a Cox's proportional hazards model was used to compare the matched cohorts.

Results, "Outcomes compared with other inflammatory diseases":

In CF, risk of MACE was equivalent to SLE and HIV (HR 0.95, 95% CI 0.82–1.09; p=0.44; and HR 0.93, 95% CI 0.82–1.06; p=0.29, respectively) and was greater than rheumatoid arthritis (HR 1.21, 95% CI 1.00–1.48).

Discussion, first paragraph:

Furthermore, cardiac risk in PwCF was equivalent to or higher than other chronic inflammatory diseases considered β€œhigh risk” for cardiac disease.

Discussion, fifth paragraph (the paragraph beginning "Chronic inflammation is a hallmark of CF"):

Here, we found that despite adjusting for the presence of classic cardiac risk factors, risk of cardiac disease in CF was equivalent to or greater than that of other inflammatory conditions.

What the paper's own numbers show

Method. Hazard ratios from a Cox model are normally reported with a Wald 95% CI on the log scale. For such a CI, SE(log HR) = (ln upper βˆ’ ln lower) / (2 Γ— 1.96), z = ln HR / SE, and the two-sided p = 2(1 βˆ’ Ξ¦(|z|)). This cannot reproduce the exact Cox p-value without the individual event times, but it is the standard check that a printed HR, CI and p-value are consistent. I applied it to the four matched comparisons the abstract reports. To allow for rounding, I also varied the RA HR and both bounds over every value that rounds to the printed two decimals. Every number below is printed by recompute.py.txt.

Quantity Location Reported Recomputed from the paper's numbers
CF vs RA, matched: p-value Abstract, Results HR 1.21 (1.00–1.48); p<0.001 SE(log HR) 0.100, z = 1.91, p = 0.057
CF vs RA, matched: p-value Table 4 HR 1.21 (1.00–1.48); p = 0.055 p = 0.057 (agrees)
CF vs RA, matched: p over rounding of HR and CI Table 4 / Abstract β€” 0.047–0.068
CF vs RA, matched: HR against CI midpoint Table 4 / Abstract 1.21 geometric midpoint √(1.00 Γ— 1.48) = 1.217 (consistent)
CF vs RA, matched: what p<0.001 would need β€” β€” |z| > 3.29, SE ≀ 0.058, so a 95% CI no wider than 1.08–1.36
CF vs RA, matched: one-sided p β€” β€” 0.028
CF vs RA, unadjusted Table 4 HR 0.75 (0.66–0.86); p<0.001 z = βˆ’4.26, p = 2.0 Γ— 10⁻⁡ (agrees); the only p<0.001 in the RA row
CF vs RA, matched: crude event counts Table 4 CF 223/5901 vs RA 177/5901 3.78% vs 3.00%; crude risk ratio 1.26 (1.04–1.53), p = 0.020 (ignores time to event and censoring, so it does not replace the Cox p)
CF vs SLE, matched (cross-check) Abstract / Table 4 HR 0.95 (0.82–1.09); p = 0.44 / 0.439 p = 0.48 (rough agreement, within rounding of the CI)
CF vs HIV, matched (cross-check) Abstract / Table 4 HR 0.93 (0.82–1.06); p = 0.29 / 0.293 p = 0.27 (rough agreement)
CF vs general population, matched (cross-check) Abstract / Table 3 HR 1.65 (1.40–1.95); p<0.001 z = 5.92, p = 3 Γ— 10⁻⁹ (agrees)

The same back-calculation agrees with the printed p-values for the other three matched comparisons. For RA it agrees with Table 4 but not with the abstract. A CI whose lower bound is 1.00 is by construction close to p = 0.05, and a two-sided p<0.001 would require the lower bound to be at least about 1.08.

Figure

Reported and recomputed p-values for the four propensity-matched MACE comparisons, on a log p-value axis

Figure 1. P-values for the four propensity-matched MACE comparisons named in the abstract, on one log-scale axis. Orange diamonds are the values printed in the abstract and orange squares the values printed in Table 3 (general population) or Table 4 (SLE, RA, HIV). A left-pointing arrow marks a value printed as "p<". Blue circles are the p-values recomputed from the printed HR and 95% CI. For RA, the blue bar spans the p-values obtained when the HR and both CI bounds vary within their rounding ranges (0.047–0.068). The dashed line marks p = 0.05 and the dotted line p = 0.001. For the general population, SLE and HIV the three values agree. For RA, Table 4 and the recomputed value sit on the 0.05 line, while the abstract places the result beyond 0.001. The recomputed general-population p (3 Γ— 10⁻⁹) lies beyond the left edge of the axis.

Diagram showing that the abstract pairs the matched RA HR and CI with the p-value from the unadjusted column of Table 4

Figure 2. Where the abstract's RA values occur in Table 4. The abstract's HR and CI (1.21, 1.00–1.48) are those of the propensity-matched columns, whose p-value is 0.055. The only p<0.001 in the RA row is in the unadjusted columns, for an HR of 0.75 (0.66–0.86) that points the other way. The figure shows where the printed values coincide. It does not show how the abstract's value arose.

Why it matters

Explanations considered

None of these accounts for p<0.001. The Table 4 value of 0.055 agrees with the recomputation, so the abstract's value is the one in error.

A side observation, not part of this finding: the Table 4 SLE matched row lists the CF group as n = 223 with 385 events and the comparator as n = 5223. The Results text states that 5223 PwCF were matched with SLE comparators, so the "223" looks like a dropped digit. This was not examined further.

Status

As of 2026-10-23:

Suggested correction

In the Abstract, Results, replace "rheumatoid arthritis (HR 1.21, 95% CI 1.00–1.48; p<0.001)" with "rheumatoid arthritis (HR 1.21, 95% CI 1.00–1.48; p=0.055)", in line with Table 4 and Supplementary Table S4.

Because this comparison does not reach p<0.05, the authors may also wish to revise the wording that reads it as an established difference. In the Results, "and was greater than rheumatoid arthritis (HR 1.21, 95% CI 1.00–1.48)" could read "and was numerically higher than, but not significantly different from, rheumatoid arthritis (HR 1.21, 95% CI 1.00–1.48; p=0.055)". The phrases "equivalent or higher" (Abstract), "equivalent to or higher than" (Discussion, first paragraph) and "equivalent to or greater than" (Discussion, fifth paragraph) could be qualified in the same way.