Paperonium

← Back to the plain-language case

Reported complete-abortion risk ratio of 2.55 should be about 1.02 by the paper's own conversion

BMJ Glob Health (2025) · doi:10.1136/bmjgh-2024-016024 · PMC11749663

Summary

For complete abortion in the review's only task-shifting trial (midlevel providers vs doctors, 1032 participants), the Abstract, the Results text and Table 2 all report a risk ratio (RR) of 2.55 (95% CI 0.82 to 4.27), described as "equivalent" or "little or no difference". The same Table 2 row gives risks of 96.1% and 97.3% and an adjusted risk difference (RD) of 1.49% (−0.17% to 3.14%), and its footnote § says the RR was converted from that RD with a 96% control risk; done in consistent units, that conversion gives RR 1.016 (0.998 to 1.033), whereas leaving the RD in percentage points, (0.96 + 1.49)/0.96, reproduces the published 2.55 (0.82 to 4.27) exactly. With a 96.1% control risk no RR can exceed 1/0.961 = 1.04, so the published value is impossible, and its interval is 100 times too wide on the linear scale. The verbal conclusion of no meaningful difference stands, but the first quantitative result in the Abstract misstates the size and precision of the effect, the correct value appears nowhere in the paper, and no correction has been found.

What the paper reports

Low certainty evidence indicates task shifting of medical abortion by doctors to midlevel providers may result in equivalent complete abortion (RR: 2.55, 95% CI: 0.82 to 4.27).

— Abstract, Results

Low certainty evidence indicates that compared with doctor-led medical abortion, nurse-led medical abortion may lead to little or no difference in abortion success (RR: 2.55, 95% CI: 0.82 to 4.27, one trial, 1032 participants) or the occurrence of an incomplete abortion (RR: 0.92, 95% CI: 0.45 to 1.89, one trial, 1032 participants, table 2). The certainty of evidence was downgraded by two levels due to serious imprecision (data from a single trial and CI including both benefit and harm) and serious risk of bias (no blinding of participants, personnel and outcome assessors).

— Results › Effects of interventions › Comparison 1. Who provides care (task shifting)

Patient health status: complete abortion | 96.1% | 97.3% | RR 2.55 (0.82 to 4.27)§ | 1032 (1 RCT) | Low†‡⊕⊕⊝⊝ | RD 1.49%¶ (–0.17% to 3.14%)

— Table 2 (Summary of findings 1), "complete abortion" row. Columns: outcome | assumed risk, control | corresponding risk, intervention | relative effect (95% CI) | participants | certainty | comments

§The effect in RR was converted from the adjusted risk difference provided in the report using control group risk of 96%.

— Table 2, footnote §

¶The risk difference calculated with intention-to-treat analysis estimated from a generalised estimating equation model with treatment as the fixed effect and service provider as a random effect and adjusted with woman’s age and length of gestation.

— Table 2, footnote ¶

the assumed risk in the comparison group and the relative effect of the intervention

— Table 2, footnote * (which says that the intervention-group risk is based on these two quantities)

What the paper's own numbers show

Method. Footnote § describes the conversion. If the control risk is p₀ and the risk difference is RD (both as proportions), the intervention risk is p₀ + RD, so RR = (p₀ + RD) / p₀. Applied to the point estimate and to each CI limit, this maps the RD interval linearly onto an RR interval. I applied it with p₀ = 0.96 (the footnote) and p₀ = 0.961 (Table 2), first with the RD as a proportion and then with the RD left as a percentage-point number. I also checked the result against the two risks in the same row of Table 2, and against the shape of the published interval. As an outside cross-check I used the counts in the source trial's abstract (Lancet 2011;377:1155-61, PMID 21458058). All numbers below are printed by recompute.py.txt.

Quantity Location Reported Recomputed
RR, complete abortion Abstract; Results Comparison 1; Table 2 2.55 (0.82 to 4.27) 1.016 (0.998 to 1.033), from footnote § with RD as a proportion (same to 3 dp with p₀ 0.96 or 0.961)
Same formula, RD left in percentage points Table 2 footnote § — (0.96 + 1.49)/0.96 = 2.552; (0.96 − 0.17)/0.96 = 0.823; (0.96 + 3.14)/0.96 = 4.271 → 2.55 (0.82 to 4.27), an exact match to the published values
Intervention risk implied by the conversion Table 2 97.3% 0.96 + 0.0149 = 0.975 (correct units); 0.96 + 1.49 = 2.45, i.e. 245% (published units)
Ratio of the two risks in Table 2 Table 2 96.1% vs 97.3% 97.3 / 96.1 = 1.012
Largest RR possible with control risk 96.1% Table 2 — 1 / 0.961 = 1.041
Intervention risk implied by RR 2.55 (footnote *) Table 2 97.3% 0.961 × 2.55 = 2.451 (245%)
Shape of the reported RR interval Table 2 0.82 to 4.27 around 2.55 Linear gaps 1.73 below, 1.72 above (symmetric on the linear scale); log gaps 1.135 vs 0.516. RR width / RD width = 1.042 ≈ 1/0.96 = 1.042, i.e. a linear rescaling of the RD interval by 1/0.96
Width of the published interval relative to the recomputed one Table 2 0.82 to 4.27 100 times wider on the linear scale; 48.6 times wider on the log scale
Adjusted RD, complete abortion Table 2 comments 1.49% (−0.17% to 3.14%) Not reproducible from counts (GEE-adjusted, footnote ¶); taken as given. Unadjusted from trial counts: 1.19% (−0.99% to 3.37%); trial abstract: 1.24% (−0.53 to 3.02)
Unadjusted RR, complete abortion (outside check) Source trial abstract: 504/518 vs 494/514 — 1.012 (0.990 to 1.035)
RR, incomplete abortion (control check) Results; Table 2 row 2 0.92 (0.45 to 1.89) 14/518 vs 15/514: 0.926 (0.45 to 1.90), consistent

The adjacent incomplete-abortion RR is reproduced from the trial's counts. This shows that the rest of the row's arithmetic holds, and that the discrepancy is confined to the RD-to-RR conversion.

Figure

Arithmetic chain of the RD-to-RR conversion in Table 2 footnote §, done in consistent units (blue) and with the RD left in percentage points (orange)

Figure 1. The conversion described in Table 2 footnote §, from the inputs stated in Table 2 to the risk ratio. The two lanes differ only at the first step, which is shaded: whether the adjusted risk difference enters the formula as a proportion (0.0149, blue, recomputed) or as a percentage-point number (1.49, orange). The orange lane reproduces the published RR 2.55 (0.82 to 4.27) to two decimals. It does so by way of an intervention "risk" of 245%, and its result lies above 1/0.961 = 1.04, the largest RR possible with the 96.1% control risk in the same table row. The blue lane gives RR 1.016 (0.998 to 1.033), which agrees with the ratio of the tabulated risks (1.012). All values are computed in recompute.py.txt.

Published and recomputed risk ratios for complete abortion on a log scale, with the region above RR 1.04 shaded as impossible

Figure 2. Risk ratio for complete abortion (midlevel providers vs doctors) on a log scale, with a thin reference line at RR = 1. Orange: the value published in the Abstract, Results and Table 2. Blue: the footnote § conversion recomputed with the RD as a proportion (its interval, 0.998 to 1.033, is narrower than the marker at this scale), and the plain ratio of the two Table 2 risks. The shaded region marks RRs above 1/0.961 = 1.04, which cannot occur when the control risk is 96.1%. The published point estimate and most of its interval lie in that region.

Why it matters

Explanations considered

None of these accounts for the published numbers. The stated conversion, carried out with the RD in percentage points rather than as a proportion, reproduces them exactly.

Status

As of 2026-10-23:

Suggested correction

In the Abstract, in Results › Comparison 1 and in Table 2 (complete abortion row), replace "RR: 2.55, 95% CI: 0.82 to 4.27" with "RR: 1.02, 95% CI: 1.00 to 1.03". Unrounded, this is 1.016 (0.998 to 1.033), from (0.96 + RD)/0.96 with RD = 0.0149 (−0.0017 to 0.0314). If two decimals would hide the fact that the lower limit lies just below 1, report three decimals: 1.016 (0.998 to 1.033). The authors may also wish to: