Paperonium

← Back to the plain-language case

Abstract reports 347 participants completing both evaluations; the paper's body and group counts give 281

Neurology (2021) Β· doi:10.1212/WNL.0000000000011089 Β· PMC7884983

Summary

The abstract says that "a total of 347 participants completed both time points of evaluation", meaning both the 1-year and the 5-year clinical evaluations. The body gives a different number three times: the Methods say 347 completed the 1-year visit, 348 the 5-year visit and 281 both; the Statistical Analysis section gives the longitudinal n as 281; and the Results group counts for both visits add up to 80 + 136 + 39 + 26 = 281. So the abstract's 347 is the 1-year completer count, and it overstates the paired cohort behind the abstract's 1-to-5-year decline percentages by 66 participants (23.5%) and obscures that 19.0% of the 1-year completers had no 5-year evaluation. The analyses themselves use the correct sample sizes, so no reported effect, percentage or conclusion changes.

What the paper reports

All quotations were checked verbatim against the PMC-archived text.

Abstract, Methods:

One-year and 5-year clinical evaluations included identical batteries for neurobehavioral, psychiatric, and cognitive outcomes. A total of 347 participants completed both time points of evaluation. Cross-sectional and longitudinal comparisons were assessed.

Abstract, Results (these are the longitudinal estimates the "both time points" cohort supports):

Both combat concussion groups also showed clinically significant decline from 1- to 5-year evaluation (66%–76% neurobehavioral NRS; 41%–54% psychiatric CAPS by group). Both control groups fared better but a subset also had clinically significant decline (37%–50% neurobehavioral NRS; 9%–25% psychiatric CAPS by group).

Methods, second paragraph:

Through these efforts, 575 participants have been prospectively enrolled and assessed at the acute (0–7 days, median 4, study 4) and subacute time points (0–30 days, median 7–9, study 2–3; 0–90 days, median 14, study 1), 347 of whom completed further clinical examination at 1 year and 348 at 5 years postinjury, with 281 completing both follow-up evaluations.

Methods, Statistical Analysis:

Five-year cross-sectional analysis considered the entire cohort that completed this follow-up evaluation (n = 348) while longitudinal analysis only considered those who completed both the 1-year and 5-year evaluations (n = 281).

Results, first paragraph:

At 5-year follow-up, 109 nonblast controls and 170 patients with concussive blast TBI, as well as 41 blast controls and 28 patients with nonblast TBI, completed evaluation, of which 80 nonblast controls, 136 patients with concussive blast TBI, 39 blast controls, and 26 patients with nonblast TBI completed both 1- and 5-year follow-up.

Figure 1 (CONSORT diagram, an image in the article) has a box labelled "Total completed 1-year follow-up (n = 347)" and another labelled "Total completed 5-year follow-up (n = 348)". It gives no count of participants with both visits. Table 1 (also an image) gives the 5-year group sizes in its column headers: nonblast CTL n = 109, blast-exposed CTL n = 41, concussive blast TBI n = 170, nonblast TBI n = 28.

What the paper's own numbers show

Method. I added up the group counts the paper gives for each cohort and compared each sum with the stated total and with the abstract. For the 1-year cohort I used the four study boxes in Figure 1. I also checked the logical bound that the number seen at both visits cannot exceed the number seen at either one, overall and within each group. Every number below is printed by recompute.py.txt.

Quantity Location Reported Recomputed from the paper's own numbers
Completed both 1- and 5-year evaluations Abstract, Methods 347 281 (Results 80 + 136 + 39 + 26)
Completed both, as stated in the body Methods p2; Statistical Analysis 281; n = 281 281 (same sum)
Completed 1-year evaluation Methods p2; Figure 1 347; n = 347 347 (Figure 1 boxes 65 + 32 + 178 + 72)
Completed 5-year evaluation Methods p2; Statistical Analysis; Figure 1 348; n = 348; n = 348 348 (Results and Table 1: 109 + 170 + 41 + 28)
Abstract minus both-visit n Abstract vs body β€” 347 βˆ’ 281 = 66 (23.5% of 281)
Largest possible both-visit n derived β€” min(347, 348) = 347, reached only if every 1-year completer also had a 5-year visit
1-year completers with no 5-year visit derived β€” 347 βˆ’ 281 = 66 (19.0% of 347); by group 23 / 34 / 6 / 3, sum 66
5-year completers with no 1-year visit derived β€” 348 βˆ’ 281 = 67
Seen at 1 year, 5 years or both derived β€” 347 + 348 βˆ’ 281 = 414 of 575 enrolled
Both-visit n within each group ≀ 1-year and 5-year n Figure 1; Results 80, 136, 39, 26 holds for all four groups (1-year: 103, 170, 45, 29; 5-year: 109, 170, 41, 28)

Group order in the last two rows: nonblast controls, blast TBI, blast controls, nonblast TBI.

The body agrees with itself everywhere. The 1-year, 5-year and both-visit totals each match the sum of their components, and the per-group counts satisfy the bound. The abstract is the only place where the both-visit cohort is given as 347, and 347 is exactly the 1-year total. A both-visit count of 347 would mean that every 1-year completer also completed the 5-year visit. That contradicts the 281 stated in the Methods, which implies that 66 participants were seen at 1 year only.

Figure

The abstract's count of participants with both evaluations conflicts with three passages in the body and equals the 1-year count

Figure 1. On the left is the abstract sentence that gives the cohort with both evaluations, with its count of 347 (orange, as reported). On the right are the three body passages that give the same cohort: the Methods study-population paragraph, the Statistical Analysis section and the first Results paragraph. The blue line is the sum of the Results group counts (80 + 136 + 39 + 26 = 281), recomputed here. The orange connectors mark the conflict: 347 in the abstract against 281 in the body, a difference of 66 participants (+23.5%). The grey connector shows that 347 is the number the Methods give for the 1-year visit alone. All quotations are verbatim, with "..." marking omitted text.

Dot comparison of reported and recomputed cohort sizes; only the abstract's both-visit count departs from its components

Figure 2. Cohort sizes as reported in the paper (filled orange dots) and as recomputed from the paper's own components (open blue circles), on an axis starting at zero. For the 1-year, 5-year and both-visit cohorts given in the body, the reported totals equal the sums of their parts (Figure 1 study boxes for the 1-year cohort; Results group counts for the others). The abstract's count of participants with both visits (347) sits 66 above the both-visit sum (281), at the same value as the 1-year total.

Why it matters

Explanations considered

Status

Suggested correction

In the abstract (Methods), replace

A total of 347 participants completed both time points of evaluation.

with

A total of 281 participants completed both time points of evaluation.

The authors might instead give all three counts, as the Methods do: "347 participants completed the 1-year evaluation, 348 the 5-year evaluation, and 281 both." That wording also shows readers of the abstract how much attrition there was between visits.