Depression treatment · JAMA Netw Open · 2025
“Significantly” better depression care? Its own test: chance alone gives that gap about half the time.
How often chance alone would produce this gap between equally good treatments
The paper says
Depression scores (higher is worse) started near 24 and fell 18.1 points in 24 weeks with care guided by symptom measurements, 17.0 with usual care. The summary calls the 1.1-point gap “significantly” bigger: chance alone would produce one this big under 1 time in 1,000.
Its own data show
The same sentence prints the number its test produced: 0.71. That means chance alone would produce a gap this big about 1 time in 2; under 1 in 1,000 needs 3.37 or more. Rerunning the test from each group’s printed range gives about 1 in 3. The results section and Table 3 repeat the claim.
Even equally good treatments show some gap, just from which patients land in which group. The test asks how often that alone would produce a gap this big; “significant” means under 1 time in 20, the paper’s own bar. Guided care did speed improvement, the paper’s main finding, but at 24 weeks no improvement measure shows it clearly ahead.