Taste chemistry · Nucleic Acids Res · 2021
The paper rates a sweetness-guessing program 88% accurate, but that’s its “best” round. Ten-round average: 76.5%.
Share of chemicals the program guessed right in its ten-round test
The paper says
A computer program learns which chemicals taste sweet from known examples. It was tested in ten rounds: each time it learned from nine-tenths of the examples and guessed the other tenth. The paper’s table: right on 97% of sweet chemicals, 96% of others, 88% overall.
Its own data show
That can’t be: the overall score mixes the two group scores, so it must land between 96% and 97%. A spreadsheet published with the paper explains why: each figure comes from the round it labels “best” for that score, picked separately, not all from one round. Its ten-round averages: 74% sweet, 79% others, 76.5% overall.
A ten-round test is summed up by its average, the way a grade averages all your exams instead of keeping your best. By that measure the program got 76.5% right, not 88%; its scores swung widely between rounds. Its separate test on 403 new chemicals holds up: 89%.