- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper focuses on the signed Choquet twin (SCT), which forecasts body and blood measurements from longitudinal diet records of 7876 participants. The method can render the results as a 3D body without any scans. Each outcome's change is modeled as a diet-free trajectory network and a diet term built from a symmetric Choquet integral with 2 additional components. The 3D path learns a ridge map from 7 body features to the conditioning space of a frozen generator using 320 synthetic reference bodies. SCT achieved the most accurate performance.
Critical strengths
- The analysis shows the diet effect is estimated accurately and stably; the authors show the diet model as a simple linear problem with 66 weights. As a result, the sign of the overall diet effect is the same in 25 runs, proving that the method is accurate.
- The framing of the problem is innovative, such as the debiased cross-fitting and Neyman orthogonality in the learning, so the neural trajectory networks absorb the confounding effect.
- The experiment design and ablation studies are robust and comprehensive.
Critical weaknesses
- The effectiveness and accuracy gains are marginal; more highlighting of the novelties is needed. Or more analysis of the gains from generic trajectory networks or other perspectives.
- The cohort disbution need more clarity, looks like 9/10 outcomes are from senior women, more cohort representativeness can be described.
- The diet signal itserlf is weak and might need stability analysis.
Questions for authors
- Cross-validation picks report timing in 19/25 runs, so most forecasts use diet reported at the target visit. For a twin to answer "what if I change my diet?", only start timing seems valid. Under start timing alone, do the whole-cohort effects for weight, waist, insulin, and HOMA-IR still exclude zero?
- No baseline trains one network end-to-end on context, baseline outcomes, time, and diet history. What skill does it reach? If it matches 0.249, then the accuracy claim reduces to "an MLP beats ridge and boosting," and the abstract should say so.
- Nine outcomes come only from older women (Study B) and HOMA-IR only from young adults (Study A), with sex confounded with age band and era. Do the diet effects hold when each study is fit separately?
- The synthetic study shows single-component intervals cover only 33% of true effects at κ = 0.3, the anchor chosen on the real cohort. Will it either report real-cohort component effects at κ = 0 with valid intervals, or drop the component-level claims (e.g., the trans-fat/fruit/nuts ordering for weight)?
2 comments
Response to Reviewer A5Li: Part 2
Weakness 2 and Question 3: who is in the cohort, and do the effects hold in each study separately?
We made the make-up of the cohort clear and added fully separate analyses for each study.
Follow-up measurements for nine outcomes come from Study B, which enrols women aged 50 to 79. Insulin resistance comes from Study A, which enrols men and women aged 17 to 35. So each outcome's association was already informed by follow-up data from one study. What the pooled analysis shared was the adjustment networks, the diet standardization and the settings.
To test whether pooling mattered, we refitted the networks, the standardization and the settings on each study alone, with 50 new cross-fitted runs (Table 13).
| Study | Outcome | Estimated association | 95% interval |
|---|---|---|---|
| B | Weight | -1.10 kg | -1.65 to -0.71 |
| B | Waist | -1.09 cm | -1.59 to -0.76 |
| B | Insulin | -0.72 micro-units per mL | -1.45 to -0.35 |
| A | Insulin resistance (HOMA-IR) | -0.36 | -0.61 to -0.20 |
The main associations remain when each study is fitted on its own. The intervals for systolic and diastolic blood pressure also exclude zero in the Study B refit. This shows that the findings do not depend on pooling. It is not a replication of the same outcome in two populations.
Table 9 now reports, for each study, the demographics, baseline years, follow-up schedule, number of participants left at each visit, share of imputed diet records, and baseline missingness. The abstract and the discussion say which population each estimate refers to. Age band and sex cannot be separated from study in this design, so we make no claim about differences by age or sex.
Weakness 3: the diet signal is weak; is it stable?
We agree that these are two different questions: how much diet adds to prediction, and how stable the association is. The diet term adds little accuracy on this cohort. The main associations, however, hold across the following checks (Appendices C and G).
- Diet imputation. Fitting each of the five imputations separately and combining them with Rubin's rules gives a weight association of -1.25 kg (95% interval -2.03 to -0.48), negative in all five. We also repeated this with ten imputed diet datasets: -1.29 kg (-2.10 to -0.47), negative in all ten. With ten imputations, the intervals for waist, insulin and insulin resistance also exclude zero.
- Subsets of participants. We refitted 20 times on half of the participants and 20 times on three quarters. The weight association stayed negative in all 40 refits. Its interval excluded zero in 14 of the 20 half-size refits and in 18 of the 20 three-quarter refits, as expected when smaller samples give less precision.
- New folds and retrained networks. Redrawing the cross-fitting folds and retraining the networks gives a standard error for weight that is 0.97 times the one from the fixed-network analysis. For insulin resistance the uncertainty grows more, by a factor of 1.49, although its interval still excludes zero.
- Earlier evidence. The direction is the same in all 25 split runs, the overall association depends only modestly on the anchor, and height, our negative control, shows no detectable association with diet.
Stability is not the same as robustness to confounding, so we report that separately. The approximate E-values for weight are 1.63 for the estimate and 1.46 for the interval bound nearest zero. This means that unmeasured confounding of moderate strength could explain the association away. These checks do not make the result causal, and we keep reading it as an adjusted association.
Question 4: report component effects with valid intervals or drop the component claims?
We did both.
- We removed the ranking of components from the main text.
- We added a separate analysis in Table 14. For weight, waist, insulin and insulin resistance, it reports the component estimates from an additive fit without constraints, their participant-clustered 95% intervals, and p-values with a Holm correction across the 11 components within each outcome.
No component remains significant after the correction. The smallest adjusted p-value is 0.07, for trans fat and weight.
We also looked at the cone-constrained fit with no anchor, as you suggested. In its bootstrap, many refits put a component exactly at the edge of the cone. So even where an interval appears to exclude zero, we do not use it as ordinary evidence for that component. The rankings that remain in the appendix are marked as exploratory and carry the coverage warning from the synthetic experiments.
Our revised conclusion separates the two things. The model splits the diet contribution exactly, which is a mathematical property. On this cohort, the data do not establish associations for single components beyond an equal-weight diet score.
Thank you again. Your questions led directly to the strongest new evidence in the revision.
response to reviewer A5Li: Part 1
Thank you for a sharp and concrete review. Each of your questions was a clear test, and we ran all of them. Some answers support the paper and one confirms your suspicion. We report both in the revised paper.
We ran exactly this baseline (Table 1, Appendix F). It uses the same architecture as our outcome networks, five seeds on each of the same five participant splits, and settings chosen by validation skill.
Its inputs are context, baseline measurements, time and longitudinal diet features. These are the running averages of the component scores under both timing conventions, the baseline component scores, and the component scores and their total at the scored visit. The first version called these inputs "diet history". One of the source studies uses "Diet History" as the name of its diet questionnaire, and we do not mean that plainly, so the revised paper now uses "longitudinal diet features".
This supports your point: the gain in accuracy over the classical baselines comes mainly from modelling the trajectory with a neural network. We now say this in the abstract and the introduction.
What our model adds is a more consistent diet estimate. For a diet one standard deviation better, the estimated weight associations are:
Our model also splits the diet contribution exactly into component terms and pair terms. This split is a mathematical property. It does not show that the cohort supports each component or pair on its own.
We revised the abstract and the introduction so that they lead with the estimator, not with accuracy.
What is new technically:
In practice (Tables 2 and 4):
One clarification on the gradient-descent comparison: Appendix D shows that gradient descent run to convergence on the same objective reaches the same solution as the exact solver. The larger differences in the staged gradient baseline also come from its training order and its parameterization, so we do not credit all of that difference to the exact solver.
Our model is ahead of ridge regression by 0.022 (95% interval 0.016 to 0.029), the linear mixed model by 0.023 (0.016 to 0.031), and the explainable boosting machine with pairs by 0.012 (0.006 to 0.019). It is comparable to the neural network without diet. So what we emphasize is a constrained and interpretable diet estimate, together with competitive prediction.
Yes for weight, waist and insulin. We repeated the whole-cohort analysis using only diet reported before each outcome visit, with the settings chosen within start timing (Table 3). For a diet one standard deviation better, the adjusted associations are:
The estimate for insulin resistance is still negative, but its interval just includes zero, so we call that evidence inconclusive at the 95% level. Skill is essentially unchanged (0.2488 against 0.2490).
Start timing keeps the order in time right and the main associations remain. The study is still observational, so we do not read these numbers as the effect of an intervention.