- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors propose VT-SMC, a twisted sequential MC sampler that completes missing dMRI connectomes from fMRI/sMRI while favoring completions a downstream diagnostic classifier finds useful. A label-free conditional diffusion prior is tilted by the predictive entropy of a frozen classifier ensemble. The authors show that a fresh classifier trained on the guided completions reaches 81 AUC on ABIDE II vs. 76 with unguided completions, demonstrating the utility of the method.
Critical strengths
S1) Declaring the tiled target explicitly and correcting the guided proposals is more principled than ad hoc classifier guidance.
S2) The evaluation separates utility from fidelity and uses an independent evaluator.
Critical weaknesses
W1) The submission is either unfinished, or AI-generated text was left in. Tables 5-7 are explicitly declared to be placeholders, Table 4 and Appendix C.7 say values await the "final server log," Appendix C.9 says formal experiments start after checks pass, Appendix E is an internal figure spec, etc. Additionally, Table 1 is unreadable as structured.
W2) Training-fold guidance leaks labels. is trained with labels on the training subjects (per Alg. 2) and then guides those same subjects' completions. This breaks the conditional independence premise of Appendix A.1. Guidance must be cross-fitted.
W3) The ablation pattern is not really credible. Table 8 shows all variants produce nearly identical outputs. Additionally, no standard error is given for the 3 seeds, 5 folds.
W4) Novelty and guarantees are thin. The sampler is twisted diffusion sequential MC sampler with an entropy potential. Prop 1 is the equal-covariance Gaussian KL identity and Prop. 2 is standard Feynman-Kac consistency.
W5) Overall, the paper is written very poorly. Beyond the unfinished parts, key symbols are undefined or defined after use (e.g., quality-tier embedding , or the operator in Eq. 4, etc.), writing is poor and difficult to follow, and overall presentation is not very good. This text needs another human pass to get it in good shape.
Questions for authors
Q1) Are training-subject completions guided by models trained on those subjects' labels? IF so, does the gain survive out-of-fold guidance?
Q2) How does the full VT-SMC gain +5 AUC when its two ingredients alone gain <1 and Table 8 shows the variants' outputs nearly identical?
Q3) Which Table 1 entries were re-run on your splits, which are copied from papers, and which tables and figures in the submission are final?
Q4) Fidelity is validated only on the 148 subjects from the four dMRI sites. What supports generated dMRI for the 654 subjects from the other eleven sites who are also older?