- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigated the problem of training data selection for Conditional Flow Matching (CFM) and proposes State-Jac method. It combines target endpoint features with local velocity response features to select training samples based on coverage of the target within the joint feature space. The theoretical analysis establishes a relationship between endpoint distance and the discrepancy in prescribed state-velocity supervision under shared source noise. It further analyzes the closed-loop trajectory error between the full-data model and the subset model and characterizes differences in the state Jacobian through local perturbations and random directional probing. Experiments cover super-resolution tasks on CIFAR-10, CIFAR-100, Long-tailed CIFAR-10, and latent ImageNet-100.
Critical strengths
-
This paper proposes a selection representation related to the CFM structure. Compared to using only static semantic features, the response of the velocity field to state perturbations provides a different type of information. I believe leveraging this for data selection is potentially a promising avenue for research
-
The paper is generally theoretically grounded. The fundamental derivations hold under the stated assumptions. The endpoint identity in Section 3.1, the closed-loop error decomposition in Section 3.2, and the results regarding local response and random directional probing in Section 3.3 are all clearly presented. Appendix A provides further elaboration on these derivations and the practical approximations involved.
Critical weaknesses
W1: Theoretical analysis does not yet sufficiently support the claim of data interchangeability
Section 3 analyzes the distance between supervision pairs, the trajectory errors of the two models, and the Jacobian differences at various samples, yet it fails to establish a link between the coverage error in Equation (15) and the retraining model field error in Equation (5). Furthermore, the rationale behind choosing the sum of the state difference and the target velocity difference, as well as its relationship to training loss or parameter gradients, remains insufficiently explained. Additionally, uniformly sampling representative points may alter the probability mass of the original data. Equation (80) in Appendix A.8 explicitly includes a mass mismatch term that is not controlled by the coverage objective. As a result, the current theory serves better as a heuristic for representation design rather than a guarantee that learning outcomes will remain similar following sample substitution.
W2: Lack of Comparison Methods
The baselines in Table 1 mainly cover static features and scalar difficulty metrics, lacking representative methods for gradient-based subset selection or distribution matching. This setup relates to one-shot data curation, coreset selection, and certain active learning approaches. It is suggested that the authors should clarify these procedural differences and compare against strong baselines that share comparable informational assumptions. More importantly, the study lacks comparisons, under identical settings for the proxy model, compression dimensions, and selection mechanisms, between the proposed method and approaches based on standard features, speed prediction, or response representations. In Table 2, State-Jac does not outperform all simple variants on CIFAR-10, and the CIFAR-100 results omit the "Response-only" setting.
W3: Actual performance-to-cost advantages and budgetary patterns have not yet been established.
There remains a significant gap between State-Jac and Full: the CIFAR-10 FID is 15.102 versus 7.555, and the ImageNet-100 FID is 15.274 versus 12.917. While this does not negate the method's value under budget constraints, Figure 4(c) lacks a comparison with Full and Random baselines at equivalent total costs. Thus, it does not yet demonstrate that data selection is more cost-effective than simply increasing the training volume. The primary experiments utilize only a 20% retention rate, with 40% results appearing solely in the long-tail setting of Table 3. Performance-versus-total-cost curves across more sample budget ratios are highly recommended to identify the practical range for compression.
Questions for authors
Q1: What is the practical value of this selection setup?
The full set of target data is available prior to selection, yet the performance of the subsets in Table 1 and Table 3 remains significantly lower than that of the "Full" set. What specific resource constraints do the authors aim to address? Does State-Jac outperform direct training on the "Full" or "Random" sets given the same total computational budget? Could the authors provide performance-vs-cost curves across various retention ratios, rather than just the results for the 20% setting used in the main benchmarks?
Q2: Why does the proposed geometry allow for determining the interchangeability of training samples?
How do the distance and Jacobian results from Section 3 relate to the training impact of sample replacement? Specifically, why does reducing the coverage error in Equation (15) improve the model field discrepancy addressed in Equation (5)? Which conclusions are theoretically supported, and which serve merely as heuristic motivations for the selector? Why does the proposed geometric approach enable the assessment of training sample interchangeability?
Q3: Does the method's performance depend on the specific conditional structure of the restoration task setting? If not, could you please explain in more details. Thanks!
All experiments utilize paired super-resolution of the form . If the condition is not generated by a deterministic target, can the joint distance between endpoints and responses still effectively serve as a selection criterion? How should the authors qualify their conclusions regarding data selection for general CFM?
Engage in discussion
The authors and reviewers are requested to engage in the discussion phase.
Authors: please respond to the review comments.
Reviewers: please review the authors’ rebuttal and consider revising your assessment/score.