- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces CounterFlow, a conditional flow-matching framework for visual counterfactual generation. The main idea is to directly learn a transport field from a source image toward a user-specified target class, avoiding the intermediate prior-space traversal and repeated optimization used by several existing approaches. The method combines source/target class conditioning, latent-space nearest-neighbor pairing, and an auxiliary classification loss. Experiments on MNIST and CIFAR-10 show strong conditional validity and favorable computational cost compared with several GAN-, diffusion-, and flow-based baselines.
Critical strengths
Simple and well-motivated formulation. Directly learning a source-to-target transport field is conceptually clean and avoids several expensive steps required by prior generative counterfactual methods. The use of a single model for multiple class transitions is also practically attractive. Strong empirical efficiency and validity. On CIFAR-10, CounterFlow achieves 100% conditional validity while substantially reducing FLOPs and model size relative to some competing methods. The latent-pairing ablation also supports the proposed training design.
Critical weaknesses
The experimental scope is too limited to establish generality. The evaluation is restricted to MNIST and CIFAR-10, both low-resolution benchmarks. This makes it difficult to judge whether direct pixel-space transport remains effective on higher-resolution or more complex images. The paper itself acknowledges this limitation.
The evidence for instance-level proximity/minimality is weak. The paper uses FID between generated counterfactuals and the source-class distribution as a proximity metric. This is a distribution-level measure and does not directly quantify how much an individual counterfactual changes relative to its corresponding source image. Therefore, claims such as “near-minimal transport” are stronger than what the current evaluation directly supports.
Questions for authors
Could the authors report instance-level proximity metrics, e.g. LPIPS, feature-space distance, or pixel-level distances between each source and its counterfactual? This would materially strengthen the minimal-edit claim.
Do the authors have results on a more challenging dataset or higher-resolution setting? Even one additional experiment would help clarify whether the method scales beyond MNIST/CIFAR-10.
How sensitive are the results to the choice of pretrained VAE embedding used for nearest-neighbor pairing?
We thank the reviewers for their feedback and for recognizing that CounterFlow, which steers images directly in pixel space toward any user-specified target class using Conditional Flow Matching, is original, and that the paper is well written and easy to follow. The main concern raised is that MNIST and CIFAR-10 are too simple to show the method’s potential. We would like to point to Appendix A.4, which explains our dataset choices, in particular why CelebA, though used by some competing methods, does not allow us to evaluate CounterFlow’s ability to transport samples from one multi-class distribution to another. Given that the reviews contain few factual criticisms and that all reviewers recognize the idea as interesting, we believe that the very negative current scores do not fully reflect the assessments written in the reviews.