- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes FlowBender, a feedback-aware framework for conditional flow models. A shared network first predicts a clean-sample estimate, from which a forward operator computes an alignment-error signal. A second pass conditions on this signal to predict a refined velocity. The framework supports gradient-based feedback and derivative-free measurement residuals, while retaining the standard flow-matching training objective. An optional prior-step shortcut reuses cached predictions to reduce denoiser evaluations. The method is evaluated on super-resolution, depth/edge-conditioned generation, JPEG restoration, and 3D mesh texturing, demonstrating favorable measurement-consistency and plausibility trade-offs against supervised and inference-time guidance baselines.
Critical strengths
- Naturally motivated, clearly presented, and well supported experimentally. The paper identifies an intuitive limitation of conditional generation: models may violate constraints even when the forward operator is available to quantify the mismatch. The proposed feedback-aware formulation follows naturally from this observation, making the motivation and method easy to follow. The extensive evaluation across image and 3D tasks, together with informative ablations and compute-budget controls, provides substantial support for the approach. This coherence between motivation, methodology, and empirical evidence makes the central claims convincing.
- A flexible and practically relevant approach to learned correction. FlowBender learns how to incorporate alignment feedback into velocity prediction while retaining the standard flow-matching objective. Its support for both gradient-based and derivative-free feedback makes the framework applicable to different operator types, including non-differentiable JPEG compression. The integration with both ControlNet and LoRA further demonstrates its compatibility with existing generative models. This flexibility gives the contribution relevance beyond a single task or a particular feedback formulation.
Critical weaknesses
None, please see questions.
Questions for authors
- Clarification — Task-specific configuration recommendations. Based on the experiments, what configurations would the authors recommend for different tasks, particularly regarding the feedback variant and shortcut threshold? Have the authors observed any consistent patterns that could guide these choices, for example depending on the operator type or task characteristics?
- Jointly conditioning on the initial prediction and its error. Table 3 compares self-conditioning with error-based feedback. Have the authors considered providing both the initial clean-sample estimate and its feedback signal to the refinement pass? Since the feedback may discard information from the initial prediction, could these two inputs provide complementary information?
- Optional exploration — Multiple feedback-refinement rounds. It would be interesting to explore whether recomputing feedback from the refined prediction and performing additional refinement passes within the same timestep offers further benefits. This differs from the multi-step look-ahead studied in Table 15. Since FlowBender already performs feedback-based correction throughout sampling, I view this as a potential extension rather than a necessary addition to the current submission.
3 comments
The rebuttal has addressed my concern. Overall, I find the paper straightforward and easy to follow, with notable performance improvements. The additional experiments suggest that there is still room for further improvement, but I do not think this detracts from the overall quality of the work. I will maintain my positive recommendation.
Thank you for taking the time to read our rebuttal and for your continued support of the paper.
We thank the reviewer for the encouraging review. We are glad that the motivation was clear, and that the experiments, ablations, and compute-matched controls were found to support the approach convincingly. We also appreciate the recognition of the framework’s flexibility.
1. Recommended configurations. When applicable, we generally recommend the zero-order variant: it is cheaper, often close to the best variant, and the only option for non-differentiable operators. The shortcut retains much of the gain at roughly half the denoiser cost, and should be the go-to in time-constrained settings. For the most reliable performance, we recommend full two-pass sampling with the combined (x̂₁) variant, which is the most consistent across tasks. We will add this discussion to the final version.
2. Jointly conditioning on x̂₁ and s_t. Thank you for the suggestion. This is an appealing variant, as x̂₁ is already computed in the look-ahead pass and adds negligible cost, and we tested it as requested. On SR, providing both inputs performs on par with s_t (zero-order variant) alone (differences within seed variation), suggesting the feedback already carries the relevant information. We will add this result to the appendix.
We provide x̂₁ through the latent input slot (used for first-order feedback) and s_t through the zero-order slot, both from the same look-ahead pass, using the zero-order training protocol:
For reference, in additional multi-seed runs (3 seeds), the zero-order variant varies by ±0.88 dB PSNR and ±0.11 FID across seeds.
3. Multiple feedback-refinement rounds. We agree this is a promising direction and consider it for future work.
Thank you again for the constructive suggestions.