- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes ATHENA, a training-free framework for improving object-count fidelity in text-to-image generation. It constructs cardinality-specific steering signals by contrasting model predictions under the original prompt and a count-modified control prompt. Three strategies are introduced: Static, Feedback, and Adaptive, which progressively incorporate intermediate count estimation and steering-strength adjustment.
The authors provide a geometric interpretation and introduce ATHENA-COUNT, a benchmark with 360 prompts of varying complexity. Experiments across several generative backbones demonstrate substantial improvements in count accuracy, supported by additional evaluations using Qwen3-VL, GenEval, and multiple random seeds.
Critical strengths
S1. Substantial empirical improvements. ATHENA improves count fidelity across multiple generative backbones and counting benchmarks. The independent Qwen3-VL evaluation, GenEval experiments, and multi-seed analysis provide additional evidence of practical effectiveness.
S2. Practical training-free framework. The method requires no retraining or architectural modifications and provides different accuracy–runtime trade-offs. The introduced counting benchmark and multi-object experiments further broaden the evaluation.
Critical weaknesses
W1. Unresolved inconsistencies in experimental reporting. Table 2 and Appendix Table 10 contain several incompatible results under the stated single-seed and three-seed protocols. For example, SDXL unsteered accuracy on ATHENA-COUNT is 19.7% in Table 2 but 24.9 ± 1.8% in Table 10, while CountGen runtime on CoCoCount-E is 29.2 s versus 45.8 ± 0.7 s. These discrepancies require reconciliation before the reported performance and efficiency conclusions can be assessed reliably.
W2. Limited methodological isolation and theory–implementation mismatch. The steering formulation resembles existing contrastive guidance, while comparisons against computation-matched alternatives are missing. Moreover, Appendix B analyzes an unnormalized noise-prediction update, whereas Algorithm 2 applies norm matching and the evaluated backbones include flow-matching models. The current derivation therefore does not directly establish the claimed geometric behavior of the implemented method.
Questions for authors
Q1. Experimental consistency. What explains the discrepancies between Table 2 and Table 10? Please provide per-seed results, runtime measurements, and any differences in sampler settings, hardware, or evaluation protocols.
Q2. Theoretical justification. Does the geometric interpretation remain valid after the norm matching in Algorithm 2? How is the derivation adapted to the velocity predictions of flow-matching models?
Q3. Contribution attribution. How does ATHENA compare with standard contrastive guidance and detector-based best-of-N selection under matched denoiser evaluations or wall-clock budgets? What is the additional benefit of feedback-based adaptation beyond increased inference computation?
Q4. Adaptive behavior. Why does Static outperform Adaptive in some settings, particularly FLUX.1-dev on CoCoCount and FLUX.1-dev / SD 3.5 Large on GenEval? Can the authors analyze correction success rates and cases where adaptive steering degrades the result?
Q5. Evaluation robustness. Although Qwen3-VL provides independent evaluation, ATHENA-COUNT explicitly prioritizes detector-compatible categories. Can the authors provide a manually verified subset or additional analysis of detector disagreement? Also, how robust are the claims of semantic preservation given the declines in some perceptual metrics reported in Table 14?
4 comments
Addressing reviewer HJs4 concerns (part 2)
W2 and Q3
Regarding the Best-of-N comparison, following the reviewer’s suggestion, we evaluated detector-based Best-of-2 across all three backbones and datasets. This baseline generates two independent unsteered images and selects the one whose detected count is closest to the target. Complete results are provided below and in Appendix H.2 (Comparison with Best-of-2 Sampling), highlighted in blue. ATHENA-Adaptive achieves higher or comparable accuracy across all nine settings and lower wall-clock generation time in six. For example, on SD 3.5 Large and CoCoCount, ATHENA achieves 78.3% accuracy in 62.0 seconds, compared with 72.7% in 88.5 seconds for Best-of-2.
| Model | Method | CoCoCount Acc. (%) ↑ | Time (s) ↓ | CoCoCount-E Acc. (%) ↑ | Time (s) ↓ | ATHENA-COUNT Acc. (%) ↑ | Time (s) ↓ |
|---|---|---|---|---|---|---|---|
| FLUX.1-dev | Best-of-2 | 72.7 | 91.0 | 61.1 | 45.6 | 53.3 | 91.0 |
| FLUX.1-dev | ATHENA-Adaptive | 70.2 | 64.8 | 62.2 | 35.1 | 53.6 | 72.5 |
| SD 3.5 Large | Best-of-2 | 72.7 | 88.5 | 62.7 | 48.3 | 53.1 | 87.9 |
| SD 3.5 Large | ATHENA-Adaptive | 78.3 | 62.0 | 65.6 | 38.1 | 56.1 | 70.4 |
| SDXL | Best-of-2 | 46.6 | 18.7 | 39.4 | 10.5 | 31.7 | 18.7 |
| SDXL | ATHENA-Adaptive | 54.0 | 19.4 | 45.5 | 11.6 | 34.7 | 21.2 |
Beyond these results, ATHENA, like correction-based baselines, targets errors in the same seeded generation, aiming to preserve its scene structure and semantic content rather than replace it with an independently generated image. Moreover, additional feedback-guided correction attempts could further refine the steering strength . Resampling and steering are also complementary. Best-of-N can select among independently generated ATHENA candidates, combining ATHENA’s higher per-sample success rate with the benefits of candidate selection.
Regarding the benefit of feedback, we thank the reviewer for raising this point. Feedback allows ATHENA to construct a control prompt that better targets the actual counting discrepancy, guiding the correction toward the desired count and avoiding unnecessary intervention when the estimated count is already correct. Adaptive further adjusts the correction strength based on the observed response. This targeted approach achieves higher exact-count accuracy on the more challenging CoCoCount-E and ATHENA-COUNT datasets across all three backbones (Table 2). For example, on ATHENA-COUNT, Feedback achieves 52.2% and 51.1% accuracy on FLUX.1-dev and SD 3.5 Large, respectively, compared with 48.9% and 46.7% for Static. We would also be happy to evaluate any additional specific contrastive-guidance baseline the reviewer suggests.
Q4
We thank the reviewer for this question. We would like to clarify that ATHENA-Adaptive is particularly more effective on harder datasets; for example, on ATHENA-COUNT with FLUX.1-dev, it achieves 53.6% accuracy versus 48.9% for Static. On the other hand, Static can be more effective on simpler settings with simpler prompts and smaller target counts, as commonly encountered in CoCoCount and GenEval. In these cases, additional feedback-based adjustments may offer limited benefit or introduce errors due to imperfect intermediate count estimates. For example, Figure 9(a) shows Static outperforming Adaptive at a target count of four on CoCoCount-E with FLUX.1-dev.
Moreover, following the reviewer’s suggestion, we compared unsteered and ATHENA-Adaptive outputs on ATHENA-COUNT using FLUX.1-dev. 16.67% of all samples were incorrect without steering but correct with Adaptive, while 2.50% showed the reverse, yielding an overall accuracy gain from 39.44% to 53.61%. Appendix J.2 illustrates successful and unsuccessful corrections and their effects on scene structure.
Q5
Regarding detector compatibility and human evaluation, we additionally conducted a human evaluation of SD 3.5 Large generations on ATHENA-COUNT based on the reviewer's suggestion. Human-evaluated exact-count accuracy improves from 47.50% for Unsteered to 61.67% for ATHENA-Adaptive, consistent with the improvements reported by G-DINO (38.90% to 56.10%) and Qwen3-VL (44.44% to 60.83%, Table 3). The human evaluation is closer to Qwen3-VL than G-DINO for both methods, suggesting that G-DINO may underestimate counting accuracy on ATHENA-COUNT. Overall, this result supports that ATHENA’s gains are not specific to detector-based evaluation.
Regarding image quality, the drops in PickScore and HPSv2 are small (Appendix J.1, Table 14), suggesting that any degradation in perceived image quality is unlikely to be noticeable to human observers. The qualitative examples in Appendix J.2 also support this, showing count corrections that preserve scene structure and visual quality.
We hope the new experiments and discussion resolve the reviewer’s concerns and clarify ATHENA’s contribution and practical benefits.
Thank you for the further clarifications. I accept the explanations regarding baseline availability, backbone differences, and the range of counts. The revised experimental results and supplementary derivations have largely addressed my concerns about the paper’s reliability.
My primary remaining reservation concerns the novelty of the method and the attribution of performance gains. While the additional "Best-of-2" experiment is valuable, it does not yet sufficiently demonstrate that ATHENA offers a distinct advantage over simple guidance based on numerical constraints.
Overall, the rebuttal has significantly strengthened the credibility of the paper; however, I will maintain my current score for the time being.
We thank the reviewer for their response and are pleased that the additional experiments and clarifications have largely addressed the reliability concerns.
We would appreciate further guidance on the remaining concern. Our evaluation includes Counting Guidance, which uses gradients to enforce numerical constraints. In same-backbone comparisons, ATHENA achieves higher accuracy with substantially lower computational overhead. To ensure we address the reviewer’s intended comparison, could they clarify which method or setup they have in mind by “simple guidance based on numerical constraints”? We would be happy to conduct additional comparisons to help address this concern.
Addressing reviewer HJs4 concerns (part 1)
We thank the reviewer for their careful evaluation of our work and for recognizing the empirical improvements, practical applicability, and extensive evaluation of ATHENA. We address each concern in detail below.
W1 and Q1
We thank the reviewer for identifying these discrepancies and apologize for the inconsistencies in the reported results. We would first like to clarify that all results in Table 2 and the associated figures are accurate and remain unchanged. Table 2 reports results using seed 23, while Table 10 reports the mean and standard deviation across three seeds {7, 23, 42}. The discrepancies arose from a small issue in our merger code affecting some of the entries and a few transcription errors in Table 10. We have carefully rechecked the results and updated Table 10 in the revised manuscript. For full transparency, we provide the complete per-seed results in Section G.1.1 of the Appendix, highlighted in blue, which can be used to independently verify all entries in the corrected Table 10.
Regarding runtime measurements, as specified in Section 4.1 (Computational Setup), we use NVIDIA RTX A6000 GPUs (48 GB) for CoCoCount and ATHENA-COUNT, and NVIDIA A100 SXM4 GPUs (40 GB) for CoCoCount-E. Within each dataset, all models and methods are evaluated using the same GPU type, ensuring consistent runtime comparisons. We hope these clarifications address the reviewer's concerns.
W2 and Q2
Regarding norm matching, the geometric interpretation and norm matching serve complementary purposes. Section 3.2.2 motivates the direction of the contrastive correction under the stated assumptions. Norm matching allows us to apply this correction while preserving the original prediction scale, reducing the risk of subsequent latents becoming out of distribution for the denoiser. Without it, our preliminary experiments showed severe degradation or invalid images. Related guidance-rescaling strategies have also been used to mitigate image-quality degradation in (Lin et al., 2024). Although normalization changes the exact correction relative to the unsteered prediction, it preserves the direction of the combined steered prediction. Hence, the geometric interpretation motivates the steering signal in ATHENA, rather than providing an exact characterization of the normalized update.
Regarding flow-matching models, the geometric interpretation also applies to linear flow matching. Consider zt=(1−t)z0+tξ, with $v_{t,q}$ approximating E[ξ−z0∣zt,q]. Then the corresponding noise prediction and score satisfy
\qquad s_{t,q}(z_t)\approx-\frac{\epsilon_{t,q}^{\mathrm{noise}}}{t},$$ For the unnormalized steering update $\tilde v_t=v_{t,p}+\gamma(v_{t,p}-v_{t,\hat p})$, with steering strength $\gamma>0$, define the original and steered clean estimates as $\hat z_{0,p}=z_t-tv_{t,p}$ and $\tilde z_0=z_t-t\tilde v_t$. Their difference is $$\tilde z_0-\hat z_{0,p} =-t\gamma(v_{t,p}-v_{t,\hat p}) \approx\frac{\gamma t^2}{1-t} \bigl(s_{t,p}(z_t)-s_{t,\hat p}(z_t)\bigr).$$ Thus, the clean-estimate correction follows the same score contrast as in the diffusion formulation. Under the local manifold and control-condition assumptions in Appendix B, this motivates a correction toward the target-conditioned manifold. We have added the full derivation and its assumptions to **Appendix B (Extension to Linear Flow-Matching Models)**, highlighted in blue. **Reference** S. Lin, B. Liu, J. Li, and X. Yang. “Common Diffusion Noise Schedules and Sample Steps Are Flawed.” 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 5392–5399, 2024.