- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PromptEcho, it uses a frozen VLM (Qwen3-VL-32B) as a reward signal for text-to-image RL. The reward is the mean teacher-forced log-likelihood of the original prompt conditioned on the generated image and a fixed query. The results show some improvement over a few baselines under the same RL setup.
Critical strengths
- The idea of this paper is interesting and the proposed method is straight forward. The reward requires no annotation, no reward-model training, and less than 5% overhead during training.
- Results are good. e.g., The 8B vs. 32B ablation shows that scaling the VLM helps; pairwise comparisons backed by human validation.
Critical weaknesses
-
My main concern is that the baselines are weak in a way that makes it hard to tell where the gains actually come from. CLIP (77 tokens) and ImageReward (35 tokens) physically cannot encode the ~200-word DenseAlignBench prompts, so they are guaranteed to underperform on this benchmark regardless of reward design. InferScore uses discrete 1-5 ratings and often yields zero advantage within a group. I believe this paper could be benefited by adding the following: 1.1. discuss and compare with VQAScore (Lin et al., ECCV 2024), which is also a zero-shot, continuous VLM log-likelihood score and is the most direct point of comparison; 1.2. new baseline: a caption-then-compare reward, where the same VLM generates a caption and it is compared against the prompt as in CycleReward (ICCV 2025); learned VLM rewards like UnifiedReward or VisionReward.
-
The score is essentially similar to VisualGPTScore's (Lin et al., ICML 2024). Using text-image-text consistency as an annotation-free reward was studied in CycleReward, and the actual contribution is applying this likelihood as an online RL reward for T2I fine-tuning, which is a valid contribution but should be stated as such.
Questions for authors
Please refer to my weakness.
3 comments
Dear Reviewer jZTj,
Thank you again for your time and effort in reviewing our paper. With only two days remaining in the discussion period, we would like to kindly ask whether you have any further suggestions or concerns. We believe that our previous responses and additional experiments have adequately addressed your concerns. Should you have any further questions, we would greatly appreciate the opportunity to address them promptly.
Best regards, The Authors
Dear Reviewer jZTj,
Thank you again for your time and effort in reviewing our paper. As the discussion period is coming to a close, we would be grateful if you could take a look at our rebuttal and additional experimental results and share any remaining questions or concerns.
Your feedback would be very valuable to us, and we would sincerely appreciate the opportunity to address any outstanding issues promptly before the discussion ends.
Thank you for your consideration.
Best regards, The Authors
Thank you for your detailed and constructive review. Following your suggestions, we have added further experiments and analyses, which have been very helpful in improving the quality of this paper.
1. Additional reward baselines
Following your suggestion, we have added comparisons with VQAScore, CycleReward-style Caption-cycle, and UnifiedReward. The prompt-following component of VisionReward uses VQAScore, so we do not repeat this comparison here; these methods, as well as HPSv3, which we have already compared in this paper, are not subject to the aforementioned caption truncation limitation.
For InferScore, we have added two further variants: changing the score range to 0–100, and computing the expected score from the output probabilities of scores 1–5, thereby addressing the overly coarse granularity of the original 1–5 scoring scheme. The relevant results are shown in the table below, which also includes the diverse guiding-query training metrics from the paper.
TIIF scores in the table are consistently reported on a 0–1 scale; the diverse guiding-query results are from Table 6 of the paper.
The results show that PromptEcho achieves better performance on both the public benchmarks and DenseAlignBench, especially in the long dense-caption setting of DenseAlignBench. Diverse guiding-query training further improves overall performance. We hope these experiments address your concern that the baselines are too weak.
2. The relationship between VisualGPTScore, CycleReward, and our work
We agree with your description of the relationship between our work and VisualGPTScore and CycleReward, and will add citations to these two works in the revised version and revise the related work section to accurately explain their relationship to our work.
At the same time, we would like to explain, from a theoretical perspective, the potential advantages of PromptEcho over the CycleReward-style procedure of “regenerating a caption and then comparing”:
The actual RL results also show that PromptEcho provides a higher-quality reward signal.