- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes LenGuard-GPC for multi-view spatial reasoning with GRPO. It uses guided-prompt consistency to provide a denser trajectory-level signal than answer correctness alone and introduces a staged length guard to balance reasoning sufficiency and conciseness. Comparisons with the base model and vanilla GRPO across in-domain and out-of-domain benchmarks, together with fine-grained analyses, generation-length statistics, and ablations, indicate improved spatial reasoning and reduced redundant generation.
Critical strengths
-
The method directly addresses the stated failure modes. The reward design jointly tackles sparse supervision, verbose reasoning, and collapse to overly short responses. It is simple to integrate and incurs no additional inference-time cost.
-
The empirical trends are broadly consistent. LenGuard-GPC improves over vanilla GRPO across multiple benchmarks while reducing generation length. The fine-grained results are also broadly aligned with the intended improvement in cross-view spatial reasoning.
Critical weaknesses
- Guided-prompt consistency is not directly validated as a measure of reasoning quality. The method assumes that a trajectory should receive a higher reward when the predictive distributions under the standard and guided prompts are more similar. However, both distributions are produced by the same policy, and a low KL may instead reflect weak guidance, model insensitivity to the guidance, or shared prompt biases. The paper demonstrates the utility of this reward mainly through downstream task performance but does not analyze how the KL score relates to correctness, reasoning quality, or grounding in visual evidence.
- The experiments do not sufficiently isolate the contributing factors. The inputs, template, filtering procedure, and possible use of answer information in guided-prompt generation are not fully disclosed. Important controls are also missing, including a length-only variant, a flat length bonus, mean per-token KL, shuffled or generic guidance, hyperparameter sensitivity, and multiple random seeds. It therefore remains unclear whether the gains arise from informative guidance, length regularization, or their specific combination.
Questions for authors
-
What information is available when generating each guided prompt? Can the generating model access the ground-truth answer or a complete rationale? Please provide the generation template, representative examples, and quality-control procedure, and explain how answer leakage or privileged teacher information is excluded.
-
Could the authors report multi-seed results and add controls for a length-only objective, a flat length bonus, mean per-token KL, and random or generic guidance? These results would materially affect my assessment of the mechanism and robustness of the reported gains.
-
Couldn the authors analyze the correlation between guided-prompt KL and answer correctness, human-rated reasoning quality, or grounding in visual evidence? Does the reward remain effective with irrelevant, generic, or randomized guidance? Such analyses would help establish that the gains arise from meaningful guided consistency rather than generic prompt regularization.
4 comments
Q3: Further Details on Guided-Prompt Construction and Its Role in Training
R3: We thank the reviewer for raising these important questions. We would like to clarify the role of ground-truth (GT) information in our guided-prompt construction, the distinction between training-time supervision and evaluation-time information leakage, and the reproducibility of our approach.
(1) Clarification on GT usage and token-level supervision.
First, we emphasize that the GT used in our guided-prompt template comes exclusively from the training set, where GT is already available for computing the accuracy reward in standard GRPO. Incorporating GT into the guided prompt provides an additional form of training-time supervision, which should be distinguished from information leakage during evaluation.
Importantly, our method does not generate any GT-conditioned reasoning trajectory. During each RL rollout, the policy samples a single trajectory under the standard prompt, without access to either the hint or GT. The guided prompt, which incorporates task-specific guidance and GT, is used only to evaluate the token-level predictive distributions along this fixed trajectory through teacher forcing. We then compute the KL divergence between the standard and guided distributions at each token position and aggregate these scores into a trajectory-level RL reward.
Thus, GT serves as privileged training-time information for constructing a stronger reference condition, rather than as a target chain of thought for imitation. The policy is optimized through the standard GRPO objective, without generating or directly imitating teacher-produced reasoning trajectories.
Crucially, neither GT, guided prompts, nor the external hint generator is used during inference. The trained policy receives only the standard prompt and independently generates its reasoning and final answer. Furthermore, all evaluation benchmarks are held out from training, and their GT answers are never used for guided-prompt construction. Therefore, our method does not involve evaluation-set or inference-time GT leakage.
(2) Guided-prompt construction and reproducibility.
As described in Section 3.2, we use GPT-5.3-Chat to generate one-sentence, task-specific hints offline for each training instance. To improve reproducibility, we provide the complete prompt templates below.
Hint-generation instructions (GPT-5.3-Chat):
You are given a set of images, a question, and the ground-truth answer. Generate one caption that helps solve the question without revealing the answer.
Rules:
- Do not state, paraphrase, or imply the ground-truth answer.
- Do not copy words from the ground-truth answer.
- Focus on the key cross-image clues, such as matching objects, relative positions, viewpoint changes, or spatial relations.
Question: {question}
Ground Truth: {answer}
Output: One caption only.
Guided-prompt template:
Question: {}
Please reason step-by-step according to the following instructions:
Provide your detailed reasoning for the raw question within the <thinking> </thinking> tags.
Hint: {}
Ground Truth: {}
Use the multiple perspectives to discover objects or details not visible in a single image. Ensure your logic synthesizes the visual evidence into a coherent conclusion.
Final Output: Provide only the single option letter (e.g., A, B, C, D) within the <answer> </answer> tags.
As shown above, the hint-generation instructions explicitly discourage revealing or implying the GT answer. While the guided-prompt template includes GT to provide a stronger reference condition, it is used exclusively for token-level reward evaluation, rather than for generating additional reasoning trajectories. This distinction is central to our reward design.
We thank the reviewer for this constructive feedback. We have clarified the role of GT-conditioned training supervision, provided the complete prompt templates, and clarified the training-only role of guidance to improve the transparency and reproducibility of our framework.
Q4: Robustness Across Random Seeds
R4: We thank the reviewer for the valuable suggestion regarding experimental robustness. We would like to emphasize that the contributions of different reward components and alternative design choices have been extensively examined in Tables 1 and 2, including the effectiveness of guided-prompt consistency, staged length regulation, and alternative KL aggregation and length bonus strategies.
To further assess training stability, we additionally evaluate our method across multiple random seeds using the same Qwen3-VL-8B-Instruct backbone and identical training configurations.
Table 3. Multi-seed evaluation on MMSI (accuracy, %).
| Method | Seed 1 | Seed 2 | Seed 3 |
|---|---|---|---|
| LenGuard-GPC (Ours) | 36.1 | 35.9 | 36.4 |
Together with the comprehensive ablation studies presented in Tables 1 and 2, these multi-seed experiments provide additional evidence regarding the effectiveness and robustness of our framework.
We thank the reviewer for this constructive suggestion, which helps strengthen the empirical evaluation of our method.
Q5: Effectiveness of Task-Specific Guidance
R5: We thank the reviewer for this insightful suggestion regarding whether guided-prompt consistency benefits from meaningful task-specific guidance rather than generic prompt regularization.
First, as demonstrated in Tables 1 and 2, our ablation studies provide evidence for the effectiveness of guided-prompt consistency and its interaction with length regulation. In particular, guided-prompt consistency with a constant length bonus achieves 33.5% accuracy, while the staged length reward without guided-prompt consistency achieves 32.5%. Combining guided-prompt consistency with the staged length guard further improves accuracy to 36.1%, supporting the complementary roles of the two components.
To further investigate whether the reward depends on meaningful guidance, we introduce an additional Shuffled Guidance control. Specifically, we randomly permute the generated hints across different training instances, breaking the correspondence between each hint and its original question. Importantly, the ground-truth answer remains unchanged for each instance, and the guided-prompt template, KL reward, length guard, and all training hyperparameters are kept identical to our full method.
Table 4. Effect of task-specific versus shuffled guidance on MMSI.
| Method | Guidance Configuration | MMSI Acc. (%) |
|---|---|---|
| Vanilla GRPO | No Guidance | 32.2 |
| LenGuard-GPC | Shuffled Hints | 32.1 |
| LenGuard-GPC (Ours) | Original Hints | 36.1 |
This controlled comparison isolates the contribution of task-specific hint information while preserving the same GT-conditioned reference setting. Original hints achieve 36.1% accuracy, compared with 32.1% for shuffled hints, supporting the contribution of task-specific guidance beyond an additional prompting condition alone.
We emphasize that guided-prompt KL is not intended as a standalone measure of reasoning correctness. Instead, it serves as an auxiliary reward signal combined with verifiable task rewards. The ablations in Tables 1 and 2, together with the shuffled-guidance control, provide complementary evidence regarding the effectiveness of this reward design.
We thank the reviewer for this valuable suggestion, which helps clarify the role of task-specific guidance in our framework.
Dear Reviewer,
As the discussion period is nearing its end, we would appreciate your feedback on our rebuttal and the additional results in the revised manuscript. Please let us know if any concerns remain so that we can respond promptly.
Best regards,
The Authors
Q1: Effectiveness of Guided-Prompt Consistency as a Reward Signal
R1: We thank the reviewer for this insightful comment regarding the effectiveness of guided-prompt consistency. Guided-prompt consistency serves as an auxiliary training signal that complements the verifiable accuracy reward in GRPO. Its contribution is directly evaluated through the following ablations.
Importantly, our ablation results provide empirical evidence of the effectiveness of this reward component. As reported in Section 4.3, we compare vanilla GRPO, guided-prompt consistency without length regulation, and our full method. We additionally evaluate a variant without the KL reward to isolate the contribution of staged length regulation.
Table 1. Ablation of reward components on MMSI.
As shown above, introducing guided-prompt consistency improves MMSI accuracy from 32.2% to 33.5%, whereas using only the staged length reward yields a marginal improvement to 32.5%. This suggests that the performance gain cannot be explained by length regulation alone. Combining both components further improves accuracy to 36.1%, outperforming the KL-only and length-only variants by 2.6 and 3.6 percentage points, respectively.
These findings indicate that guided-prompt consistency provides an effective additional training signal, while the staged length guard complements it by regulating reasoning length. Although KL divergence is not intended as a standalone measure of reasoning correctness, the ablation results demonstrate the complementary roles of the two reward components in improving downstream spatial reasoning performance.
We thank the reviewer for this valuable suggestion, which helps clarify the individual contributions of our reward components and strengthen the empirical support for LenGuard-GPC.
Q2: Further Evaluation of Reward Design Choices
R2: We thank the reviewer for the constructive suggestions regarding the contributions of different reward components and alternative design choices. We would like to clarify the existing ablation results and provide additional controlled comparisons.
We clarify that the variant labeled “w/o staged length reward” in Section 4.3 of the original submission retains a constant length bonus while removing the staged bonus design. It therefore corresponds to “KL + Constant Bonus” in Table 2, achieving 33.5% accuracy on MMSI with an average response length of 163.9 tokens. Replacing the constant bonus with our staged length guard improves accuracy to 36.1%, demonstrating the benefit of the staged design. We have revised this point in our paper.
To further investigate the design choices, we additionally evaluate mean KL per token and a constant length bonus. We also report average response lengths to examine the effect of different reward configurations on reasoning efficiency.
Table 2. Ablation of KL aggregation and length regulation on MMSI.
Furthermore, the KL-only variant provides direct evidence of short-response collapse. Without length regulation, its average response length drops dramatically to 13.1 tokens, compared with 307.9 tokens for vanilla GRPO. This behavior is consistent with the length-dependent bias of accumulated KL penalties, which can incentivize the policy to terminate reasoning prematurely.
In contrast, our staged length guard maintains an average response length of 261.9 tokens while improving accuracy to 36.1%, demonstrating that length regulation effectively mitigates short-response collapse while preserving the benefits of guided-prompt consistency.
Regarding guided-prompt construction, we provide the complete generation instructions and guided-prompt template in our response to Q3, clarifying the role of training-set ground truth and external supervision.
We thank the reviewer for these valuable suggestions, which help clarify the motivation and empirical effectiveness of our reward design.