- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper replaces verbose free-form multimodal CoT with Dense Reasoning Trace (DRT): compact, structured traces that compress wording via symbolic connectors, place visual observations in <visual> and deduction in <think> with the two explicitly disentangled, and close with a short answer. Training proceeds in two stages. DenseTrace Initialization has GPT-5.1 rewrite 200K multimodal samples into the DRT format for SFT; the Trace-Grounded RL stage first builds reference traces through a tri-perspective verification pipeline, then optimizes Trace-Grounded GRPO with step-level partial credit, a hallucination penalty, and exploration bonuses. On five reasoning benchmarks, DRT delivers a 5.5× token-efficiency gain while adding 1.3 accuracy points over the Qwen3-VL baseline.
Critical strengths
- Clear practical value. A 5.5× cut in output tokens with slightly better accuracy is a strong operating point, and the accuracy–efficiency trade-off dominates the compared efficient-reasoning methods, which matters directly for lowering multimodal inference cost.
- Complete and careful training design. Reference traces pass tri-perspective verification; the reward combines process-level partial credit, a multiplicative hallucination correction, and difficulty-aware exploration bonuses — the pieces interlock, and ablations support the necessity of each component.
Critical weaknesses
- Compression still has an accuracy ceiling. In Table 1, DRT-RL averages 67.2, well behind Qwen-Thinking at 72.2, so the "accuracy preserved" framing is overstated — the honest takeaway is a better trade-off, not free efficiency.
- Heavy reliance on strong external models. GPT-5.1 performs both the SFT rewriting and the RL reference verification, and reward judging depends on Qwen3-235B; much of the gain is therefore distillation plus verification, with the method's own novelty concentrated in the format. Sensitivity to the reward hyperparameters (the λ's, N_cap) is not studied.
Questions for authors
- Under a matched token budget, how does DRT-RL stack up against Qwen-Thinking?
- Does the DRT format transfer to backbones other than Qwen3-VL?
- What fraction of candidate trajectories survives tri-perspective verification, and how is verifier-induced bias assessed?
2 comments
Thank you for the detailed response and additional experiments, which address most of my concerns. Therefore, I will keep my positive rating.
[Question 1] Under a matched token budget, how does DRT-RL stack up against Qwen-Thinking?
We have not yet completed a controlled matched-budget comparison with Qwen-Thinking. DRT-RL is trained through SFT and RL to produce compact traces, so increasing its generation limit alone does not ensure that it uses the additional token budget.
Our accuracy-preserving claim refers specifically to Qwen3-VL-8B-Instruct: DRT-RL maintains the Instruct baseline's average reasoning performance while substantially reducing output tokens, but does not match Qwen-Thinking's higher accuracy. We will clarify this scope and acknowledge controllable reasoning-budget scaling as a limitation.
[Question 2] Does the DRT format transfer to backbones other than Qwen3-VL?
We applied the complete DRT SFT+RL pipeline to Qwen3-VL-2B-Instruct and InternVL3.5-8B and evaluated both on all five benchmarks. Each cell reports accuracy (%) / mean full-output tokens. AVG is the arithmetic mean across the five benchmarks.
On Qwen3-VL-2B, DRT-RL improves accuracy on all four multimodal benchmarks while substantially reducing output length, although GSM8K accuracy decreases. On InternVL3.5-8B, DRT-RL likewise produces much shorter traces, but with lower accuracy across all five benchmarks. These results show that compact DRT reasoning transfers to both a smaller backbone and a different model family, while accuracy preservation remains backbone- and task-dependent.
[Question 3] What fraction of candidate trajectories survives tri-perspective verification, and how is verifier-induced bias assessed?
Among 28,479 valid candidate trajectories, 95.68% pass visual fidelity, 88.73% pass reasoning validity, and 61.20% pass answer correctness. Overall, 14,724 trajectories (51.70%) pass all three criteria and are retained for training.
Motivated by concerns about self-preference in LLM judgments [1], we assess dependence on the original verifier through a cross-family audit of all 14,724 retained trajectories. We use two models from different families: Gemini-3.8-Flash and Seed-2.1-Pro-0915. GPT-5.1, which generated and originally verified the trajectories, is excluded from the audit panel. Both auditors are blinded to the generator identity, the original verification decision, and each other's judgments. Each independently solves the original problem before evaluating the trajectory's visual fidelity, reasoning validity, and answer correctness.
Within the 1,796 jointly flagged trajectories, the auditors jointly localize one erroneous step in 664, two in 506, three in 311, and four or more in 315.
These results indicate that tri-perspective verification filters the candidate pool but does not guarantee error-free reasoning. We will report verification pass rates, cross-family agreement and disagreement, and error severity rather than treat any single verifier as ground truth. The downstream RL results support the practical utility of the retained data, while the audit highlights residual quality concerns and verifier dependence.
[1] Chen, Zhi-Yuan, et al. "Beyond the surface: Measuring self-preference in llm judgments." Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.