- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes a novel framework to improve visual reasoning performance by introducing Mixture of Latent Experts. The new architecture consists a Sparse Visual Routing, Expert-Specific Value Adapter and Latent Summary Experts. The authors adopt a two stage training strategy. Firstly, by using a bottleneck in the beginning, enforcing the model to learn about latent tokens instead of visual tokens, encouraging latent tokens to capture useful visual information. Then restoring the normal training process. Such training process is natural and understandable.
Critical strengths
The paper presents a well-motivated framework for improving latent visual reasoning by encouraging different latent experts to extract complementary visual information. The combination of sparse visual routing, expert-specific value adapters, and latent summary experts is intuitive and well designed. The two-stage training strategy is also reasonable and easy to understand. The proposed method achieves consistent improvements across five visual reasoning benchmarks, outperforming both data-matched SFT and existing latent reasoning baselines. The authors also provide extensive ablation studies to demonstrate the effectiveness of different architectural components, training objectives, and expert configurations. Additional experiments on Qwen3-VL models further support the general applicability of the method.
Critical weaknesses
The paper argues that encouraging different latent experts to learn complementary visual information reduces redundancy and improves visual reasoning performance. However, the causal relationship between these factors is not sufficiently demonstrated. Although the authors provide ablation studies and representation similarity analyses, it remains unclear whether the improvements mainly come from reduced redundancy or from the additional architectural components. More direct experimental evidence would strengthen the central claim. Also, the proposed sparse routing mechanism explicitly restricts different experts to different subsets of visual tokens. Therefore, the observed diversity in attention patterns may partially result from these architectural constraints rather than meaningful specialization learned by the model. Although the authors provide a parameter-matched adapter baseline, a more controlled comparison within the same latent architecture would help isolate the contribution of expert-specific processing.
Questions for authors
- The authors argue that expert specialization reduces redundancy and improves visual reasoning performance. Could the authors provide more direct evidence supporting this causal relationship?
- I am concerned that a limited number of latent visual experts may not be sufficient to represent fine-grained information in high-resolution images. Although the second training stage restores direct visual access, could the authors further analyze how latent budget and image resolution affect performance, particularly on V*?
- While the authors demonstrate improvements across Qwen3-VL models of different sizes, the gains appear smaller on larger backbones. Could the authors discuss whether the benefits of latent expert specialization diminish as model capacity increases?
Thank you for the detailed responses and additional experiments. I appreciate the substantial effort in addressing the concerns. Overall, these results address most of my concerns.
I have one minor remaining suggestion regarding the relationship between image resolution and latent budget. The current comparison between RWQA and V* may be affected by differences in task characteristics and data distributions. If feasible, could you conduct a small inference-time experiment on the same V* samples at different input resolutions, comparing the existing 4+4 and 12+4 configurations? This could provide more direct evidence of whether higher-resolution inputs particularly benefit from allocating more capacity to visual experts?