- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes LENS (Latent Noise Mask), a framework for improving multimodal reasoning by suppressing question-irrelevant visual tokens in latent space. The method introduces a learnable Lens Evidence Token (LET) to estimate visual token relevance and injects adaptive noise into low-relevance tokens while preserving the original token structure. The framework is optimized through supervised fine-tuning and reinforcement learning. Experiments across multiple MLLMs and ten benchmarks demonstrate improvements in visual question answering and grounding tasks.
Critical strengths
Effective visual evidence selection framework. LENS introduces a soft latent-space suppression mechanism that preserves relevant visual tokens without changing the token sequence structure, providing a practical alternative to hard token pruning.
Extensive experimental evaluation. The paper evaluates multiple model families and benchmarks, with comprehensive ablation studies demonstrating consistent improvements in both visual question answering and grounding performance.
Critical weaknesses
Limited methodological novelty. Question-conditioned visual token selection and suppression have been extensively explored in previous studies. LENS primarily combines a learnable evidence token with latent noise injection, which appears to be an incremental modification of existing visual token filtering and feature gating approaches.
Potential confounding effects of additional supervision. The LET module is trained using question-relevant bounding-box annotations, providing explicit supervision about important visual regions. It remains unclear whether the improvements primarily result from this additional supervision rather than the proposed latent noise mechanism. Comparisons with alternative methods under identical evidence supervision are necessary.
Insufficient justification for latent noise injection. The paper assumes that injecting noise into low-relevance visual tokens effectively suppresses redundant information. However, feature perturbation does not necessarily imply information removal or reduced interference. More direct evidence is needed to establish that latent noise genuinely suppresses irrelevant visual information rather than merely altering feature distributions.
Incomplete isolation of the proposed method's contribution. Although the paper includes SFT and GRPO ablations, the benefits of evidence selection, noise injection, and reinforcement learning are not fully disentangled under matched training conditions. Stronger comparisons with conventional soft masking, feature gating, and attention reweighting using the same LET predictions would better establish the necessity of the proposed mechanism.
Limited analysis of computational efficiency and generalization. LENS requires an additional evidence-probing pass and a noise generation module during inference. The practical computational overhead is not sufficiently quantified. Furthermore, its dependence on object-level evidence annotations raises questions about generalization to tasks requiring global visual understanding or complex multi-region reasoning.
Questions for authors
NA