- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether gains from adaptive visual token allocation come from free-position geometry or image-content guidance. The authors propose OAPC, which optimizes token positions using raw feature magnitude, and compare it with fixed grids and content-independent free layouts. The results show that feature-magnitude guidance does not consistently outperform a strong uniform-layout baseline or provide consistent gains in object-mask prediction.
Critical strengths
-
The control design addresses a useful distinction. Separating free geometry from content guidance helps avoid attributing all gains to content adaptation.
-
The reporting is transparent. The authors include a same-optimizer control and openly report negative results and methodological limitations.
Critical weaknesses
-
The importance of the central hypothesis is not established. Feature magnitude does not inherently represent semantic importance, and the paper does not sufficiently explain which practical methods or important debates rely on this assumption. Demonstrating that this signal is unreliable therefore seems more like diagnosing a particular design than resolving a broadly significant question.
-
The experimental coverage is insufficient to support broader conclusions. Reconstruction experiments use only 300 images and ResNet-50, ConvNeXt-T, and ViT-B/16; semantic experiments use 1,500 images and two backbones. Model scale and diversity are limited, with no evidence from larger or more recent visual encoders. Since the results depend strongly on the backbone, their relevance to current vision-language models remains unclear.
-
The reasons for underperformance are not sufficiently disentangled. Raw energy improves over constant density with the same optimizer in 23 of 24 settings, yet both generally underperform Lloyd uniform-CVT. This suggests that the optimizer itself may be an important limitation, so overall underperformance cannot simply be attributed to the guidance signal. The paper does not yet turn these findings into clear, generalizable design insights.
Questions for authors
-
Which existing methods specifically rely on raw feature magnitude for token allocation? What important prior understanding do these findings revise?
-
Given the backbone-dependent results, which conclusions are supported beyond the models tested here?
-
Based on the existing controls, how can optimizer limitations be distinguished from guidance-signal limitations? Which is the main bottleneck in the reported results?