- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies why pretrained visual Mamba models degrade at resolutions beyond pretraining. It attributes this to changes in spatial recurrent rate and consequent mismatches in recurrent states and residual updates. It defines Cross-Resolution Trajectory Discrepancy (CRTD) and proposes Uniform-RU, combining deterministic spatial-dynamics transport with learned carried-state and update corrections. The backbone stays frozen and calibration uses unlabeled images. Evaluation spans visual Mamba architectures on ImageNet classification, COCO detection, and ADE20K segmentation.
Critical strengths
- The evaluation is broad across model families, resolution shifts, and downstream tasks, including classification, detection, and segmentation. The inclusion of an output-only control and component-level comparisons also shows a serious effort to distinguish the proposed mechanism from simpler alternatives.
- The method has a practical adaptation profile: it requires no class labels and keeps the pretrained backbone frozen. This makes the approach relevant to settings where unlabeled target-resolution data are available but retraining the original model is undesirable.
Critical weaknesses
- Calibration cost is non-negligible: 8,192 unlabeled calibration images, 1,024 model-selection images, eight epochs, and a separate calibrator per target resolution. Added parameters range from 0.5M to 8.0M, with additional FLOPs. Wall-clock and hardware costs should be reported.
- CRTD reduction and accuracy recovery occur together, while calibration explicitly enforces internal and output consistency. The output-only control helps, but does not fully isolate each proposed architectural mechanism.
Questions for authors
- What are the wall-clock and hardware costs per target-resolution calibrator, including native-resolution reference passes and model selection?
- Can the authors quantify the additional value of trajectory supervision over the output-only control across more than ViM-T and VMamba-T?
Thank you to the authors for their response. I find the ablation studies on the capabilities of different model components and the comparison of parameter counts presented in the rebuttal very meaningful, as they provide further evidence of the effectiveness of the proposed method. Therefore, I will maintain my original positive assessment of this work.