- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes OCShell-Mamba, a hierarchical vision SSM built on the DAMamba block that replaces DAMamba's adaptive scan with an object-centric token order. In the routing module, SOCO, a lightweight conv head predicts an objectness map, and per-image Otsu thresholding and connected-component labelling turn it into object candidates. In the deep stages, each candidate's tokens are traversed shell by shell from an objectness-weighted centre outwards, candidates are concatenated by confidence, and the background follows in raster order; the shallow stages instead sort all tokens into confidence bins. The SSM runs on the permuted sequence and the output is permuted back. The second component, PoMe, which the paper calls Persistent Topology Memory, is a bank of 64 latent tokens of width 256 that is read and written once per stage by cross-attention and carries an auxiliary classification loss during ImageNet pre-training. The objectness head is regularised by an annotation-free border-background prior and a routing-coherence loss. Only a Tiny model with 27M parameters and 5.7 GFLOPs is reported. It reaches 83.9% top-1 on ImageNet-1K, against 83.8% reported for DAMamba-T and 83.6% for the authors' reproduction; 50.8 versus 50.3 mIoU on ADE20K with UperNet; and 49.1 box AP and 43.7 mask AP versus 48.5 and 43.4 on COCO with Mask R-CNN 1×. All component and hyperparameter ablations are run on a custom 100-class mini-ImageNet split.
Critical strengths
The core idea is clear and intuitive: making each object candidate a contiguous, centre-out segment of the recurrence is a natural content-dependent alternative to geometric and deformable scans, and the construction (Otsu threshold, connected components, centre and radius, shell binning, inverse permutation) is fully specified, with pseudocode in Alg. D.1, so it is reproducible and could be grafted onto other SSM backbones. The comparison is also made against a strong and closely matched baseline, using DAMamba's own recipe and evaluation protocols on classification, segmentation and detection, and the improvement over DAMamba has the same sign on all three tasks.
Critical weaknesses
1. The state-of-the-art claim is not supported, and there is no evidence of a better accuracy–efficiency trade-off. On ImageNet the model improves over its direct baseline DAMamba-T by only 0.1 points, from 83.8% to 83.9%, at 19% more FLOPs, and the dense-prediction gains of 0.5 mIoU, 0.6 box AP and 0.3 mask AP also come at higher cost. Several recent backbones of the same size reach equal or higher accuracy at equal or lower cost and are absent from Table 1: Mamba2D-T [1] reaches 84.0% with 26.5M parameters and 4.7 GFLOPs, A2Mamba-S [2] 84.7% with 31M and 5.4G, OverLoCK-T [3] 84.2% with 33M and 5.5G, and TransNeXt-Tiny [4] 84.0% with 28M and 5.7G. Some included rows are also wrong or not comparable: the VSSD row combines the accuracy of VSSD-Micro with the FLOPs of VSSD-Tiny, and ZigMa and MaIR are, to my knowledge, a diffusion model and an image-restoration model that do not report ImageNet-1K top-1. The method adds per-image Otsu thresholding, connected-component labelling, sorting, gather–scatter permutations and memory cross-attention at every stage, which are irregular and hard to fuse on GPUs, yet only parameters and FLOPs are reported.
2. The evidence does not show that the object-centric routing is responsible for the gain. Only one model size is reported, and all ablations are run on a custom 100-class mini-ImageNet split, where the full model gains 1.43 points over a retrained DAMamba-T, from 87.48% to 88.91%, whereas on full ImageNet-1K the gain shrinks to 0.1 points over the reported and 0.3 points over the reproduced baseline. The controls are missing that the same backbone with the same losses and PoMe but with SOCO replaced by raster scan or by DAMamba's adaptive scan, and the model with the auxiliary losses switched off, even though is an auxiliary classifier that could explain part of the gain by deep supervision alone. In addition, the description of the routing conflicts with the appendix. Sec. 3.1 and Fig. 3 state that the objectness head is learned from task gradients, but routing uses a stop-gradient copy of the map, and according to App. B the head is trained only by the border-background prior and the coherence loss, so the resulting map is a background-prior saliency map rather than an object structure learned from the task.
[1] E. Baty, A. Hernández Díaz, R. Davidson, C. Bridges, S. Hadfield. Mamba2D: A Natively Multi-Dimensional State-Space Model for Vision Tasks. arXiv:2412.16146, 2024.
[2] M. Lou, Y. Fu, Y. Yu. A2Mamba: Attention-augmented State Space Models for Visual Recognition. arXiv:2507.16624, 2025.
[3] M. Lou, Y. Yu. OverLoCK: An Overview-first-Look-Closely-next ConvNet with Context-Mixing Dynamic Kernels. CVPR, 2025.
[4] D. Shi. TransNeXt: Robust Foveal Visual Perception for Vision Transformers. CVPR, 2024.
Questions for authors
(1) Please give the source of every row in Table 1, correct the VSSD row, remove or justify the ZigMa and MaIR rows, and add recent same-scale backbones such as Mamba2D-T, A2Mamba-S, OverLoCK-T and TransNeXt-Tiny.
(2) What are the throughput and peak memory of OCShell-Mamba, DAMamba-T and the strongest Table 1 baselines on the same GPU, at 224² for classification and at 1280×800 for detection, and what fraction of runtime goes to the routing and memory operations?
(3) On full ImageNet-1K, what accuracy does the same architecture with the same losses reach when SOCO is replaced by raster scan and by DAMamba's adaptive scan, and when , and are set to zero?
(4) Please confirm how the objectness head is trained, whether DAMamba's adaptive scan is kept, and give the stage depths and widths with a per-component breakdown of parameters and FLOPs that explains the extra 0.9 GFLOPs over DAMamba-T.