- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a hybrid CNN–Mamba–Transformer architecture for various vision tasks. Its main contribution is an alpha-blending mechanism that adapts bidirectional Mamba to image inputs. It also introduces RepConvSE, an engineering refinement of the CNN block designed to facilitate deployment.
Critical strengths
- The paper provides extensive experimental evaluations across a wide range of downstream scenarios.
- The proposed modifications are lightweight, and the method consistently outperforms all compared baselines across the evaluated downstream tasks.
Critical weaknesses
-
The motivation of this paper is unclear. As I understand, this paper appears primarily focused on combining CNN, Mamba, and Transformer components, without clearly identifying the problem that motivates this design.
-
The hybrid architectural novelty is limited. Existing methods, including MambaVision, which is included in the comparisons, have already explored hybrid architectures incorporating Mamba.
-
RepConvSE is a deployment optimization based on existing techniques. There is not enough evidence which can prove its efficiency and novelty. The experiments also lack comparisons with similar optimization approaches, such as RepMBConv.
-
In Section 4.1, this paper states that "all compared methods were trained for 300 epochs". I am wondering which methods does “all compared methods” refer to? Some reported results exactly match those in the original or other published papers, although their original experimental configurations differ from the setup stated in this paper. This raises concerns about the consistency of the reported experimental settings and the validity of the comparisons.
-
Table 4 could not support the efficiency of the two main contributions, alpha blending and RepConvSE. Adding them can provide only marginal improvements. Even without either component, the model achieves 83.2% accuracy, ranking second only to MambaVision-S (-0.1%) in Table 1. More concerningly, the architecture of MambaVision is highly similar to the proposed model.
Questions for authors
- Please address the concern raised in Weakness 3
- Please provide additional ablation comparisons for RepConvSE to substantiate its novelty and effectiveness. Please compare it with existing optimization methods, such as RepMBConv, and clarify why existing approaches are insufficient.
- Please provide ablation results across different downstream tasks, as the current results (Table 4) do not clearly demonstrate the benefits of the proposed components.