- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CASSM for UHD low-light image enhancement. The main idea is to replace the usual spatial scanning of visual state-space models with a content-aware sequence. A codebook is learned from low-frequency components of clean images. Restoration features are then assigned to codebook entries, tokens with the same assignment are grouped together, and the groups are ordered using a 1D t-SNE embedding before being processed by an SSM. The model is built on the C²SSM encoder-decoder architecture. The paper reports strong results on UHD low-light benchmarks and also evaluates generalization to standard-resolution low-light datasets. Ablations are provided for the proposed components and sequence construction.
Critical strengths
The main strength is the empirical performance. CASSM performs well on the reported UHD low-light benchmarks and also shows reasonable cross-dataset generalization. The idea of keeping all tokens while changing their serialization is also simple and potentially useful. I also appreciate that the paper includes C²SSM as a strong and closely related baseline and uses its architecture as the backbone. This makes the empirical comparison more meaningful than comparisons across unrelated architectures.
Critical weaknesses
My main concern is the motivation of the method. The paper argues that spatial scanning is suboptimal because visually similar tokens can be far apart in the sequence. I can understand this as a general argument about visual SSMs, but I do not see why it is specifically important for low-light enhancement. What property of low-light degradation makes codebook-based content grouping the appropriate solution?
In particular, low-light restoration depends strongly on local structures, illumination transitions, edges, noise, and spatially varying degradation. CASSM deliberately brings spatially distant tokens together based on feature similarity. This may improve content-level interaction, but it also breaks spatial continuity. The paper does not really study this trade-off. Why should content similarity be more important than spatial locality for this task, and under what conditions does this hold?
I have a related concern about the codebook. It is learned from the low-frequency components of clean images and is then used to define which restoration tokens should be close in the Mamba sequence. Why does similarity to this clean-image codebook correspond to the dependencies that are useful for correcting low-light degradation? At present this connection seems assumed rather than demonstrated. A comparison with codebooks learned from the task data in different ways, or an analysis of what the resulting groups actually represent, would help.
The novelty relative to C²SSM also needs to be stated more carefully. C²SSM already argues that pixel-wise spatial scanning is not ideal for UHD restoration and that content/cluster structure should be used for SSM modeling. CASSM is technically different: it keeps all tokens rather than compressing them into centroids and further introduces group ordering. I think this is a valid distinction, but it makes CASSM look more like a fine-grained extension of cluster-centric SSM than a new content-aware SSM paradigm. Could the authors clarify what new conclusion CASSM establishes beyond the main observation already made by C²SSM?
This also leads to an experimental issue. The comparison with C²SSM changes centroid compression, token grouping, the codebook, feature adaptation, and group ordering at the same time. A controlled experiment such as spatial all-token SSM → centroid-level SSM → grouped all-token SSM → grouped all-token SSM with the proposed ordering would be much more informative.
I am particularly unconvinced by the use of 1D t-SNE to order the groups. Why should a one-dimensional t-SNE embedding define a good state propagation order for Mamba? The current comparison does not rule out much simpler alternatives. I would like to see comparisons with, for example, PCA-based ordering, nearest-neighbour traversal in the codebook space, or a learned ordering. More directly, the authors could measure whether the proposed serialization actually reduces the sequence distance between semantically related tokens and whether this reduction correlates with restoration quality.
The current ablation is also somewhat revealing: content grouping alone gives only a small gain, while group ordering contributes more. This makes the ordering mechanism quite central to the claimed contribution, but it is currently one of the least justified parts of the method. I think this deserves substantially more analysis.
Besides, the codebook is pretrained using clean images from several UHD restoration datasets rather than only the training set of the target low-light benchmark. This is not data leakage, but it gives CASSM an additional clean-image prior that the compared methods may not have. How much of the reported generalization, especially the cross-dataset gain, remains if the codebook is learned only from the corresponding training dataset?
Questions for authors
See weaknesses