- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper finds that letting several of them share one memory can retain more information than shrinking each latent independently. It proposes the Superposed Latent Autoencoder, which binds wide latents with randomized keys, superposes them into a single tensor at the same average storage, and recovers each latent before decoding. At matched storage, this reduces reconstruction error by up to 56% and improves downstream classification by up to 16.79 percentage points.
Critical strengths
-
The paper is clearly written. The capacity–interference framing, the matched-storage setup, and the method are easy to follow, and the figures and notation line up with the claims.
-
The experiments are well designed. Comparisons use a matched storage budget across datasets and budgets, and the capacity–interference breakdown plus the depth and joint-compression controls make the source of the gains interpretable.
Critical weaknesses
-
The article lacks results based on large-scale datasets, such as ImageNet-1K/21K. The manifold distribution of large-scale datasets is highly complex, and this algorithm, which combines multiple sample latent variables, may fail on ImageNet-1K/21K.
-
Additionally, in Appendix M, the comparative experiments between the SLAE and quantization is also insufficient. INT4 PTQ quantization often requires more advanced techniques (e.g., smooth/OBQ). Instead of the naive post-training per-channel uniform quantization with scales calibrated on the training set.
-
Representation quality should be evaluated by using the latent itself as a frozen feature and training a fully connected classifier on top of it. On Table-9, this probe measures how much class-discriminative information survives lossy compression.
-
For the figures in the paper, please use vector graphics instead of screenshots.
Questions for authors
Please see weakness
Revised Manuscript Incorporating Rebuttal Results and Clarifications
Dear Reviewers and Area Chair,
As the discussion phase draws to a close, we have uploaded a revised PDF incorporating additional results and clarifications discussed during the rebuttal. Highlighting new large-scale and medical-image evaluations, comparisons with alternative autoencoder architectures, and expanded strong quantization method experiments, in addition to SLAE warm-up sensitivity and key-overhead analyses in the appendices. The main-text additions are highlighted in blue.
Thank you for your constructive feedback, which has helped us strengthen the paper.