- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper evaluates the compression of pathology foundation model embeddings, examining storage efficiency, reconstruction fidelity, decoding latency, and downstream task performance. Experiments on TCGA glioma data demonstrate that channel-wise INT4 compression achieves an 8.95× compression ratio while maintaining Multiple Instance Learning (MIL) performance comparable to FP32; residual-sign correction further enhances attention mechanism fidelity but incurs additional storage and decoding overhead. Furthermore, the paper establishes theoretical bounds regarding attention mechanisms and prediction stability under compression.
Critical strengths
- The paper provides a comprehensive evaluation of compression efficiency, retrieval fidelity, attention stability, and downstream performance.
- The experiments are rigorous, using patient-disjoint splits, multiple seeds, and bootstrap confidence intervals.
- The paper demonstrates substantial storage savings with minimal performance degradation and provides theoretical stability bounds.
Critical weaknesses
- The methodological novelty is limited, as the paper primarily evaluates existing quantization and rotation techniques.
- The experiments are limited to a single foundation model, dataset, and MIL architecture, raising concerns about generalizability.
- The paper is difficult to follow, particularly in the abstract, which presents numerous technical details and experimental results without clearly motivating the problem or highlighting the main contributions.
Questions for authors
What is the main methodological contribution of this work beyond evaluating existing quantization and compression techniques?