- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SN-AbsTopK, a sparse autoencoder for medical foundation-model representations. Its main contribution is a group-level support selection, where spatially related tokens share a candidate dictionary before individual AbsTopK selection, together with normative centring using an EMA reference.
Critical strengths
Addresses spatial fragmentation in conventional SAE representations with a simple group-support mechanism. Ablations indicate that group selection substantially improves spatial consistency.
Critical weaknesses
1 The overall figure has poor layout/resolution and is difficult to follow; figure sizes are also inconsistent.
2 Experimental discussions do not always clearly reference the corresponding tables, making results difficult to trace.
3 Improved Moran’s I and Jaccard is partly expected because spatial coherence is explicitly imposed by group support. Stronger evidence of medical interpretability is needed. How this benifit the downstream task and reconstruction?
4 The motivation and benefit of normative residual centring remain unclear.
5 The substantial reduction in alive feature raises concerns about dictionary utilisation and capacity. How it affects representation diversity, reconstruction, and interpretability?
6 Results are reported over only two seeds, raising questions about statistical robustness.
Questions for authors
1 Can the authors better demonstrate that increased spatial coherence corresponds to meaningful anatomical/pathological concepts?
2 What is the impact of the substantial reduction in alive atoms on representation capacity, reconstruction and interpretability?
3 Does “two seeds” mean only two independent training runs for the reported mean and standard deviation?
4 Clearer table references and a better organised, higher-resolution overall framework figure would make the relationships among the different components easier to follow..
5 Please provide clearer visualisations comparing grouped and non-grouped representations across contiguous histology regions and MRI slices. This would better demonstrate the actual effect of group-level support selection.