- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors propose a method for qualitative evaluation of dense visual representations. They suggest that the standard PCA-to-RGB visualization can be misleading. Their method, based on Laplacian principal component analysis, results in more spatial consistency without additional complexity by adding a spatial smoothness term to PCA. They compare their method against plain PCA on semantic segmentation and depth estimation tasks by measuring how much performance survives when the features are projected.
Critical strengths
These visualizations are commonly used, so the observation that PCA to RGB can result in clean linear components for noisy looking models and vise versa for DINO, is valuable.
Critical weaknesses
- I find the novelty of the method limited. The penalized form of the smoothness term is new; however, the idea of a PCA objective plus a spatial smoothness term has been introduced in methods like LPP.
- On the experimental side, the only baseline is PCA, and the authors mention that they pick on test data. PCA is a special case of the proposed method (), the gains with fixed are not consistent, and the absence of error bars also makes me suspicious.
Questions for authors
Can you add a couple more baselines?
2 comments
Thank you for the additional experiments and the new comparison table. They address part of my concern. My remaining concern is novelty. The clarifications improve the positioning, but the core objective (PCA with a graph-Laplacian smoothness term) remains close to LPP and Jiang et al. (2013). the negative regularization is the most novel aspect, but I'm not convinced it is sufficient on its own. Given the improved experiments, I therefore raise my score from 1 to 2.
Thank you for your valuable feedback. We also appreciate the encouraging scores on the sub-categories. We have improved the manuscript in terms of baseline comparisons and experimental rigor, and formulated the novelty of the method more clearly. We believe that incorporating your feedback has strengthened the paper quite a bit and would appreciate it if you could take the time to re-evaluate. Specifically:
We now establish the novelty more clearly in the text by incorporating a new table (Tab. 1), which more explicitly highlights differences to previous methods. We reference the table in the related works section. For example, while LPP also relies on the graph Laplacian to reduce dimensionality, it has no notion of spatial contiguity as we explore in this work. The table also states more clearly why the method proposed by Jiang et al. (2013), which is most similar to the one discussed here, is unsuitable for our application as it does not provide a parametric map from features to visualization. This is also discussed in the new 'Baselines' paragraph (4.2; see below.). We also now state the novelty more explicitly with respect to the negative regularization that is necessary to analyze the DINOv3 features; the corresponding paragraph now cleanly mentions that this discovery is not possible with previous methods.
We previously did not include the prior method by Bolya et at. (2025) because of the conceptual arguments against it provided in the text. However, for completeness, we now include it as an additional quantitative baseline. We incorporate a dedicated paragraph on baselines in section 4.2, explicitly describing this choice and why other candidates (such as Jiang et al. (2013)) are not suitable for comparison (i.e. the lack of a parametric map). We agree that this was not communicated clearly enough before. Comparisons to the prior method by Bolya et at. (2025) show that both outperform PCA, while Laplacian PCA demonstrates clear advantages over both baselines.
You are likely referring to Table 2, which also showed performance for the best value of α for each model. We agree that this was confusing and have removed that column. These results are now presented in Table 3, together with the new baseline method. All comparisons are now without tweaking any hyperparameters.
We used the rebuttal time to compute error bars for all relevant quantitative comparisons to baselines. These are now included in the tables, as well as the line plots. Since we only evaluate linear probes, error margins are quite small, and improvements over PCA, as well as the method proposed by Bolya et al., are consistent for the vast majority of comparisons. In case you have further concerns regarding this point, we would appreciate a brief update.
Thank you again for your helpful suggestions.