- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper studies compression of frozen ViT features using VAEs whose bottleneck is a product of low-dimensional Power Spherical distributions. Reconstructed features are passed to frozen downstream heads. The main quantitative results show stronger performance than standard Gaussian. Additional experiments study compression dimensions, alternative bottlenecks, lightweight depth probes, and qualitative generation using a DiT trained on the learned latents.
Critical strengths
- The paper is easy to follow
- The author shows that spherical representation outperforms standard Gaussians on downstream 3D tasks. There are a ablation studies on dimensionality of VAE.
Critical weaknesses
Unclear goal. The author has an unclear goal for this paper. Specifically, if the goal is to have a better VAE for 3D generation, then there should be quantitative and qualitative results on 3D generation with various baselines, for example, Gen3R: 3D Scene Generation Meets Feed-Forward Reconstruction. If the author with to improve downstream 3D tasks such as depth prediction, camera pose estimation, and 3D reconstruction, then there should also be proper baselines. I do not know which problem the author is trying to solve.
Improper experimental evaluations. Comparing with a standard Gaussian under 3D tasks does not show a contribution to the community. The generation results are simply two images. The quantitative evaluation results are very limited. Only two tables, each with two rows. There are also limited visual examples. The author only shows one thing: if we add a VAE between the encoder and decoder of VGGT, we want the VAE to have a spherical distribution to minimize error. But "so what" is not discussed.
Questions for authors
Please clarify the research problem and goals with complete experiments and resubmit to another venue. I have no reason to change my rating to 3 or 4 based on any rebuttal, rather than rewriting the paper. If my concerns are resolved, the paper will be largely rewritten, and this should not be a case under ICLR policy.