- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper explores structured 2D atlases for 3D representation learning. It uses geodesic optimal transport to organize sampled surface positions and normals into a 2D representation, and evaluates reconstruction using an image-space Shape VAE.
Critical strengths
I find this an interesting and worthwhile exploration of a representation direction. Although the results are not uniformly state of the art, I learned something useful from the approach. The relatively small 33.1M-parameter reconstruction network and its reconstruction results are encouraging. Overall, I lean toward acceptance because of the value of this exploration.
Critical weaknesses
The final reconstructions still appear to lose substantial fine geometric detail. My main concern is whether the high-frequency variation in the atlas, particularly discontinuities in XYZ coordinates, can be faithfully preserved through VAE compression and decoding. Smoothing across such discontinuities could introduce incorrect intermediate positions rather than merely a small visual loss of sharpness. This is a possible explanation for the observed detail loss, not an established cause.
The overall reconstruction results do not isolate how accurately these discontinuities survive compression. More targeted evidence would help clarify the limitations of the representation and its reconstruction model. Its implications for generative modeling are also uncertain: successful reconstruction alone does not establish that the resulting representation is easy for a diffusion model to learn.
Questions for authors
-
How accurately are XYZ discontinuities preserved after VAE encoding and decoding? Could the authors provide localized input-versus-reconstruction comparisons or errors around discontinuities, together with the corresponding 3D geometry?
-
What is the contribution of the continuity masking and boundary/seam losses to preserving these structures? Can the authors distinguish detail lost during VAE reconstruction from the effects of subsequent surface reconstruction or refinement?
-
Do the authors have evidence or analysis of how the high-frequency atlas structure affects generative modeling? In particular, can the VAE preserve the relevant detail while producing latents that are tractable for a diffusion model? I recognize that the current experiments focus on reconstruction and regard this as a question about the approach's future generative potential.