- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
THe paper introduces DensiTok, a plug-in latent completion module for pretrained unposed feed-forward 3DGS backbones that mitigates sparse-view degradation by synthesizing intermediate multi-level geometry tokens for unobserved viewpoints directly from sparse input views. DensiTok first uses a LAM-VAE to compress high-dimensional multi-level tokens into a compact latent space, and then trains a camera-conditioned DiT to complete missing view latents along an interpolated camera trajectory before decoding them back into full-view token sets for the reconstruction heads. Evaluated across three pretrained backbones, DensiTok consistently improves rendering, depth, and pose accuracy.
Critical strengths
[S1] Plug-in compatibility across different backbones: DensiTok consistently improves appearance, depth, and camera pose across AnySplat, WorldMirror, and DA3, while running faster than 16-view dense inference.
[S2] Compact multi-level token compression and one-step latent completion enable faster generative 3DGS: Rather than synthesizing novel RGB views and re-encoding them, or running cascaded multi-step diffusion on large feature channels as in GLD, DensiTok compresses backbone feature levels into a four-channel latent per token and completes missing views. As a result, DensiTok can produce improved quality with fast inference speed.
Critical weaknesses
[W1] Unexplained gap over the 16-view teacher: Sparse-view DensiTok substantially outperforms the 16-view teacher backbone. Because stage 2 and 3 supervise against ground-truth target images rather than teacher renderings, token completion is entangled with in-domain supervised adaptation on Re10K and DL3DV.
[W2] Ambiguity of the warped color prior and appearance adaptation: While the main paper frames DensiTok as a pure token-space module with frozen heads, AnySplat require per-view RGB inputs which DensiTok supplies for unobserved views using a depth-warped color prior, a learned hole embedding, and finetuning. It is unclear in the main text that which backbones use this color prior and finetuning, whether “Fully Frozen” in Table 12 still relies on depth-warped color prior or uses no RGB warping at all.
[W3] Observed-view latent mismatch ( vs. ): Both the geometry encoder and LAM-VAE use global cross-view attention, so the observed latents (encoded from n views) differs from (encoded from N views) and carry degraded cross-view features.
[W4] Trajectory interpolation: Fitting a cubic spline through predicted sparse-view poses assumes ordered inputs along a smooth 1D path (this is not general unordered collections) and is vulnerable to noisy initial pose estimates such as n=2.
Questions for authors
[Q1] Why does sparse DensiTok exceed the 16-view teacher? What is the performance of DensiTok at , or when stage 2 and 3 are supervised purely by teacher outputs rather than GT images?
[Q2] In Table 12, does “Fully frozen” still pass the warped color prior for unobserved views, or does it omit the warped color prior entirely? Also, do WorldMirror and DA3 use Appendix A.2?
[Q3] How much does performance improve if conditioned on oracle (scale-aligned GT) cameras at inference?
Thank you for the clarification and the new experiments. All my concerns are resolved, I will maintain my positive score.