- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes UVSM, an LVSM-style feed-forward transformer for novel view synthesis. A 12-layer backbone maps posed input views and target rays to a latent representation, which a weight-tied 2-layer refiner updates up to eight times. The reported results are strong, particularly on zero-shot benchmarks. The method also incorporates per-patch halting to reduce computation, although the provided implementation does not substantiate the claimed per-patch computational savings.
Critical strengths
-
The performance is good. They have strong zero-shot results, achieving ScanNet +3.29 dB, DL3DV-even +1.65 dB over the best baseline.
-
The broad benchmark study, architectural ablations, and supplied code are valuable.
Critical weaknesses
The computational savings from per-patch halting are not established. Fig. 1 and Sec. 7 state that only active tokens undergo further refinement, but the submitted implementation continues processing all tokens until every patch has halted. Thus, the mean exit depth reported in Fig. 5 and Table 7 does not measure executed computation. The authors should report end-to-end FLOPs and latency across halting thresholds, including a comparison with fixed-depth inference using the same checkpoint.
Questions for authors
I have one question, corresponding to the weakness above: Please clarify how halted patches are excluded from subsequent computation, reconcile this with the submitted implementation, and quantify the resulting FLOPs and latency savings.