- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Stream3D, a training-free method that lets frozen single-view 3D generators such as SAM 3D and TRELLIS.2 take long monocular video streams as input. For each chunk, every new frame is probed with one denoising step. The generator's cross-attention maps are then used to compute a per-voxel-token evidence score, and each token keeps its top-D frames. Tokens vote for the top-K frames, which are used for multi-view generation, where per-view velocities are fused with token-wise evidence weights. The cache of frame indices has a fixed size, independent of stream length. Experiments on GSO and NAVI show improvements over single-view generators, multi-view fusion baselines, and other view-selection strategies.
Critical strengths
1.Using the generator's own cross-attention to decide which frame is useful for which part of the object is a simple and neat idea, and it requires no training.
2.The method is plug-and-play on top of existing 3D generators and gives clear improvements over single-view SAM 3D.
3.The ablations are fairly clean. Separating view selection from fusion, and comparing against visibility- and VLM-based selection, shows that both parts contribute.
Critical weaknesses
-
The "streaming" framing is oversold. Each chunk regenerates the object from scratch with the selected frames, and the only thing carried over is a table of frame indices, while the frames themselves are still stored. In practice, this is attention-based view selection plus weighted multi-view fusion, repeated every chunk.
-
Trained multi-view generators are missing from the comparison. Most baselines are training-free fusion methods, and EscherNet is quite outdated. The authors should compare with methods that are trained to take multiple views natively, such as ReconViaGen and Hunyuan3D-2mv. ReconViaGen already shows that trained multi-view conditioning is much better than TRELLIS multidiffusion.
-
Generality and the long-stream benefit are not convincing. On TRELLIS.2, the gain over plain multidiffusion is small (CD 0.093 → 0.087), so most of the improvement seems specific to SAM3D. Geometry also stops improving after about 40 frames, so the long-stream setting is not really tested.
Questions for authors
1.Please compare against ReconViaGen and Hunyuan3D-2mv under the same frame budget. For Hunyuan3D-2mv, frames closest to its required viewpoints could be selected from the stream.
2.Why does Stream3D(TRELLIS.2) underperform TRELLIS+M.D. on GSO? Does the evidence score need to be retuned for each backbone?
3.What does the streaming formulation add beyond selecting the best K frames from the whole video at once? A comparison with offline selection over the full stream would help clarify this.