- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper observes that fast weights in Test-Time Training (TTT) layers can be reused across timestamps in fixed-camera multi-view videos. To exploit this insight, the paper introduces StreamLRM, a training-free strategy that updates memory once and reuses it for subsequent frames. Compared with frame-wise inference using the static TTT-based baselines, StreamLRM achieves faster reconstruction and improved temporal consistency, with slightly lower rendering quality.
Critical strengths
- The observation of temporal redundancy in fast-weight adaptation is interesting and leads to a simple, effective method.
- The training-free strategy can be easily plugged into pretrained static TTT-based Large Reconstruction Models.
While I acknowledge these strengths, my initial score is primarily driven by the concerns below, particularly the unclear StreamLRM's positioning among existing dynamic scene reconstruction methods. I am willing to raise my score if the authors address my concerns during the rebuttal period.
Critical weaknesses
- The paper lacks sufficient analysis of the conditions under which the proposed reuse strategy succeeds or fails (see Q1 for more detail).
- While comparing with frame-wise 3D reconstruction baselines appropriately validates the reuse strategy, current experiments do not sufficiently establish StreamLRM’s position among existing dynamic scene reconstruction methods (see Q2 for more detail).
Questions for authors
- Could the authors further analyze when the reuse strategy becomes less effective?
- Evaluating rendering quality and cosine similarity separately for static and dynamic regions could help identify where performance degradation occurs.
- Under substantial appearance changes, such as fire-induced background color changes in the
Flamesscene of the Google Immersive dataset [1], would this lead to greater rendering quality degradation? - Would it become less effective with moving cameras, where less scene context may be reusable than in the fixed-camera setting?
- Would it maintain stable reconstruction quality beyond 300 frames, such as for the
dancescene used in Figure 7 (totaling 8,200 frames) or thebikescene (37,377 frames) of the SelfCap dataset?- Please provide the PSNR slope such as IGS's Figure 3 [2].
- Could the authors compare with existing dynamic scene reconstruction methods in terms of reconstruction speed, rendering quality, temporal consistency, and VRAM usage?
- For example, valuable comparisons with 1) an online per-frame optimization method [3] that also aims to improve temporal consistency, and 2) NoPo4D discussed in the paper, would be valuable.
- These experiments would clarify StreamLRM’s competitive standing among existing methods.
(Please carefully distinguish \citep and \citet in the paper.)
[1] Broxton et al. "Immersive light field video with a layered mesh representation." TOG 2020.
[2] Yan et al. "Instant Gaussian stream: Fast and generalizable streaming of dynamic scene reconstruction via Gaussian splatting." CVPR 2025.
[3] Yun et al. "Compensating spatiotemporally inconsistent observations for online dynamic 3D Gaussian splatting." SIGGRAPH 2025.