- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents LifeStreamGS, to support streaming 3D recosntruction with compact gaussian splating from unposed inputs. LifeStreamGS is based on a causal feed-forward framework. It combines merge-guided candidate sampling, gating and opacity weighting to reduce the gaussian numbers and uses overlapping chunks to support long sequences reconstruction.
Critical strengths
- The pipeline looks reasonable in general.
- The experiment results, especillay for the 500 frames inputs looks impressive. 3.The supp include the code and video, making it more convicing.
Critical weaknesses
- The novelty of the proposed lifecycle components should be clarified. Frame-wise streaming is largely enabled by the inherited causal-attention backbone. Gaussian reduction relies on learned patch-local sampling, with up to 32 candidates per patch, followed by existence gating. The choice of 32 requires further justification and sensitivity analysis. More importantly, it remains unclear whether this mechanism removes cross-frame redundancy or primarily sparsifies individual frames. For example, does it suppress candidates on surfaces already represented by earlier observations? The dense-prediction-and-selection design should also be distinguished from EcoSplat, which already supports budget-controlled Gaussian selection.
- The contribution to long-sequence scalability requires stronger validation. Long-video reconstruction relies on overlapping chunks, which closely resemble existing chunk-based reconstruction strategies. A chunked AnySplat baseline using VGGT-Long-style alignment would also help assess whether its OOM failures can be mitigated through chunking, while acknowledging the distinction between chunk-level processing and frame-wise causal inference.
- The related work discussion is incomplete. Relevant methods, including YoNoSplat (ICLR 2026), Multi-view Pyramid Transformer (CVPR 2026), and C3G (CVPR 2026), should be discussed in relation to the proposed approach.
- High resolution scalability remains unverified. The experiments use inputs resized to a width of 518 pixels. Since image-token processing and dense attribute prediction remain necessary, reducing the final Gaussian count alone does not establish efficient high-resolution reconstruction. Please report reconstruction quality, processing speed, and peak GPU memory at higher input resolutions.
- Minor: qualitative comparisons should show errors more clearly. The renderings in Figure 1 are too small to assess detailed differences from ground truth. Enlarged crops and error maps with a shared color scale would improve the comparison. Blur and floaters remain visible in the supplementary videos; representative examples should be shown and discussed.
Questions for authors
Please see the weakness.
8 comments
Official Comment by Authors (2/2)
Q3: Additional related work. Thank you for the suggestion. YoNoSplat predicts per-view local Gaussians and camera poses from an arbitrary number of jointly available images and aggregates them into a global representation, whereas LifeStreamGS restricts information to past frames and manages Gaussian admission and rendering contributions online. Multi-view Pyramid Transformer uses local-to-global inter-view and fine-to-coarse intra-view hierarchies to jointly reconstruct tens to hundreds of views in a single forward pass; it targets efficient global multi-view interaction rather than causal streaming accumulation. C3G uses learnable tokens to aggregate sparse multi-view features and decode an explicitly compact representation with about 2K Gaussians, while LifeStreamGS uses per-frame causal proposal and validation together with query-dependent opacity aging for a growing video stream. We will add these distinctions to the revised paper.
Q4: Scope of high-resolution reconstruction. Thank you for the observation. Our goal is not to solve high-resolution streaming feed-forward reconstruction. To our knowledge, this setting remains largely underexplored; existing feed-forward studies, both offline and online, primarily focus on reconstruction quality at moderate input resolutions. LifeStreamGS addresses a different and complementary bottleneck: as a video stream grows, dense and fixed Gaussian predictions from successive frames accumulate redundancy and errors, increasing representation size and interfering with rendering. Increasing the input resolution alone does not resolve this temporal accumulation. Without controlling the Gaussian lifecycle, a higher resolution would instead produce more candidates per frame and further amplify computation, memory use, and representation redundancy. High-resolution streaming reconstruction is an important future direction, and we will explore combining lifecycle management with tiled or hierarchical token processing and multi-scale attribute prediction.
Q5: Clearer qualitative comparisons and temporal artifacts. Thank you for the suggestion. In the revision, we will redesign Figure 1, enlarge the local crops in the qualitative comparison, and add pixel-level error maps with the same color scale.
Thank you for the observation about the supplementary video. We acknowledge local temporal jumps, including blur and floaters, in the video. These issues are not caused by camera pose estimation. Aging changes the rendering weights of different Gaussians based on the current query view and temporal relation. When neighboring frames or chunks have remaining geometry and pose differences, the dominant Gaussians can switch as the query changes. This can cause local discontinuities in edges or appearance, which appear as visual jumps. Similar temporal jumps in ARTDECO can be observed at 0:24-0:27, 0:29-0:32, and 1:05-1:08 in the supplementary video. This may occur because ARTDECO optimizes all Gaussians at each frame, which can change the dominant Gaussians used for rendering. Without aging, inconsistent Gaussians may be blended and temporal jumps may appear weaker. However, this usually produces more blur and ghosting. This shows the current trade-off between per-frame sharpness and temporal consistency. The source of this issue is cross-frame inconsistency caused by remaining geometry errors in causal reconstruction. It is a common issue in current streaming reconstruction methods. We will study explicit temporal consistency constraints in future work.
Thank You for Your Review and Consideration of Our Revision
Thank you again for your thoughtful review and constructive comments. We have uploaded a revised version of the manuscript that incorporates the additional clarifications and experiments discussed in our rebuttal and follow-up responses. For ease of review, all revisions are highlighted in blue. We would be very grateful if you could take a moment to review these updates and, if appropriate, reconsider your evaluation. Thank you very much for your time and effort.
Official Comment by Authors (1/2)
Q1: Candidate-count sensitivity and difference from EcoSplat. Thank you for pointing this out. Table 1 below reports our sensitivity study with P=16/32/64. P=32 gives the best overall quality on DL3DV and RE10K. A smaller capacity limits candidate coverage, while increasing it to 64 gives no further gain. Therefore, 32 is a stable empirical choice under the current protocol, rather than a theoretical constant.
Table 1. Sensitivity to the maximum candidate count P per patch. Bold values indicate the best results, and values marked with † indicate the second-best results.
The current learned patch-local sampling does not explicitly match the current candidates with the global Gaussian bank. Its direct role is mainly to sparsify the current frame and control the causal admission of new Gaussians. It does not guarantee the removal of all cross-frame duplication. A surface represented by a previous frame does not mean that a Gaussian from a later observation is always redundant. An existing Gaussian may only be accurate near its source view. At a distant view, it may be affected by occlusion, pose error, or geometry inconsistency. A later observation may therefore provide a complementary representation. Future observations are not available at admission time, so it is also difficult to fully judge the long-term value of a Gaussian. LifeStreamGS therefore uses aging to adjust the contribution of accepted Gaussians for different queries. This reduces rendering interference caused by cross-frame accumulation.
EcoSplat uses a user-specified global Gaussian count. In offline multi-view prediction, it ranks candidates by importance and adjusts their parameters to provide a controllable quality-budget trade-off. In contrast, LifeStreamGS performs streaming reconstruction and cannot make a global budget allocation. In LifeStreamGS, P is only the maximum candidate capacity of each patch. It is not the final scene budget. The existence gate decides whether a current candidate enters the causal stream, but it does not guarantee an exact global count. Aging continues to manage the later contribution of accepted Gaussians. EcoSplat asks which candidates to keep under a given global budget. We instead ask how streaming Gaussians should be admitted and how they should contribute to later rendering.
Q2: Matched-chunk comparison with an offline baseline. Thank you for the suggestion. Existing results show that WorldMirror consistently outperforms AnySplat. We therefore adapt WorldMirror as the stronger representative offline baseline for the matched-chunk comparison. Table 2 below compares WorldMirror with LifeStreamGS using the same chunk size, overlap, and VGGT-Long-style alignment. WorldMirror gives higher quality on the evaluated metrics. It can be viewed as a non-causal reference upper bound when full information can be jointly accessed. LifeStreamGS is also faster across the four evaluated settings. However, WorldMirror must wait for and jointly process a complete chunk. Its current predictions can use future frames within that chunk. It therefore does not meet the requirement of frame-wise causal streaming inference. In contrast, LifeStreamGS keeps causal information dependence within each chunk.
Table 2. Quality and efficiency comparison with WorldMirror under matched chunking. Bold values indicate the best results, and values marked with † indicate the second-best results.