- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes FormFlow-GS, an online multimodal 3D Gaussian Splatting (3DGS) framework designed to address geometric initialization errors and downstream optimization latency. The method introduces two main components: (1) GeoBirth, which utilizes local metric geometry from LiDAR or depth along with neighborhood reliability to initialize surface-aligned anisotropic 3D Gaussians; and (2) Coalesced Gaussian Optimization (CGO), a CUDA kernel fusion strategy that consolidates heterogeneous attribute updates (position, rotation, scale, opacity, and spherical harmonics) into a unified kernel pass across a shared visible-Gaussian workset. The framework is evaluated across monocular, RGB-D, and LiDAR-inertial SLAM/mapping backbones (including Gaussian-LIC2, GS-LIVM, PVG, SGAD-SLAM, VarSplat, and MonoGS) on several multimodal benchmarks.
Critical strengths
S1: Relevant system-level optimization focus for real-time Gaussian mapping. Modern online 3DGS systems frequently suffer from GPU thread divergence and excessive kernel launch scheduling overhead when updating decoupled Gaussian parameters sequentially across separate CUDA kernels. Restructuring the multi-attribute gradient accumulation into a coalesced execution path over active visible Gaussians targets a practical engineering bottleneck relevant to compute-constrained edge robotics and embedded mapping devices.
S2: Broad cross-backbone evaluation scope across sensor configurations. The authors make a noticeable effort to interface their approach with diverse sensor suites and baseline architectures, spanning monocular (MonoGS), RGB-D (SGAD-SLAM, VarSplat), and LiDAR-visual-inertial setups (Gaussian-LIC2, GS-LIVM, PVG), attempting to substantiate cross-modal transferability rather than restricting evaluation to a single sensor setup.
Critical weaknesses
W1: Misleading efficiency claims and neglect of Amdahl's Law in end-to-end mapping. Throughout the introduction and abstract, the paper heavily emphasizes major speedups and reduced optimization overhead, foregrounding micro-benchmark metrics such as kernel launches dropping from 63 to 1 (or 40 to 1) and isolated optimizer GPU execution time decreasing by 70% to 92%. However, an examination of the actual system-level wall-clock mapping time in Table 1 reveals that these micro-optimizations yield negligible end-to-end benefits across nearly all evaluated pipelines: VarSplat on TUM decreases by only 0.62% (from 206.72s to 205.44s), SGAD-SLAM on TUM decreases by only 1.99% (from 11.53s to 11.30s), and GS-LIVM decreases by only 2.30% (from 12.61s to 12.32s). In online SLAM and dense visual mapping, optimizer kernel scheduling occupies only a minor slice of the overall compute budget compared to pose tracking, spatial point cloud projection, voxel downsampling, visibility sorting, and differential rasterization. Highlighting isolated kernel fusion gains as a breakthrough in online mapping efficiency while total system runtime remains virtually unchanged constitutes an ungrounded claim.
W2: Statistically insignificant PSNR improvements accompanied by systematic degradation in perceptual quality (LPIPS metric inversion). Across standard benchmarks in Table 1, the observed rendering gains in PSNR are minimal—often within the margins of stochastic variance (+0.103 dB on VarSplat, +0.105 dB on SGAD-SLAM, and +0.154 dB on PVG). More critically, the perceptual metric LPIPS exhibits consistent negative optimization. In Table 1 on Gaussian-LIC2, applying FormFlow-GS degrades LPIPS from 0.2390 to 0.2501 (+0.0111 increase, where lower indicates better perceptual fidelity). This contradiction is reinforced by the 2x2 controlled decomposition in Table 2: the unmodified baseline E00 achieves the best LPIPS score of 0.2390, whereas adding GeoBirth (E10) degrades it to 0.2550, and the complete pipeline (E11) remains degraded at 0.2501. The text repeatedly claims enhanced boundary sharpness and finer visual textures, yet fails to report, acknowledge, or reconcile why the primary perceptual quality metric consistently deteriorates across configurations.
W3: Benchmarking against catastrophic baseline failures without technical justification. In Table 1, the reported baseline numbers for GS-LIVM (PSNR 6.175 dB, SSIM 0.3735) and MonoGS (PSNR 7.980 dB, SSIM 0.0517) represent completely collapsed, non-converged map states rather than functional, operational baselines (where typical novel-view rendering on these benchmarks exceeds 18 to 25 dB). Presenting an incremental gain on top of a failed system (such as moving from 7.980 dB to 9.610 dB, which remains an unusable reconstruction) does not validate the proposed method's capability. The authors provide no error analysis explaining why these baselines experienced catastrophic tracking or mapping loss, leaving it ambiguous whether the baselines were misconfigured or if divergent trajectories were retained simply to display numerical deltas.
W4: Conceptual fragmentation and absence of mathematical synergy. The paper attempts to frame GeoBirth and CGO as a mutually reinforcing, full-lifecycle mapping methodology where formation conditions refinement. In reality, GeoBirth is an intuitive geometry-based initialization that aligns Gaussian ellipsoids with local surface normals and covariance (a well-established strategy in methods like PGSR, 2DGS, and GeoGS), while CGO is an orthogonal, low-level CUDA operator fusion. There is no mathematical bridge or algorithmic dependency connecting the two components: CGO does not utilize geometric priors established by GeoBirth, nor does GeoBirth structure the coalesced memory layout of CGO. Packaging two disparate engineering steps under an abstract "formation-refinement" narrative artificially inflates the conceptual depth of the work.
W5: Unexplained optimization dynamics and numerical inconsistency in ablation studies. In the 2x2 ablation in Table 2, CGO is introduced as an execution-level kernel fusion that aggregates heterogeneous attribute updates. If CGO performs mathematically equivalent gradient updates across attributes, transitioning from E00 (Native+Native, 20.692 dB) to E01 (Native+CGO) should yield identical reconstruction fidelity. However, E01 drops to 20.675 dB, while combining CGO with GeoBirth in E11 produces an unexplained non-linear leap to 21.041 dB (+0.194 dB over E10). The paper contains no mathematical convergence analysis, discussion of floating-point reduction order, atomic write race conditions, or gradient clipping differences to explain why an operator fusion alters optimization trajectories, raising doubts about experimental reproducibility.
Questions for authors
Q1: How do the authors reconcile the paper's claims of sharper visual fidelity with the consistent degradation of LPIPS across Table 1 (Gaussian-LIC2) and Table 2 (where baseline E00 achieves 0.2390 while E11 worsens to 0.2501)? What visual artifacts or spatial smoothing are introduced by GeoBirth or CGO that cause perceptual fidelity to decline despite minor PSNR shifts?
Q2: Given that end-to-end mapping time in Table 1 decreases by less than 1% on VarSplat (0.62%), under 2% on SGAD-SLAM (1.99%), and under 2.5% on GS-LIVM (2.30%), what is the practical runtime benefit of CGO when integrated into full robotic pipelines where tracking, projection, and rendering dominate the compute budget?
Q3: What specific factors led to the baseline collapse of GS-LIVM (PSNR 6.175 dB) and MonoGS (PSNR 7.980 dB) in Table 1? Did the tracking frontend diverge, or were default parameters modified? Why are comparisons against unusable reconstructions considered valid benchmarks for cross-backbone transferability?
Q4: Is CGO mathematically equivalent to the native multi-kernel attribute update? If so, why does E01 deviate in PSNR and SSIM from E00 in Table 2? Does CGO introduce non-deterministic floating-point accumulation or thread contention during online optimization?
Q5: Why does the paper omit standard 3D surface reconstruction metrics (e.g., Chamfer Distance, F-score, or point-to-plane RMSE) when evaluating GeoBirth, relying solely on 2D novel-view rendering metrics to claim improved 3D metric surface alignment?
5 comments
Response to Reviewer eC7e (Q2): CGO Runtime Benefits in Robotic Mapping
FormFlow-GS reduces Mapping time on all six tested backbones: Gaussian-LIC², GS-LIVM, PVG, SGAD-SLAM, VarSplat, and MonoGS. Independent optimizer experiments further validate CGO’s efficiency advantage in frequent Gaussian parameter updates. We thank the reviewer for their interest in CGO’s practical benefits in complete robotic mapping pipelines.
Through a shared visible-Gaussian working set, CGO fuses updates of six heterogeneous attribute groups into a single CUDA Kernel, reducing repeated launches and scheduling overhead without modifying existing tracking, projection, or rendering modules.
1. Optimizer-level benefits of CGO and applicable conditions
CGO consolidates updates of six heterogeneous Gaussian attribute groups into a shared visible working set, reducing repeated launches and scheduling overhead through a single CUDA Kernel. We performed matched timing comparisons with SelectiveAdam and AdamW-GS at different Gaussian scales and visibility rates.
Table 1: Optimizer execution time at different Gaussian scales and visibility rates
| Gaussian count | Visibility rate | CGO ↓ (μs) | SelectiveAdam ↓ (μs) | AdamW-GS ↓ (μs) | CGO speedup |
|---|---|---|---|---|---|
| 10k | 10% | 4.323 | 14.101 | 19.235 | 3.26× |
| 10k | 50% | 5.408 | 15.187 | 21.330 | 2.81× |
| 10k | 100% | 6.298 | 16.198 | 21.988 | 2.57× |
| 100k | 10% | 23.356 | 32.201 | 45.446 | 1.38× |
| 100k | 50% | 59.319 | 70.417 | 78.264 | 1.19× |
| 100k | 100% | 181.429 | 185.881 | 187.392 | 1.02× |
| 1M | 10% | 422.222 | 424.527 | 439.100 | 1.01× |
| 1M | 50% | 1186.431 | 1182.320 | 1200.040 | 0.997× |
| 1M | 100% | 1788.593 | 1796.271 | 1810.605 | 1.004× |
Note: A speedup greater than 1 means that CGO is faster.
The results show a clear advantage for CGO in small-scale, frequent Gaussian updates. As the Gaussian count increases, parameter and momentum reads and writes increasingly dominate, and the benefit of fused execution decreases accordingly; at 1M Gaussians, performance is already essentially on par with SelectiveAdam.
2. Relationship between optimizer benefits and full Mapping benefits
We further distinguish three measurement levels: parameter updates, local mapping optimization, and full Mapping.
| Measurement level | Experimental configuration | Measured time change |
|---|---|---|
| Composite update | Gaussian-LIC² | 0.997→0.723 s(−27.48%) |
| Mapping Optimize | Gaussian-LIC² | 6.147→5.713 s(−7.06%) |
| Mapping under the adaptation protocol | GS-LIVM | −2.30% |
| Mapping under the adaptation protocol | SGAD-SLAM | −1.99% |
| Mapping under the adaptation protocol | VarSplat | −0.62% |
These results indicate that CGO can effectively reduce Gaussian parameter-update costs, while the speedup in full Mapping also depends on the optimizer’s share of the total computational workload. When tracking, projection, and rendering consume more computation time, the acceleration of the update stage accounts for a correspondingly smaller proportion of the overall runtime.
In summary, CGO demonstrates clear optimizer-level acceleration and good cross-framework applicability. FormFlow-GS improves Mapping time on all six tested Gaussian Mapping backends. Without modifying existing tracking, projection, or rendering modules, CGO provides an efficient, lightweight, and reusable parameter-update mechanism that helps reduce the computational overhead of online robotic mapping and effectively supports low-latency, real-time Gaussian Mapping.
Response to Reviewer eC7e (Q3): Baseline Quality and Cross-Backbone Evaluation
FormFlow-GS has been successfully adapted to six Gaussian Mapping backends and achieves improvements in rendering quality under matched experimental conditions, validating its cross-framework integrability. We thank the reviewer for their attention to low-quality baselines and evaluation validity. We further verified the experimental configurations and original records, explicitly distinguishing controlled adaptation experiments from each method’s official standard evaluation.
1. Causes of baseline quality degradation
The baseline PSNR values for GS-LIVM, MonoGS, and SGAD-SLAM are 6.175, 7.980, and 12.378 dB, respectively. All come from actual runs and can be recomputed from the original records. To verify FormFlow-GS’s cross-framework adaptability, we used the official public implementations of these methods and adapted their mapping modules to different sensor configurations and data scenarios. Differences in scene geometry, sensor observations, and illumination conditions may affect the baselines’ absolute rendering quality. For GS-LIVM and MonoGS, the experiments use externally provided camera poses; therefore, the low PSNR values are not caused by tracking-frontend divergence in this evaluation.
We further verified the specific experimental configurations:
| Backbone | Adaptation experiment settings |
|---|---|
| GS-LIVM | Three FAST-LIVO2 sequences; independent single-image submaps, 100 optimization updates per image; fixed poses and held-out-view rendering |
| MonoGS | Six sequences; 9 mapping views and 20 held-out views; 500 optimization updates in total; window size 4; fixed poses |
| SGAD-SLAM | Three TUM RGB-D sequences; independent submaps, 100 optimization updates per image; held-out-view evaluation |
2. Validity of cross-framework comparisons
Table 1 uses strictly matched Base and Ours+Base comparisons, maintaining identical input data, camera poses, and optimization configurations within each backbone to evaluate performance changes after integrating GeoBirth and CGO. All experiments are based on official public implementations and follow explicitly defined adaptation protocols. Thus, the paired experiments directly measure the proposed modules’ contributions to rendering quality and mapping efficiency, providing experimental evidence for FormFlow-GS’s cross-framework integrability and performance transfer.
In summary, through GeoBirth’s geometry-aware initialization and CGO’s efficient parameter updates, FormFlow-GS successfully adapts to six Gaussian Mapping backends and demonstrates rendering-performance benefits and improved mapping efficiency in matched experiments. These results reflect the complementary advantages of the two innovations and the method’s cross-framework applicability to multimodal online mapping.
Response to Reviewer eC7e (Q1): LPIPS Degradation and Reliability-Guided Shaping
In the 12-sequence evaluation on Gaussian-LIC², FormFlow-GS improves PSNR from 20.692 to 21.041 dB and SSIM from 0.7160 to 0.7216. To address the lack of a corresponding LPIPS improvement, we conducted controlled experiments that reveal the relationship between spatial support strength and perceptual detail. Across three test scenes, Reliability reduces mean LPIPS by approximately 12.53% relative to Full-strength, validating the effectiveness of adaptive shaping in mitigating perceptual loss. We thank the reviewer for pointing out this issue and analyze it through supplementary experiments.
1. Causes of perceptual degradation and controlled verification
GeoBirth changes the image-projection support of Gaussians by adjusting their anisotropic scales. Stronger spatial support can improve pixel fitting within a region, but may also increase projection overlap and color blending, smoothing high-frequency textures such as text strokes, thin lines, and local edges.
To verify this mechanism, we fixed 464,435 Gaussians, birth candidates, camera poses, and optimization conditions, varying only spatial support strength. The results show that PSNR increases from 21.2736 to 21.8861 dB (+0.6125 dB), whereas standard LPIPS increases from 0.33555 to 0.37535 (+0.03980), confirming that excessive spatial shaping may cause a tradeoff between pixel accuracy and perceptual quality. Further same-view comparisons are presented below.
Table 1: Rendering quality comparison for the full view and local text region
Although Full-strength improves PSNR, it also degrades LPIPS. In contrast, Ours E11 achieves both higher PSNR and lower LPIPS in the full image and obtains the best results on all three metrics in the local text region. This indicates that Reliability-guided shaping can effectively preserve local perceptual detail in this test view.
2. The role of Reliability in modulating perceptual quality
GeoBirth adaptively adjusts the anisotropic support of Gaussians according to local geometric reliability, strengthening surface alignment in geometrically trustworthy regions and reducing shaping strength where reliability is insufficient, thereby mitigating excessive smoothing caused by fixed full-strength shaping.
Table 2: Reliability ablation and changes in standard LPIPS for the full method
Note: Negative values indicate an LPIPS improvement in the corresponding comparison.
Reliability outperforms Full-strength in all three scenes, with an average LPIPS improvement of approximately 12.53%, further validating the positive role of adaptively controlling spatial shaping strength in mitigating the loss of perceptual detail.
3. Does CGO introduce perceptual degradation?
We performed bitwise-consistency verification of 10,692 parameter and momentum updates, confirming that CGO and the tested native visibility-gated Adam produce identical updates under identical inputs. Further controlled experiments localized the first historical numerical difference to the Backward gradient-accumulation stage, before the optimizer. With the Backward configuration fixed, switching only CGO did not show stable changes in PSNR or LPIPS. Therefore, the available evidence does not support attributing perceptual degradation to CGO’s parameter-update rule.
In summary, GeoBirth improves Gaussian surface alignment and pixel-level reconstruction accuracy through geometry-aware initialization, while Reliability further uses local geometric reliability to modulate anisotropic support, effectively mitigating the smoothing of high-frequency textures caused by excessive shaping. Together with CGO’s numerical-consistency and independent controlled verification, the results indicate that FormFlow-GS can achieve a more appropriate balance among geometric consistency, pixel-level reconstruction accuracy, and local perceptual quality while maintaining efficient optimization.