- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper presents ARGUS-GS, a sensor-guided 3D Gaussian Splatting framework designed for joint aerial-ground urban reconstruction with physical model-to-world alignment. The method utilizes onboard GNSS/IMU measurements to anchor vehicle and UAV camera poses into a shared metric world frame, bypassing the need for explicit cross-stream visual feature matching. It initializes Gaussians using range-adaptive inverse-depth search with Depth Anything V2 priors, refines camera poses and Gaussian attributes jointly under soft sensor-derived pose penalties, and incorporates a revisit handling mechanism alongside error-guided reseeding to suppress duplicate primitive insertion. Evaluated on 20 simulated trajectory sequences in a PX4-Gazebo-Unity platform, the authors report substantial improvements in PSNR, depth MAE, and surface agreement under ground-truth camera poses.
Critical strengths
S1. Practical Problem Formulation: Reconstructing large-scale urban scenes by coupling aerial and ground perspectives while anchoring geometry into an absolute metric world coordinate system is an important and practically grounded problem for digital twin generation, robotics, and low-altitude surveying.
S2. Cohesive System Architecture: The end-to-end framework systematically touches upon several core challenges in heterogeneous visual mapping, specifically tackling disparate view ranges via range-adaptive search, mitigating cross-stream initialization discrepancies with monocular depth scaling, and addressing trajectory overlap artifacts via history-aware revisit gating.
S3. Extensive Ablation and Diagnostic Breakdown: The synthetic experimental section provides detailed component-level ablations in Table 3, quantifying the relative impact of the inverse-depth window scheme, the sensor pose loss term, the revisit insertion filter, and targeted reseeding on both pose error and surface reconstruction metrics.
Critical weaknesses
W1. Severe Protocol Bias in Baseline Evaluation: The central claim of a 5.8 dB PSNR gain over baselines is fundamentally confounded by the evaluation protocol. In Section 4.1 and Section 4.2, all models are rendered and evaluated strictly at the Unity ground-truth world-frame camera poses. Pure-vision baselines (e.g., 3DGS, VastGaussian, CityGaussianV2, UrbanGS) are georeferenced via a single global Sim(3) alignment without local pose refinement against world sensors, leaving trajectory drift uncorrected (as shown by their 0.5+ m position errors in Table 1). In large-scale scenes, even sub-degree rotation or sub-meter positional offsets produce severe pixel-space phase shifts that drastically degrade PSNR down to 16–17 dB regardless of the actual quality of local scene geometry and texture. Consequently, Table 1 primarily demonstrates that ARGUS-GS achieves better camera pose georeferencing, not necessarily a superior radiance field representation. To establish genuine reconstruction superiority, baselines must be evaluated either in their estimated camera frames or with test-time local pose alignment (e.g., local Umeyama alignment per evaluation chunk).
W2. Critical Absence of Empirical Real-World Validation: Although the experimental setup mentions real-world aerial-ground captures and references the Horizon-GS setup, the actual experimental validation in Tables 1, 2, and 3 is conducted entirely on synthetic data simulated in PX4-Gazebo-Unity. Synthetic sensors generate idealized, well-behaved Gaussian noise or smooth random walks. This fails to simulate real urban canyon conditions, where onboard GNSS suffers from severe non-line-of-sight (NLOS) multipath jumps, IMUs exhibit unmodeled temperature-dependent bias drifts, camera sensors present rolling-shutter artifacts and large dynamic range discrepancies, and real scenes contain transient moving objects. Claiming robust "model-to-world alignment from standard onboard sensors" without a single quantitative or qualitative evaluation on actual real-world vehicle/UAV sensor logs represents an unresolved empirical gap.
W3. Missing Core Engineering Baseline (Sensor-Aided SfM + SOTA 3DGS): The benchmark compares ARGUS-GS against pure-vision methods and GeoRefGS. However, the standard and widely adopted engineering paradigm for this problem is a two-stage pipeline: running Bundle Adjustment / Factor Graph Optimization with GNSS/IMU pose priors (e.g., COLMAP with GPS priors or Ceres-based pose graph optimization) to obtain drift-free metric camera poses, followed by training modern urban 3DGS models such as CityGaussianV2 or UrbanGS. Without comparing against this baseline, it is impossible to determine whether the complex joint photometric-pose gradient backpropagation (Equation 7) and heuristic reseeding provide any tangible benefit over decoupled sensor fusion followed by state-of-the-art splatting.
W4. Disconnect Between Revisit Claims and Quantitative Geometric Metrics: Section 3.6 emphasizes preventing "duplicate or layered Gaussians" when loops or revisits occur. However, the evaluation in revisited areas (Figure 5) relies strictly on photometric error and rendered depth maps. Photometric loss alone is not an adequate indicator of duplicate suppression, as volumetric Gaussians with adjusted opacities can easily fit RGB views despite harboring redundant, overlapping internal surfaces. The paper lacks direct geometric verification such as point cloud thickness, Chamfer distance, or primitive redundancy ratios in overlapped sub-regions. Furthermore, while the Abstract highlights "87.5% higher surface agreement", this metric is not defined in Section 4.1 (deferred entirely to Appendix B), leaving a noticeable gap between the abstract's headline claim and the main text's formal analysis.
W5. Conflated Impact of Monocular Foundation Model Priors: The range-adaptive initialization relies heavily on Depth Anything V2 (DDA V2), a massive pretrained vision foundation model possessing strong semantic geometric priors. The ablation in Table 3 only compares a range-adaptive window against a fixed inverse-depth window, failing to isolate how much of the geometric initialization improvement originates from the external foundation model prior versus the proposed geometric search formulation.
Questions for authors
Q1. Regarding Table 1's evaluation protocol: If the pure-vision baselines (e.g., CityGaussianV2, UrbanGS) are evaluated at their own estimated camera poses or subjected to test-time local pose registration before computing PSNR/SSIM, how much of the reported 5.8 dB PSNR advantage remains? Does the visual representation itself outperform baselines when decoupled from pose registration error?
Q2. Why are there no quantitative or visual results on the real-world dataset (such as the Horizon-GS real capture mentioned in the setup)? Can the authors present quantitative metrics or side-by-side visual comparisons on a real-world aerial-ground sequence demonstrating that the soft sensor constraint remains stable under real urban GNSS multipath spikes and IMU bias drift?
Q3. How does the proposed joint photometric-pose optimization compare against a two-stage pipeline where camera poses are pre-optimized using standard sensor-fusion bundle adjustment (e.g., COLMAP with GNSS priors) and then used to train UrbanGS or CityGaussianV2? What specific geometric failure modes does joint optimization solve that sensor-aided BA cannot?
Q4. Can the authors provide direct quantitative evidence demonstrating the suppression of duplicate Gaussians in revisit zones, such as local point cloud thickness profiles, Chamfer distance against ground-truth meshes, or primitive count comparisons in overlapped areas?
Q5. What is the computational and memory overhead of the revisit landmark matching and error-guided reseeding stages during training relative to standard 3DGS densification?