ARGUS-GS: Sensor-Guided Aerial-Ground Gaussian Splatting for 3D City Modeling with Model-to-World Alignment
Abstract
3D city modeling requires both broad scene coverage and accurate alignment with the physical world (i.e., model-to-world alignment), for which image-based reconstruction techniques, such as Gaussian Splatting (GS), provide an effective solution. Vehicle and UAV imagery provide complementary coverage, but their large viewpoint gap complicates cross-stream fusion, while accumulated estimated pose errors along the trajectory can further distort the reconstruction away from its true physical location during coordinate alignment. We present ARGUS-GS, a sensor-guided ground-aerial collaborative 3D city modeling system that produces a unified Gaussian representation with model-to-world alignment. Standard onboard sensor measurements anchor each stream's estimated poses and sparse geometry into the shared physical-world metric frame, while revisit handling limits duplicate Gaussian insertion. We then initialize a shared Gaussian field using inverse-depth search with range-adaptive searching windows, maintaining consistent relative search coverage across viewing distances. Camera poses and Gaussian parameters are then jointly optimized using photometric losses and soft sensor-derived poses, with periodic reseeding of poorly reconstructed views. Simulated urban experiments show dB higher PSNR over baselines at ground-truth camera poses, with % lower depth MAE and % higher surface agreement.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.