- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces a method for combining aerial- and ground- generated 3D Gaussian Splatting maps. The problem is formulated as a registration problem and uses Shared Recoverable Evidence and camera conditioning. The method is tested on TerraSky3D, Horizon-GS, and ScanNet-GSReg benchmarks, and shows an improvement over the baselines.
Critical strengths
- The paper presents a clear method for the ground- and -aerial acquisition map combination using Gaussians as the representation. The problem formulation inspired from point cloud registration is a sensible approach; supported by the experimental evaluation
Critical weaknesses
- My main reservation pertains to limited discussion on the failure cases wrt the underlying assumptions (which are not specified but one needs to infer - this should be explicitly stated). In particular, the aerial and ground observations are rarely taken at the same time, neither from the problem formulation nor from the experiments I can see any discussion on the temporal mismatches across the views. So, I understand that the implicit assumption is that there are no geometrical changes present in the submaps. This has been a critical challenge in the co-registration community (both point cloud and Gaussian representations), as not only the geometrical matching challenges arise (different spatial coverage, occlusions, resolution) but also temporal mismatches. For example, pedestrians, cars but also buildings being rebuilt, streets change etc.
Questions for authors
- I would like to ask for clarification on the failure case of the Reference-frame proposal (l. 194). How sensitive is this initialization? What is the impact on the refinement then? I would imagine that a proposal generated from e.g., a close-up image from a car may not align with an aerial view, also the overlap might be minimal or non-existent. How is this achieved? What happens in that kind of case? Could you provide some visual/or quantitative examples and elaborate?
- Another question pertains to the underlying assumption, which is not mentioned in the paper. What happens if the acquisitions differ in timestamp and hence there is a temporal mismatch between the acquisitions? It can be a drastic example of aerial acquisition taking place in 2008 and the ground one in 2020, the trees, buildings and other elements may not be present. It can be even more practical – a drone flyers just a few minutes after the ground acquisition and the pedestrians, cars and other dynamic elements can play a role. Could you elaborate on that and present some quantitative and/or qualitative examples?
- Line 319, mentions that in Tab 1 uses “each pipeline’s initializer”. Can it be that this has an impact on the reported performance of this method? The used VGGT-Ω is more powerful than DUSt3R, so the improvement may stem from just a better backbone. Could you please elaborate and maybe present an ablation for your method on that?
- I was also wondering – the method setup somewhat resembles the traditional approach to point cloud registration - get a coarse registration (e.g., RANSAC) and then refine (e.g., ICP). This is also similar to the FGR-ICP baseline that is selected here. Could you please comment on the performance on assuming that the Reference-frame proposal is replaced with the classical RANSAC-like approach and the fine tuning is performed with the proposed method? If I missed something, please feel free to clarify here but I would imagine this as an interesting angle to the variability/generalisation of the method.
- Another point for discussion is – does that paper need to be about the aerial to ground? It seems that it is about overall and more general registration of Gaussians, as in the tested ScanNet-GSReg. It seems that there is no underlying assumption in the method that is disqualified from registering any RGB-derived Gaussians (excluding the ones in different media than air, e.g., underwater etc.)? Could you elaborate? If yes, I would change the positioning of this paper to a more general problem.