- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper improves block-wise urban novel-view synthesis built on 2D Gaussian Splatting per block. It identifies two bottlenecks: partitioning can imbalance primitive counts across blocks or split connected buildings across independently optimized blocks, and zero-thickness 2D primitives fit planar structure well but are too rigid for irregular geometry such as vegetation or cranes. UrbanBP-GS contributes building-aware partitioning, which starts from a primitive-balanced partition and reassigns whole cross-block buildings to their dominant block under a variation budget, and planarity-constrained updating, which keeps full 3D Gaussians but aligns the orientations of those contributing to the same detected plane. Experiments on four urban scenes against Gaussian-splatting baselines show the best perceptual quality on all scenes and the best PSNR on three, with remove-one ablations on a single scene.
Critical strengths
- Building-aware partitioning targets a concrete failure mode of block-wise pipelines, and budget-constrained reassignment is a simple, controllable fix that preserves the load-balance purpose of the initial partition. The formulation is precise about what the budget does and does not constrain, and one ownership map consistently drives view assignment and merging, which makes the method easy to re-implement. The results are consistent with the motivation: perceptual quality is the best of all methods on every scene, with clear margins over the strongest baselines, and the reporting concedes the scene where PSNR trails a baseline.
- Keeping finite-thickness primitives while enforcing orientation consistency within planes is a reasonable middle ground between the surface bias of 2D Gaussians and the flexibility of 3D ones, and the planarity module avoids two standard pitfalls: the soft axis selection stops gradients that would merely switch axes, and the alignment loss treats opposite normals as equivalent. Qualitative comparisons on thin and irregular structures support the design.
Critical weaknesses
- Attribution is never isolated. The claim that zero thickness is the limiting factor is untested: the ablation varies the proposed components but includes no primitive swap, and the main comparison is confounded because baselines differ simultaneously in primitive, partitioning, regularization, and inherited depth supervision. Notably, the 2DGS representative of the same lineage scores below the plain 3DGS variant of that lineage on most scenes and metrics, and the paper does not state whether that row was re-run under the present protocol or quoted; if quoted, the comparison to it is not meaningful. As it stands, no reported margin can be assigned to any specific component.
- The two central claims are never quantified, and the geometric mechanism is left partly unspecified. The formulation defines per-block primitive counts and the target balance, yet no counts, imbalance ratios, or fragmentation statistics are reported before or after refinement, and no seam or consistency measure accompanies the stated goal, although this is the paper's central motivation. On the geometric side, only photometric novel-view metrics are reported despite the planarity motivation; plane identities are not matched across views, so the same facade is aligned toward independent orientations in different views, and sensitivity to plane-detection errors is unexamined; the shaping loss is described only in prose; and no training or rendering cost, loss weights, or limitations are given despite the large-scale framing.
Questions for authors
- Can you add a primitive-swap ablation — same partitioning and losses, zero-thickness or 2DGS primitives — across the scenes, and state whether the 2DGS baseline row was re-run under your settings or quoted from elsewhere?
- What are the per-block primitive counts before and after refinement, how many buildings span multiple blocks initially and finally, and how sensitive are the results to the variation budget and the shaping threshold? What is the exact functional form of the shaping loss?
- Do the baselines receive the same depth supervision and resolution policy, the same train-test split and test-view count, and were they retrained under your protocol? How much of the improvement survives when only supervision is equalized?
- How are per-view plane orientations reconciled for the same facade, and how sensitive is the method to plane-mask errors? Can a geometric evaluation — depth or normal error, or surface quality on facades — be added to test the geometric claims directly?
4 comments
Partition Statistics and Loss Formulation
Response to Reviewer (2/3) – Partitioning Measurements and Loss Formulation
W2 / Q2 – Quantifying building integrity and workload balance.
We measured fragmentation and per-block primitive counts on SMBU (103 extracted candidate regions, 4 blocks) under different refinement budgets:
| Budget | Cross-block regions | Fragmented area | Per-block primitives (M) | Max/mean | Min/mean |
|---|---|---|---|---|---|
| Initial partition | 18 | 45.7% | 2.28 / 2.31 / 2.27 / 2.22 | 1.017 | 0.977 |
| 0.1–0.5 (default: 0.3) | 1 | 27.3% | 2.50 / 2.37 / 2.03 / 2.17 | 1.101 | 0.896 |
| At least 0.66 | 0 | 0.0% | – | 1.596 | 0.480 |
Structural integrity. Refinement consolidates 17 of the 18 initially cross-block candidate regions. The remaining region corresponds to a large vegetated hillside included in the extracted candidates, rather than an ordinary building instance. It accounts for the remaining fragmented candidate-region area.
Budget sensitivity and balance. All tested budgets between 0.1 and 0.5 produce the same partition. Although the budget limits each reassignment rather than cumulative deviation, the largest cumulative block-count change is only 10.5%. Consolidating the remaining large region requires a budget of at least 0.66 and would increase the maximum block load to approximately 1.60 times the mean. Thus, the budget rejects a disproportionately expensive reassignment.
The trained SMBU model contains 13.2M Gaussians after densification, distributed as 3.64 / 3.77 / 2.81 / 3.00 M across the refined blocks. The maximum load ratio increases only from 1.101 to 1.142 after training, indicating that the observed imbalance remains moderate.
Rendering contribution. Relative to the initial partition used by the w/o building-aware variant, refinement improves PSNR/SSIM/LPIPS from 24.862/0.807/0.174 to 24.902/0.809/0.171. The fragmentation measurements directly quantify structural consolidation and identify where block boundaries intersect extracted regions. They do not themselves measure image-space seam error, but provide complementary evidence for the mechanism underlying the rendering improvements.
Exact shaping loss.
Let and define the active set
The shaping objective is
\qquad \tau_s=0.2.$$ Only Gaussians whose shortest-to-longest scale ratio exceeds the threshold are penalized. Once $\rho_i\leq\tau_s$, the Gaussian leaves the active set. This encourages flattening without enforcing zero thickness. The threshold controls which Gaussians receive shaping supervision; we use the fixed value 0.2 in the reported experiments and do not claim robustness to untested threshold values. **Loss settings.** The complete objective is $$L=L_{\mathrm{rgb}}+w_dL_{\mathrm{depth}}+w_sL_{\mathrm{shape}}+w_pL_{\mathrm{planarity}},$$ where $$L_{\mathrm{rgb}}=0.8L_1+0.2(1-\mathrm{SSIM}).$$ The depth loss applies the same L1/SSIM combination to Depth-Anything-V2 inverse depth. With $$h(t)=\min(t/60000,1),$$ the loss weights are $$w_d=0.5(0.005)^{h(t)},$$ $$w_s=0.01(0.01)^{h(t)},\quad t\geq3000,$$ $$w_p=0.2(0.05)^{h(t)},\quad t\geq6000.$$ The shaping and planarity weights are zero before their respective activation steps. The selector temperature is $T=0.1$. The coarse stage (30k steps) uses only photometric and depth supervision. These settings will be stated explicitly in the appendix.Plane Consistency, Robustness and Cost
Response to Reviewer (3/3) – Plane Consistency, Robustness, and Computational Cost
Q4 – Cross-view plane consistency and mask errors.
Cross-view orientation coupling. Plane masks determine which Gaussians are grouped within each training view; they do not provide externally estimated target normals. Each group's reference direction is computed from the current orientations of its contributing Gaussians.
When the same facade is observed across multiple views, the associated groups can share many of the same underlying 3D Gaussians. Because these Gaussians have persistent parameters across views, their orientations receive coupled supervision rather than being independently optimized for each image.
We acknowledge that this is implicit coupling, not explicit cross-view plane-instance matching. Therefore, the method does not guarantee identical group directions across all observations of a facade. Nevertheless, the trained SMBU model exhibits coherent per-instance orientations: over 100 training views and 869 detected plane instances, the per-view median resultant length of the weighted signed normals ranges from 0.88 to 0.94.
Mask-error handling. Contributor collection applies visibility and opacity filtering in the rasterizer. A Gaussian is recorded only when its per-pixel opacity satisfies and ray transmittance remains at least . We retain the 10 largest plane instances per view, discard masks smaller than 10 pixels, deduplicate contributor IDs, and exclude instances with fewer than 3 Gaussians.
Associations are formed per view without persistent global plane labels. Each plane-instance loss is normalized by the total weight of its associated Gaussians. Thus, imperfect masks do not impose permanent hard plane assignments, although erroneous associations may still influence subsequent optimization through parameter updates.
The planarity weight decreases from approximately 0.148 at activation to 0.01 at the end of training, reducing the relative influence of plane supervision during later iterations. These mechanisms mitigate reliance on noisy associations but do not guarantee immunity to plane-detection errors.
Geometric evidence and limitations. We distinguish geometric consistency from ground-truth geometric accuracy. The orientation-resultant statistics characterize within-plane Gaussian alignment, while the partition measurements directly quantify structural fragmentation. Improvements in held-out-view SSIM and LPIPS provide complementary rendering evidence, but do not directly measure surface-normal or depth accuracy.
Our current evaluation therefore supports structural consolidation, orientation coherence, and improved novel-view synthesis, without establishing a quantitative gain in ground-truth geometric accuracy. We will make this distinction explicit in the limitations discussion.
Computational cost.
Measurements on SMBU (500 training images, 1600x1064) use four RTX 4080 SUPER GPUs modified to 32 GB memory each:
| Item | Cost |
|---|---|
| ZeroPlane plane masks | 5.2 min |
| Depth-Anything-V2 inverse depth | 5.5 min |
| Coarse training (30k steps) | 1.37 h |
| Building extraction, partition, view assignment | 2.0 min |
| Iteration time, planarity off to on | 252 to 423 ms |
| Peak allocated GPU memory, off to on | 17.9 to 20.8 GB |
| Total reconstruction, including preprocessing | Approximately 9 h on 4 GPUs |
| Final model | 13.2M Gaussians, 23.1 FPS at 1600x1064 |
The iteration-time and memory measurements are taken on the largest block model (10.4M Gaussians before ownership filtering). Contributor tracking and plane association increase training-time computation and memory, but are not required during rendering.
Plane-mask prediction, depth estimation, and geometry processing together take approximately 13 minutes, less than 3% of the total reconstruction time. The four blocks are trained in parallel, one per GPU.
We will explicitly discuss the remaining limitations: the lack of a controlled primitive-swap comparison, dependence on plane-mask quality, absence of direct geometric ground truth evaluation, and additional training-time overhead.
We thank the reviewer again for the constructive suggestions. We believe these measurements and clarifications better establish the specific contributions, empirical evidence, and limitations of UrbanBP-GS.
My assessment rests on three points. 1) Every baseline result in Table 1 is quoted from published sources rather than independently retrained under this paper's own depth supervision and training budget. 2) And decisively, the questions that would decide acceptance are answered with acknowledged limitations rather than with experiments. 3) The SMBU ablation shows that removing all three components together decreases PSNR by about 0.1 dB, that the planarity term alone brings no distinguishable PSNR gain at the reported precision, and that the building-aware refinement yields only a 0.04 dB improvement. My assessment is unchanged, and my score remains 2.
Attribution and Primitive Choice
Response to Reviewer (1/3) – Attribution and Primitive Choice
We thank the reviewer for the constructive evaluation and for recognizing the practical value of building-aware partitioning and finite-thickness Gaussians with planar orientation consistency. We provide additional measurements and clarify the scope of our experimental comparisons.
W1 / Q1 / Q3 – Attribution under matched supervision.
We distinguish component attribution within UrbanBP-GS from cross-paper comparisons. In our controlled ablations, all variants share the same monocular inverse-depth supervision, image resolution, train–test split, coarse checkpoint, number of blocks, and 60k steps per block. In addition to the Residence ablation (Table 2), we evaluated the components on SMBU and included a Base that removes building-aware refinement, Gaussian shaping, and planarity consistency together:
With supervision and training iterations matched, removing all three components decreases PSNR by 0.100 dB and SSIM by 0.013, while increasing LPIPS by 0.010. Every individual removal also increases LPIPS on both Residence and SMBU. The planarity term shows a modest LPIPS benefit but no distinguishable PSNR gain on SMBU at the reported precision.
The joint SSIM and LPIPS degradations exceed the sums of the individual remove-one degradations, suggesting complementary or non-additive interactions among the components. These results isolate their contributions within our common backbone, rather than attributing the full margins over external baselines to individual modules.
Primitive choice and CityGaussianV2 provenance.
We clarify that UrbanBP-GS retains full 3D Gaussians during block-wise optimization; it does not use zero-thickness 2D primitives. Our motivation is to retain flexibility for irregular geometry while applying orientation constraints selectively to detected planar regions.
Table 1 quotes baseline results from published sources rather than independently retraining those methods. Specifically, the CityGaussianV2 entries for Mill19 and UrbanScene3D are taken from the MetroGS (CVPR 2026) supplementary evaluation, since the original CityGaussianV2 paper does not report these scenes. We will explicitly identify the source of each row.
Our evaluation follows the stated benchmark resolution policy (4x downsampling for Mill19 and UrbanScene3D; 1.2x for MatrixCity-Aerial) and the corresponding train–test splits. However, external methods may differ in depth supervision, training budgets, block configurations, and other implementation details. Thus, matching the benchmark protocol does not make their training conditions identical. We do not interpret cross-paper margins as controlled evidence of any single component's contribution.
Regarding primitive choice, CityGaussianV2 reports higher geometric F1 than CityGaussian on GauU-Scene (0.501 vs. 0.453), while obtaining lower rendering quality on the three reported scenes. For example, on Russian Building, CityGaussianV2 reports PSNR/SSIM/LPIPS of 24.12/0.784/0.196, versus 24.37/0.808/0.163 for CityGaussian. This illustrates a possible geometry–rendering tradeoff, but is not a primitive-only comparison because the methods also differ in optimization.
We therefore present retaining the third Gaussian scale as a design choice motivated by the coexistence of planar and irregular urban structures, rather than claiming that zero thickness alone explains the performance differences. Our controlled ablations support the benefits of the proposed updating and partitioning components within this 3DGS representation.