- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SphereBridge, a method for reconstructing a 3D scene from a single panorama for high-resolution nearby-view browsing. It combines feed-forward Gaussian prediction adapted to spherical geometry with a rendering bridge that converts the Gaussians into a multi-sphere image (MSI) and injects high-resolution source textures. It also introduces Tangent-View Scaffolding to construct fine-tuning pairs from unpaired real panoramas. Experiments on six indoor and outdoor datasets show competitive perceptual quality and substantially faster MSI rendering than direct Gaussian splatting. Real-data fine-tuning improves performance on OmniPhotos but reduces performance on TartanGround, while rendering quality declines as camera displacement increases.
Critical strengths
-
The combination of feed-forward Gaussian reconstruction and MSI rendering is practical and effective. It enables fast scene construction and high-resolution nearby-view rendering, with a substantial rendering-speed improvement over direct Gaussian splatting.
-
Tangent-View Scaffolding offers a practical way to use unpaired real panoramas for fine-tuning. Using synthesized views as inputs and real captures as supervision avoids relying on synthetic target images. The Stage 2 ablation shows improved performance on OmniPhotos, supporting its usefulness for real-domain adaptation.
Critical weaknesses
-
The benefit of high-frequency texture injection is not isolated. Table 2 lacks a comparison of the same MSI with and without this injection, leaving its contribution unclear. The sensitivity of injected textures to depth and visibility errors is also not evaluated.
-
The evaluation is incomplete. Table 10 lacks external baselines and Direct GS results across displacement ranges, leaving unclear whether the method remains competitive and whether degradation comes from the predicted Gaussian scene or the MSI conversion and texture injection. Comparisons with diffusion-prior-based methods such as WorldExplorer [1] would strengthen the evaluation; the open-source HY-World 2.0 [2] is another useful reference.
[1] Manuel-Andreas Schneider et al. WorldExplorer: Towards Generating Fully Navigable 3D Scenes. SIGGRAPH Asia, 2025. [2] Team HY-World et al. HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds. arXiv, 2026.
Questions for authors
-
Texture injection: Could the authors to report results for the same baked MSI with and without high-resolution texture injection, changing only the layer colors? Please also examine whether depth or visibility errors cause texture misalignment at novel views.
-
Camera displacement: Could the authors extend Table 10 to include Direct GS rendering of the same reconstruction and representative external baselines in each displacement interval? This would clarify whether SphereBridge remains competitive compared to baselines as displacement increases and whether MSI conversion introduces additional degradation relative to Direct GS.
-
Baseline coverage: Could the authors evaluate the panorama-to-3D reconstruction pipeline of LayerPano3D using the same input panoramas, bypassing its text-to-panorama generation stage? Table 12 compares only its layer-placement strategy, not the full reconstruction pipeline. Comparisons with WorldExplorer and the open-source HY-World 2.0, initialized from the same panoramas, would also help assess the quality–efficiency trade-off against methods that use diffusion priors.
4 comments
Response to Reviewer PtQN (2/2): camera displacement and diffusion-prior baselines
Camera displacement (Q2). Table 12 now evaluates the six baselines, Depth-Backproj + Bridge, direct splatting of the same SphereBridge Gaussians (Direct GS), and the MSI without and with injection in every displacement interval on TartanGround. LPIPS / DISTS:
| Method | (0, 0.25] | (0.25, 0.5] | (0.5, 1.0] | (1.0, 1.5] |
|---|---|---|---|---|
| PERF | 0.373 / 0.201 | 0.485 / 0.231 | 0.526 / 0.260 | 0.561 / 0.304 |
| Pano2Room | 0.444 / 0.228 | 0.541 / 0.253 | 0.571 / 0.279 | 0.602 / 0.323 |
| LayerPano3D | 0.421 / 0.209 | 0.527 / 0.249 | 0.551 / 0.259 | 0.593 / 0.306 |
| WorldExplorer | 0.584 / 0.366 | 0.662 / 0.429 | 0.671 / 0.455 | 0.690 / 0.467 |
| Depth-Backproj | 0.350 / 0.187 | 0.434 / 0.212 | 0.483 / 0.235 | 0.520 / 0.259 |
| Tangent-View Scaffolding | 0.294 / 0.163 | 0.380 / 0.182 | 0.423 / 0.199 | 0.456 / 0.217 |
| Depth-Backproj + Bridge | 0.278 / 0.125 | 0.371 / 0.163 | 0.455 / 0.247 | 0.546 / 0.388 |
| SphereBridge (Direct GS) | 0.306 / 0.158 | 0.370 / 0.168 | 0.412 / 0.188 | 0.444 / 0.210 |
| SphereBridge (w/o injection) | 0.357 / 0.174 | 0.465 / 0.218 | 0.497 / 0.244 | 0.528 / 0.272 |
| SphereBridge | 0.275 / 0.122 | 0.387 / 0.152 | 0.439 / 0.188 | 0.478 / 0.220 |
MSI rendering ranks first on both metrics within 0.25 m and remains first or tied on DISTS up to 1.0 m. In the three farther intervals, direct splatting of the same Gaussians is ahead of the six baselines on both metrics.
The degradation has two sources. Every method degrades with displacement, Direct GS included, since a farther view exposes more content that the single source panorama never observes. The MSI conversion adds a cost on top: it discretizes the Gaussians onto 16 spheres, and the resulting parallax error grows with translation, so the MSI without injection trails Direct GS in every interval. Texture injection improves both metrics in every interval and changes PSNR by less than 0.1 dB in each interval (Part 1).
Diffusion-prior baselines (Q3). Both methods start from the same source panoramas as all other methods (Table 1, Figure 4, Tables 6–12, Appendix B.2).
- LayerPano3D runs its full panorama-to-3D pipeline of layered decomposition, inpainting, and per-scene Gaussian optimization, with the text-to-panorama stage bypassed.
- WorldExplorer accepts only eight horizontal 60° views, which we crop from the panorama, so its content beyond ±30° in elevation is generated. Every method is averaged over all evaluation scenes, including those on which the Gaussian optimization of WorldExplorer collapses. Even on the scenes where it does not collapse, and within the band it observes (the four side faces within ±25° of elevation), it trails SphereBridge in LPIPS and DISTS on every dataset, with LPIPS 0.402 to 0.526 against 0.164 to 0.312 and DISTS 0.184 to 0.282 against 0.070 to 0.136 (computed for this response).
On quality and efficiency, LayerPano3D takes about 20 minutes and WorldExplorer about 4 hours per scene, against 12.68 s for SphereBridge including the MSI bake (Table 1). Both trail SphereBridge in LPIPS and DISTS on all six datasets and in every displacement interval of Table 12.
We hope these results address your concerns, and we are happy to provide further details.
response to authors
Thank you for the additional experiments and clarifications. The texture-injection ablations, comparisons across camera displacement ranges, and additional baselines largely address my concerns and strengthen the empirical support for the method. I am updating my recommendation to weak accept.
Thank you for reviewing our response and the revised paper. We are glad that the texture-injection ablations, the displacement comparison, and the added baselines addressed your concerns. Your questions on injection and camera motion made the attribution of each component clearer and the evaluation more complete, and we appreciate the time you spent on our submission.
Response to Reviewer PtQN (1/2): texture injection
Thank you for the constructive review and the concrete experiments you proposed. This part answers W1 and Q1, and Part 2 answers W2, Q2, and Q3. Table numbers refer to the revised PDF (the General Response maps them to the submission).
Same baked MSI with and without injection (Q1). The variant without injection keeps the baked MSI unchanged, including its layer alphas and routing, and only skips rewriting the layer colors from the source panorama. It appears next to the full MSI in Table 2 (each output resolution), Table 5 (bridge ablation), Tables 6–11 (six datasets), Table 12 (displacement intervals), and Table 15 (360Loc up to native resolution). Cubemap PSNR / LPIPS / DISTS at the target views of Tables 6–11:
Injection improves LPIPS and DISTS on every dataset and changes PSNR by at most 0.14 dB. At 4096×4096 in Table 2, injection lowers LPIPS / DISTS from 0.485 / 0.418 to 0.423 / 0.235 at essentially the same frame rate.
Depth errors and misalignment at novel views (Q1). The six-dataset metrics above are measured at novel target views, where sharp texture misplaced by a depth error would lower the pixel metrics, yet the PSNR changes above stay within 0.14 dB. Camera displacement tests this more directly, since the parallax of a depth error grows with translation. Table 12 reports only LPIPS and DISTS, so we computed PSNR / SSIM on its displacement intervals for this response (TartanGround):
Up to 0.5 m, injection does not lower PSNR or SSIM. Beyond 0.5 m, both drop slightly, consistent with sharp texture shifting as parallax grows, while LPIPS and DISTS still improve in every interval (Table 12). Depth errors of the reconstructed surface are quantified in Appendix G (Table 16).
Visibility errors (Q1). A visibility error spreads the source visibility vp of a ray over layers away from the reconstructed surface, as a foreground reconstructed with too low an opacity or the soft routing variant of Table 5 does, so part of the foreground texture lands on a wrong layer and appears as a ghost at novel views. Appendix F.6 measures this effect: M(ω) sums the injected weight that ray ω places outside the two layers that share the reconstructed surface, which bounds how much misplaced injected texture any novel view can see from that ray. M exceeds 0.05 on only 0.1% to 2.6% of the non-sky rays of each dataset, and these rays cluster at depth discontinuities. The highest share is on TartanGround, the dataset of the displacement test above, where injection still changes PSNR by less than 0.1 dB in every interval. Hybrid routing, whose gates block the foreground copies of soft routing (Section 3.2, Figure 6), lowers this share on TartanGround from 4.0% to 2.6%.