- Rating
- 3(+1)
- Confidence
- 1(−1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Game2GS, a framework for converting large-scale game environments into HDR Gaussian representations for free-view 6DoF rendering. The authors address two challenges: insufficient scene coverage caused by conventional trajectory-based image acquisition and inconsistent appearance supervision caused by automatic exposure.
The proposed framework uses source geometry and engine-native lighting probes to select informative camera views based on observation quality, directional coverage, and positional diversity. It also employs fixed-exposure HDR reconstruction with runtime exposure adaptation.
Critical strengths
- Optimizing camera acquisition under a limited image budget is a meaningful direction, especially for game environments where source geometry is available.
- The proposed method combines surface visibility, projected resolution, directional coverage, and distinct-position support to guide camera selection. Leveraging existing lighting probes and source geometry is a practical approach that avoids relying on an intermediate reconstruction for view selection.
Critical weaknesses
- Comparisons with simpler strategies, such as random sampling, uniform spatial sampling, or visibility-based greedy selection from the same candidate camera pool, would help determine whether the improvements come from the proposed optimization or primarily from broader spatial sampling.
- The framework targets large-scale scenes and real-time rendering, but the paper provides limited quantitative analysis of computational costs. In particular, the overhead of candidate generation, visibility evaluation, and greedy camera selection is not clearly reported.
- The view selection objective combines several components, including directional coverage, distinct-position support, spatial penalties, and height quotas. However, their individual contributions are not sufficiently evaluated.
Questions for authors
See the Weaknesses.
8 comments
Response to Reviewer 6rMG 2
2. Computational Cost and Scalability (Weakness 2)
We thank the reviewer for highlighting the need for quantitative computational-cost analysis. Our geometry-guided acquisition is an offline preprocessing step, separate from reconstruction training and runtime Gaussian rendering.
Experiment 2A: Computational Cost Analysis
We profiled the complete offline acquisition pipeline, from loading precomputed lighting probes and DistanceMaps to exporting a final set of B_high.
Table B. Computational cost breakdown of geometry-guided view acquisition on MatrixCity Block A.
| Stage | Time (min) |
|---|---|
| Initial and supplementary candidate generation | 25.45 |
| Candidate organization and camera–surface relation construction | 44.46 |
| Camera safety checks and mesh-based occlusion verification | 41.02 |
| Coverage-gap seed and coarse selection | 6.89 |
| Final greedy selection | 1.65 |
| Surface sampling and other preprocessing | 12.63 |
| Total recorded successful-stage time | 132.11 |
The timings cover processing from precomputed probes and DistanceMaps to exported camera poses, excluding probe baking, image capture, and 3DGS training.
Results and Discussion.
The entire offline acquisition preparation requires approximately 132 minutes, with most of the computational cost arising from candidate–surface relation construction, candidate generation, and geometric validation.
Importantly, the final greedy selection of B_high camera poses takes only 98.934 seconds (approximately 1.25% of the total), demonstrating that the main computational overhead lies in preparing and validating geometric observations rather than in the final view-selection optimization.
Our implementation uses sparse camera–surface relations and lazy priority-queue updates, as described in Appendix A.7, to reduce the computational cost of selection.
Experiment 2B: Runtime Rendering Efficiency
We additionally evaluated rendering efficiency on a large-scale scene containing approximately 280 million Gaussians, with up to 4 million Gaussians rendered per frame. The rendering performance reaches 132.67 FPS for HDR and 140.28 FPS for LDR.
These results provide additional evidence of practical real-time rendering performance. Furthermore, camera acquisition and view selection are performed entirely offline and introduce no additional per-frame view-selection overhead during rendering.
We will incorporate the computational breakdown and clarify the distinction between offline acquisition preprocessing and runtime rendering costs in the revised manuscript.
Response to Reviewer 6rMG 3
3. Contribution of Individual View-Selection Components (Weakness 3)
We thank the reviewer for highlighting the need to further validate the contributions of the individual components in our view-selection pipeline. To further identify the contributions of individual components, we perform leave-one-component-out ablations on Arena, using the same validated candidate pool, image budget, HDR reconstruction settings, and free-6DoF test views.
Experiment 3: View-Selection Component Ablation
Our view-selection pipeline consists of the following components:
Validated Camera Candidates C
+
Source Mesh Surface Elements
|
v
Surface Observation Quality
(Visibility, Range, Incidence, Resolution)
|
+-------------+-------------+
| |
v v
(1) Directional Coverage (F_dir) (2) Distinct-Position Support (F_sup)
| |
+-------------+-------------+
|
v
Joint Objective
J(V) = F_dir(V) + λF_sup(V)
|
v
Greedy Selection Iteration
--------------------------
Candidate Eligibility:
- Positive marginal gain
- (4) Height Quotas
- (5) Redundancy Suppression
Candidate Scoring:
- (3) Spatial Penalty
- Score = s(c|V) × ΔJ(c|V)
--------------------------
|
v
Select Best View & Update V
|
v
Repeat Until Budget B or No Eligible View
Table C. Leave-one-component-out ablation of the coverage-aware view-selection method on Arena.
| Configuration | Directional Coverage | Position Support | Spatial Penalty | Height Quotas | Redundancy Suppression | PSNR ↑ | SSIM ↑ | LPIPS ↓ |
|---|---|---|---|---|---|---|---|---|
| w/o Directional Coverage | — | ✓ | ✓ | ✓ | ✓ | 23.636 | 0.6367 | 0.5201 |
| w/o Position Support | ✓ | — | ✓ | ✓ | ✓ | 25.639 | 0.7524 | 0.4224 |
| w/o Spatial Penalty | ✓ | ✓ | — | ✓ | ✓ | 27.133 | 0.8013 | 0.3824 |
| w/o Height Quotas | ✓ | ✓ | ✓ | — | ✓ | 25.374 | 0.7423 | 0.4233 |
| w/o Redundancy Suppression | ✓ | ✓ | ✓ | ✓ | — | 28.042 | 0.8125 | 0.3994 |
| Ours (Full Method) | ✓ | ✓ | ✓ | ✓ | ✓ | 28.368 | 0.8312 | 0.3354 |
Results and Discussion.
The ablation results demonstrate the importance of the individual components in our view-selection pipeline. Removing directional coverage causes the largest performance degradation (−4.73 dB PSNR), highlighting the importance of observing scene surfaces from complementary viewing directions. Removing height quotas and distinct-position support also leads to substantial drops (−2.99 dB and −2.73 dB, respectively), supporting the need for balanced height coverage and qualified observations from multiple camera positions.
Spatial penalties and redundancy suppression provide further improvements, with the latter showing a particularly noticeable effect on LPIPS. Overall, these results confirm that high-quality free-6DoF reconstruction requires not only broad surface coverage, but also complementary viewing directions, multi-position support, and balanced spatial allocation.
Response to Reviewer 6rMG 1
We thank the reviewer for the constructive feedback and for recognizing the practical value of geometry-guided camera acquisition using engine-native lighting probes. We appreciate the suggestions regarding comparisons with simpler selection strategies, component-level ablations, and computational efficiency.
1. Comparison with Simpler View-Selection Strategies (Weakness 1)
We agree that comparisons against prescribed-view acquisition alone do not fully establish whether the improvements arise from the proposed joint objective or simply from broader spatial sampling.
Experiment 1: View Selection Strategy Comparison
To address this concern, we conducted controlled comparisons on Arena, using the same source mesh, validated candidate camera pool, image budget, fixed-exposure HDR reconstruction, training settings, and independent free-6DoF test views.
We compare our method against three simpler strategies:
Table A. Comparison of view-selection strategies on Arena.
Results and Discussion.
Spatially uniform sampling and greedy surface coverage achieve similar performance, suggesting that broader spatial sampling or maximizing single-best surface observation quality alone is insufficient for high-quality free-6DoF reconstruction.
In contrast, our full method improves PSNR by 6.73 dB, 3.81 dB, and 3.51 dB over random sampling, spatially uniform sampling, and greedy surface coverage, respectively, with consistent improvements in SSIM and LPIPS.
These results demonstrate the additional benefits of our joint selection strategy beyond broad spatial coverage alone, highlighting the importance of complementary observations from diverse viewing directions and distinct camera positions.