- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper puts forward StratGS, a Gaussian Splatting framework built for surface reconstruction on transparent and semi‑transparent scenes. It especially targets the nested‑scene issue: the outer transparent shell messes up the model’s ability to learn inner structures.
The method has three main parts. First, after regular joint optimization, the authors add a two‑stage nested‑scene refinement step: lock down the shell and background Gaussians that have already been learned, limit how much the shell contributes to rendering, initialize brand‑new interior Gaussians using SfM, and keep optimizing only the inner representation. Second, they propose Range‑Aware Depth Extraction (RADE). Instead of squashing all Gaussian evidence along one ray into just one depth value, it pulls out multiple candidate depths by using several search ranges that keep getting wider step‑by‑step. Third comes FUSE: run TSDF integration independently for each depth query to get high‑quality fine meshes. Meanwhile generate a coarse mesh with a larger truncation distance, and only fill in areas missed by the fine reconstruction using this coarse mesh.
On top of that, the paper introduces TransNest, which contains eight synthetic nested scenes. It provides separate ground‑truth geometry for both enclosing shells and inner objects. This lets us evaluate how well the outer transparent structure and inner objects get reconstructed separately.
Experiments are run on αSurf, TransLab, ClearPose, TransNest and DTU benchmarks. StratGS achieves the lowest average geometric error across the first three transparent‑scene benchmarks, as well as the lowest CD on all eight TransNest scenes. Especially on TransNest, StratGS hits a mean CD of 3.970 mm, compared to 8.499 mm from TSGS. The interior GT‑to‑mesh distance drops from TSGS’s 12.317 mm down to 4.580 mm.
Critical strengths
This paper doesn’t only look at whether the transparent shell gets reconstructed. It also explicitly checks whether structures behind or inside that shell can be recovered. That’s harder to solve and way more useful for real‑world applications compared to evaluating only the outer transparent surface. They test across multiple datasets: αSurf, TransLab, ClearPose, TransNest and DTU, instead of relying only on one benchmark. Main results hold fairly consistently across tests. The nested‑refinement ablation gives solid experimental backing. The evaluation setup for TransNest is well‑thought‑out. Ground‑truth data for enclosures and interiors are given separately. That way you can’t hide bad inner‑object reconstruction behind an overall CD metric.
Critical weaknesses
- The cumulative, expanding‑range search setup still includes strong peaks from surfaces up front. Just grabbing the maximum‑weight window within each range doesn’t force later searches to pick deeper surfaces.
- A key preprocessing step: splitting shell / interior / background for nested refinement is not explained thoroughly. If manual region marking or scene‑specific information is required, the method becomes less general‑purpose. If it works fully automatically, they should lay out exactly how the algorithm runs.
- In Related Work they talk about NU‑NeRF as a nested transparent‑object reconstruction approach. But NU‑NeRF results are missing from the TransNest comparison in Table 2. This alone isn’t a reason to reject the paper, but authors should either add those numbers or explain why a fair comparison under the TransNest protocol isn’t feasible.
- FUSE prevents coarse‑mesh outputs from duplicating geometry already covered by fine meshes. However, that reference fine mesh itself comes from multiple fine meshes generated via separate RADE queries. If different thresholds end up reconstructing the exact same physical surface, readers want to know: do they have any mechanism to remove duplicates or merge overlapping fine outputs?
Questions for authors
- For Equation (4): is calculated purely from . When rendering jointly with and , how exactly do those shell weights (after attenuation) participate in front‑to‑back compositing? Could you write out the complete mathematical definition for the Stage‑II renderer?
- Before Stage II, how exactly do you tell shell, interior and background regions apart? Is this process 100 % automatic? Do you need manually set bounding boxes, masks, ground‑truth meshes, or other scene‑specific inputs?
- Could you run ablation studies for RADE and FUSE on TransNest? Please report CD, F1@5mm, Outer GT‑to‑mesh distance and Inner GT‑to‑mesh distance. Testing them on TransNest makes far more sense for what RADE and FUSE were built for, compared to only testing on TransLab.
- How sensitive is your method to hyper‑parameters ? Are these parameters fixed for every scene within one dataset, or tuned separately scene‑by‑scene?
- Related Work introduces NU‑NeRF as a method built for nested transparent objects. Why are there no NU‑NeRF numbers in the TransNest Table 2? Are there issues with evaluation protocols or implementation?
- Figure 3 notes that both TSGS and StratGS use TransNormal‑2 priors for TransNest experiments. For baseline TSGS results on αSurf, TransLab and ClearPose — do those also use the exact same TransNormal‑2 priors? If not, adding a controlled comparison for TSGS + TransNormal‑2 would help separate performance gains brought by the normal prior versus improvements coming from StratGS itself.
4 comments
Q3. RADE/FUSE ablation
Following your suggestion, we added the full TransNest ablation with trained models, cameras, and extraction regions fixed.
The results show that both modules contribute: with FUSE off, enabling RADE reduces CD by 51.89% and improves F1 by 113.73%; with RADE on, enabling FUSE reduces CD by 71.36% and improves F1 by 67.47%.
Table 2. RADE/FUSE ablations on TransNest.
| RADE | FUSE | CD (mm) ↓ | F1@5mm ↑ | Outer (mm) ↓ | Inner (mm) ↓ |
|---|---|---|---|---|---|
| Off | Off | 28.81 | 0.233 | 58.58 | 12.22 |
| Off | On | 26.37 | 0.281 | 53.64 | 9.32 |
| On | Off | 13.86 | 0.498 | 24.32 | 6.08 |
| On | On | 3.97 | 0.834 | 2.62 | 4.58 |
Q4. Hyperparameter sensitivity
We use one parameter configuration per dataset and do not tune them scene by scene. ClearPose contains more complex real scenes and more noise, so we use five thresholds. The other datasets use three. We also add a new ablation on TransNest: increasing the count from three to five reduces CD by 11.6% and improves F1 by 1.3% (Table 3).
Table 3. Threshold-count comparison on TransNest, with trained models and other extraction settings fixed.
| Thresholds | CD↓ (mm) | F1↑ |
|---|---|---|
| 3 | 3.97 | 0.834 |
| 5 | 3.51 | 0.845 |
Q5. NU-NeRF comparison
We add NU-NeRF comparisons on TransNest. Our mean reconstruction error is lower (Table 4). On the same TransNest scenes and an A100 GPU, the complete NU-NeRF two-stage run takes at least 40 hours, whereas StratGS takes about 30 minutes. We will add these runtime results to the supplement.
Table 4. Mean reconstruction results on TransNest.
| Method | CD (mm) ↓ | F1@5mm ↑ |
|---|---|---|
| NU-NeRF | 24.82 | 0.224 |
| StratGS | 3.97 | 0.834 |
Q6. Normal-prior comparison
We report TSGS and StratGS directly for each benchmark in Table 5. For ClearPose, TransLab, and αSurf, we additionally provide paired controls that change only the normal prior.
Table 5. TSGS–StratGS comparison under the listed normal priors.
| Dataset | Comparison | bidirectional CD↓ | F1↑ |
|---|---|---|---|
| TransNest | TSGS + TN2 → StratGS + TN2 | 8.50 → 3.97 | 0.611 → 0.834 |
| ClearPose | TSGS original prior → TSGS + TN2 → Ours | 13.44 → 12.61 → 9.71 | 0.366 → 0.378 → 0.623 |
| αSurf | TSGS original prior → TSGS + TN2 → Ours | 0.90 → 1.03 → 0.52 | 0.774 → 0.794 → 0.723 |
| TransLab | TSGS original prior → TSGS + TN2 → Ours | 1.69 → 1.66 → 1.55 | 0.959 → 0.959 → 0.959 |
αSurf uses CD (×100) and [email protected]; the other datasets use CD in mm and F1@5mm. The last three paired controls fix the other TSGS settings and change only the normal prior. On αSurf, TN2 improves F1 by 0.020 but increases CD by 0.13, so it is not an overall gain on this benchmark.
Thank you again for your constructive and helpful reviews. As the discussion period draws to a close, we’d welcome any follow-up questions about this analysis or the method. If our response has addressed your concerns, we hope you’ll revisit your assessment in light of the additional evidence. Thank you again for your time and help in improving the quality of this paper.
Thank you very much for your reply. It has addressed my concerns perfectly.
We sincerely thank the reviewer for the time and care invested in this careful and constructive review, and we are especially grateful for the recognition of interior recovery, the benchmark evaluation, and TransNest's separate ground truth. These comments have directly helped us sharpen both the evidence and the presentation, and we address each of them in turn below.
W1 & W4. Repeated queries and surface evidence
FUSE does not deduplicate the fine meshes. It removes only coarse regions near them. Later queries can repeat earlier peaks: query 3 repeats query 2 on 74.40% of jointly valid rays, while combined straight-ray GT-group coverage rises from 23.96% to 41.73%.
Q1. Stage-II shell compositing
We keep the standard 3DGS front-to-back order. For a ray, let Tis=∏j<i,gj∈Gs(1−αj) be the shell-only transmittance before shell Gaussian i. The shell weights are wis=αiTismin(1,∑j∈GsαjTjsβ),β=0.2. If the accumulated shell weight is below β, it is unchanged. Otherwise all shell weights are scaled proportionally. Interior and background Gaussians keep the standard 3DGS rule. Thus the shell remains visible but receives at most 0.2 total opacity along a ray.
In implementation, the scaled shell weights are converted back to effective alphas, and transmittance is recomputed over all depth-ordered Gaussians, including the interior and background:
\qquad C=\sum_i c_i\,\bar\alpha_i\prod_{j<i}\left(1-\bar\alpha_j\right)+T\,C_{\mathrm{bg}},$$ where $\bar\alpha_i=\bar\alpha_i^s$ for $i\in G_s$ and $\bar\alpha_i=\alpha_i$ otherwise, $c_i$ is the color of Gaussian $i$, $T=\prod_i(1-\bar\alpha_i)$, and $C_{\mathrm{bg}}$ is the background color. Together with the shell-weight formula above (Eq. (4)), these expressions for the effective alphas (Eq. (5)) and the final composition (Eq. (6)) give the complete Stage-II renderer. ## Q2. Automatic separation of shell, interior, and background The separation is fully automatic. It uses only the input RGB images, cameras, the Stage-I representation, and the SfM point cloud—no bounding boxes, masks, or GT meshes. Given these inputs, the three regions are separated in two steps. **Interior.** We first select SfM points that Stage I does not explain: $$\mathcal P_{\mathrm{in}}=\{p\in\mathcal P_{\mathrm{SfM}}:\ R(p)\land B(p)\land M(p)\},$$ where $R(p)$ is a high Stage-I rendering residual, $B(p)$ places the point behind the first depth peak, i.e. behind the shell, and $M(p)$ requires depth, normal, and color support from multiple viewing directions. Accepted points initialize the new interior group $\mathcal{G}_n$. **Shell, replacement, and background.** Among the Stage-I Gaussians, multi-view depth, normal, color, and SfM evidence identify the supported shell Gaussians $\mathcal{G}_s$. Gaussians with behind-shell support but no consistent front-side evidence are removed as conflicting interior representations $\mathcal{G}_r$. All remaining Gaussians, including the background, form the retained context group $\mathcal{G}_c=\mathcal{G}_0\setminus(\mathcal{G}_s\cup\mathcal{G}_r)$. The Stage-II representation is therefore $\mathcal{G}_s\cup\mathcal{G}_c\cup\mathcal{G}_n$, with $\mathcal{G}_r$ excluded before Stage II. **Training permissions.** $\mathcal{G}_s$ keeps position, shape, and opacity fixed and updates color only. $\mathcal{G}_c$ keeps position and shape fixed, while color and opacity may be updated. $\mathcal{G}_n$ is fully trainable and is the only group subject to densification and pruning. Stage II optimizes the full image jointly rendered from $\mathcal{G}_s\cup\mathcal{G}_c\cup\mathcal{G}_n$ with the RGB term in Eq. (3). **Controls.** Retaining $\mathcal{G}_r$ and optimizing it with the same $\mathcal{G}_n$ changes CD/F1 from **3.97/0.834** to **4.60/0.812**, while Inner rises from 4.58 to 6.73 mm. Additionally unfreezing the position and shape of $\mathcal{G}_c$ changes CD/F1 from **3.97/0.834** to **5.00/0.754**. So fixing the geometry of $\mathcal{G}_c$ mainly protects the overall reconstruction. **Table 1. Controls on Stage-II group assignment and permissions (TransNest).** | Setting | CD (mm) ↓ | F1\@5mm ↑ | Inner (mm) ↓ | | ----------------------------------------------------------- | --------: | --------: | -----------: | | Retain $\mathcal{G}_r$ and optimize it with $\mathcal{G}_n$ | 4.60 | 0.812 | 6.73 | | Unfreeze position and shape of $\mathcal{G}_c$ | 5.00 | 0.754 | **4.54** | | Full method (Ours) | **3.97** | **0.834** | 4.58 |