- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents RemixGS, a feed-forward Gaussian Splatting model designed to scale to larger multi-view inputs. Its encoder alternates per-view attention with a view-register mixer that routes cross-view interactions through a small set of learned registers, avoiding dense attention across all image patches. Its decoder uses interleaved geometry and texture blocks with one-way geometry-to-texture guidance, separately predicting geometric attributes and color. Experiments demonstrate competitive rendering quality and improved computational efficiency.
Critical strengths
- Clear Insight for the Scalable Cross-View Interaction.
The view-register mixer provides a clear and effective mechanism for reducing cross-view attention costs. The efficiency analysis and measured runtime results support its scalability as the number of input views increases.
- Comprehensive Experimental Results.
The experimental results demonstrate strong reconstruction quality and computational efficiency across a range of input settings.
Critical weaknesses
1. Insufficient Component Analysis.
The contributions of the two main components are not sufficiently disentangled. The register-count ablation does not establish the effect of replacing dense attention, while the decoder ablation changes both the processing structure and attribute separation. A controlled comparison combining each encoder with each decoder would better establish their individual quality–efficiency benefits.
2. Limited Baseline Comparisons.
The experiments are inadequate to support the broad performance claims. The main evaluation includes only TokenGS and QuerySplat; additional critical baselines, such as VolSplat [1], FreeSplat [2], GaussianGraphNetwork [3] and ZPressor [4], should be considered under matched settings. The supplementary zero-shot evaluation does not establish a clear advantage over the strongest compared methods, and differences in training data and evaluation scenes further limit its conclusiveness.
References
[1] Weijie Wang et al. “VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Prediction.” ECCV, 2026.
[2] Yunsong Wang et al. “FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenes.” NeurIPS, 2024.
[3] Shengjun Zhang et al. “Gaussian Graph Network: Learning Efficient and Generalizable Gaussian Representations from Multi-view Images.” NeurIPS, 2024.
[4] Weijie Wang et al. “ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGS.” NeurIPS, 2025.
Questions for authors
- Clarify the Individual Component Contributions.
Could the authors provide a controlled ablation to isolate their individual contributions of the encoder and decoder?
- Broader Baseline Evaluation.
Could the authors include comparisons with additional relevant baselines under matched settings to substantiate the claimed advantages?
- Evidence for Reduced Geometry–Appearance Compensation.
What direct evidence supports the claim that the decoder prevents appearance from absorbing geometric errors?
6 comments
Response to Reviewer 9fGf (Part 2 of 2)
Q3 — direct evidence for reduced geometry–appearance compensation
In the revision, we measure geometry directly against a pseudo ground truth from Depth Anything 3 [1] (Appendix F). With our encoder, our interleaved decoder raises PSNR by 1.52 and 1.78 dB, and at the same time lowers depth AbsRel from 0.555 to 0.497 and from 0.343 to 0.329. With the dense encoder, AbsRel rises instead, as its features show almost no cross-view consistency (0.001–0.050 vs. 0.243–0.408 for ours), so the geometry stream, which does not read appearance, has no consistent cue. The interleaved decoder is itself less sensitive to feature noise than the single-stream decoder with both encoders, and least with ours (2.15 vs. 4.37 at V=64).
| V=16 | V=64 | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Encoder | Decoder | AbsRel↓ | δ1↑ | Cons.↑ | Sens.↓ | AbsRel↓ | δ1↑ | Cons.↑ | Sens.↓ |
| Dense (TokenGS) | TokenGS | 0.574 | 0.574 | 0.001 | 4.96 | 0.430 | 0.643 | 0.027 | 3.08 |
| Ours | TokenGS | 0.555 | 0.579 | 0.353 | 7.03 | 0.343 | 0.680 | 0.408 | 4.37 |
| Dense (TokenGS) | Interleaved (ours) | 0.713 | 0.537 | 0.032 | 4.02 | 0.444 | 0.655 | 0.050 | 2.75 |
| Ours | Interleaved (ours) | 0.497 | 0.632 | 0.243 | 3.12 | 0.329 | 0.700 | 0.276 | 2.15 |
Cons. is the cross-view consistency of the features the decoder reads, and Sens. the depth sensitivity to 1% feature noise.
These results show that, in our RemixGS, the interleaved decoder reduces the compensation of geometric errors by appearance.
References
[1] Haotong Lin et al. "Depth Anything 3: Recovering the Visual Space from Any Views." ICLR, 2026.
Following Up on Our Responses
Dear Reviewer 9fGf,
We are grateful for your constructive suggestions, which have helped us improve the paper considerably. Our rebuttal responds to all of your comments point by point. Among other additions, we ran an encoder × decoder ablation with a dense-attention control and isolated the effect of the branch split (W1). We also compared with VolSplat, FreeSplat, GGN, and ZPressor under matched settings, clarified the RE10K zero-shot results (W2), and provided direct evidence for the decoder mechanism (Q3).
We would be thankful for a brief note on whether these additions address your concerns before the discussion ends in less than one day. Please feel free to let us know if further clarification would help.
Best regards,
The Authors of Submission 16065
Response to Reviewer 9fGf (Part 1 of 2)
We thank the reviewer for the careful reading and for recognising the clear insight of the view-register mixer and the comprehensive experiments. Below we respond to each weakness (W) and question (Q) in turn.
W1 / Q1 — controlled encoder × decoder ablation
We add this comparison in the revision: the dense encoder of TokenGS and our view-register encoder are each combined with the single-path decoder of TokenGS and our interleaved decoder, and all four models are trained from scratch for 150k steps under one recipe (Table 4 and Section 4.3).
PSNR in dB at 256×256 on DL3DV-10K.
Decoder. Our interleaved decoder raises PSNR by 1.52 to 2.61 dB with our encoder and by 0.72 to 2.07 dB with the dense one.
Encoder. With our interleaved decoder, the dense encoder of TokenGS is only 0.05 dB higher than our encoder in average PSNR over the six settings, but at a much higher cost: its cost grows quadratically with the view count, whereas ours grows close to linearly, because views exchange information only through a few registers (Section 3.1).
W2 / Q2 — additional baselines and the zero-shot evaluation
In the revision, we add ZPressor [1] on our DL3DV settings (Appendix D), and VolSplat [2] and GGN [3], which release no DL3DV weights, on the RealEstate10K zero-shot protocol (Appendix C). FreeSplat [4] releases ScanNet weights only, so we do not evaluate it. Our RemixGS has higher PSNR than all three in every setting, and its lead grows with the view count: over ZPressor from 2.68 to 3.04 dB (32 to 96 views, full trajectory) and over VolSplat from 1.27 to 5.01 dB (12 to 36 views). From 8 to 96 views, it takes 0.047–0.218 s and 1.4–3.6 GB, against 0.190–0.249 s and 3.7–4.3 GB for ZPressor. ZPressor is better in LPIPS (0.361 vs. 0.440 at 96 views), as is VolSplat at 12 and 24 views (0.111 and 0.145 vs. 0.170 and 0.160); both are trained with an LPIPS loss.
Zero-shot evaluation. Our RemixGS is trained on DL3DV only (due to limited GPU resources), whereas the other methods in Table 5 are trained on RealEstate10K, so this evaluation measures transfer rather than ranking. Even so, our RemixGS is on par with ZPressor-6 [1] at 24 and 36 views (0.11 dB lower and 0.01 dB higher in PSNR); only the state-of-the-art GlobalSplat-32K [5] is clearly ahead. From 12 to 36 views, our PSNR rises from 27.91 to 28.51 dB, while that of GlobalSplat-32K falls from 29.54 to 29.39 dB and that of LVSM [6] from 28.65 to 26.38 dB. Our test set holds 5,345 of the 5,601 scenes, as the rest are no longer available; VolSplat and GGN are evaluated on these same scenes.
Fine-tuning on RealEstate10K. To reduce the difference in training data, we fine-tune our RemixGS on the RealEstate10K training split for 10k steps with the same losses (no perceptual loss) and evaluate it under the same protocol. Its PSNR rises by 0.52–0.68 dB, to 28.43, 29.03 and 29.19 dB at 12, 24 and 36 views: 0.52 and 0.69 dB above ZPressor-6 at 24 and 36 views, and within 0.45 and 0.20 dB of GlobalSplat-32K, with higher SSIM (0.904 and 0.907 vs. 0.901 and 0.899). Both remain better in LPIPS.
References
[1] Weijie Wang et al. "ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGS." NeurIPS, 2025.
[2] Weijie Wang et al. "VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Prediction." ECCV, 2026.
[3] Shengjun Zhang et al. "Gaussian Graph Network: Learning Efficient and Generalizable Gaussian Representations from Multi-view Images." NeurIPS, 2024.
[4] Yunsong Wang et al. "FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenes." NeurIPS, 2024.
[5] Roni Itkin et al. "GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokens." ECCV, 2026.
[6] Haian Jin et al. "LVSM: A Large View Synthesis Model with Minimal 3D Inductive Bias." ICLR, 2025.