- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents AsySplat, an asymmetric architecture for efficient feed-forward 3D Gaussian reconstruction from wide-coverage multi-view images. The model processes coarse-grained tokens with a inter-view high-capacity geometry branch, while a intra-view lightweight appearance branch processes fine-grained tokens. Experiments demonstrate competitive novel-view synthesis quality and more impressive efficiency than LongLRM, alongside comparisons with recent methods and architectural ablations.
Critical strengths
- The asymmetric architecture offers a practical approach to reducing computation by combining coarse-grained cross-view processing with lightweight fine-grained appearance modeling.
- The insight is quite interesting, showing us that high-precision geometry is not a must for high-quality rendering and high-precision are generally easier to model than geometry recovery.
Critical weaknesses
- The claimed geometry–appearance specialization is not sufficiently established. Both branches exchange features and jointly predict Gaussian attributes after fusion, without direct evidence of distinct functional roles.
- The source of the rendering-quality improvements remains unclear. The asymmetric structure directly motivates computational savings, but does not by itself explain improved reconstruction quality. The gains may instead come from accompanying engineering choices, such as increased attention allocation.
Questions for authors
- What evidence shows that the two branches specialize in geometry and appearance, respectively, given that Gaussian attributes are predicted jointly from fused features?
- How does the current evidence distinguish “appearance is easier to model” from “additional cross-view processing is unnecessary after receiving geometry-branch features”?
- Under matched parameter budgets and Mamba-to-attention ratios, how much rendering-quality improvement comes specifically from the asymmetric token allocation?
- For table 2, does the advantage over LongLRM persist with longer post-optimization budgets, or do the quality–runtime curves converge or cross?
5 comments
Thank You and a Gentle Follow-up
Dear Reviewer wETR,
Thank you again for your constructive comments. In response to your questions and suggestions, We have added experiments and clarifications to provide a more detailed breakdown of the model’s internal architecture. We hope these additions help address your concerns.
With less than two days remaining in the discussion period, we would like to kindly follow up to see whether you have any remaining concerns or would find further clarification helpful. We would be happy to provide additional explanations. Thank you sincerely for your time and thoughtful feedback.
Best regards,
The Authors
Thank you for the detailed responses and additional experiments. The controlled comparisons clarify the sources of the efficiency and rendering-quality gains. However, I remain concerned that the architectural design and current evidence do not sufficiently establish the claimed geometry–appearance specialization, beyond a division between coarse cross-view processing and fine intra-view processing. Both branches exchange information and jointly predict Gaussian attributes after fusion. Moreover, the strongly asymmetric dependence suggested by the low-resolution connection ablations in Table 5a is not reproduced in the high-resolution results in Table A3d. While I appreciate the practical efficiency gains, the central interpretation of the two branches remains insufficiently supported. I will therefore maintain my rating of Weak Reject.
Official Comment by Authors
We sincerely thank you for your constructive comments and suggestions. Below, we provide clarifications and additional experimental results, responding to the weaknesses (W) and the questions (Q) in your review.
R3-W1 / Q1: Evidence that the branches specialize.
We test this directly on the trained 98M model by replacing one branch's output with its scene mean at inference on 20 DL3DV-140 scenes. Specifically, we replace every output token of one branch with its average over all views and positions.
The table above shows that replacing the appearance branch output with its mean severely degrades rendering, while largely preserving geometry. In contrast, replacing the geometry branch output with its mean destroys both rendering and geometry. Geometry is thus carried by the coarse geometry branch, while the fine appearance branch supplies the appearance details required for accurate rendering.
R3-Q2: "Appearance is easier" vs "cross-view processing is unnecessary after receiving geometry features".
Ablation experiments in Tab.5a answer this by removing the coarse-to-fine link and fine-to-coarse link, respectively:
If intra-frame processing were sufficient only because of the geometry features, the variant without coarse-to-fine would be expected to fail, but it loses only 0.14 dB. This directly demonstrates that appearance can be modeled from per-frame cues alone, without geometry features or cross-view interaction. Removing the opposite link costs 1.9 dB. Thus, the geometry branch relies heavily on appearance features, while appearance is easier to model and benefits little from cross-view interaction.
R3-Q3 / W2: Improvement from asymmetric token allocation.
Under matched parameter budgets and Mamba-to-attention ratios, [R1-W1/Q1] shows that asymmetric token allocation does not improve rendering, i.e., Two branches (8,8) versus asymmetric (16,8), but brings significant efficiency improvement.
To isolate the Mamba-to-attention ratio, we compare LongLRM models trained with exactly the same recipe and losses. The table below shows that, shrinking LongLRM from 142M to 99M at its 7:1 ratio costs 0.39 dB. Raising the attention ratio of the 99M model to 4:4 gains 0.52 dB, more than the parameters removed. A higher attention ratio therefore improves quality, and our model benefits from it. We also train our model with LongLRM's losses. With the losses, parameters and ratio all matched with LongLRM, our model is still better.
Our improvement over LongLRM thus mainly comes from two parts. (i) The asymmetric allocation makes a high attention ratio affordable, since our inter-frame layers operate on 4× fewer tokens. (ii) Decoupled modeling keeps fine-grained tokens throughout the network at a low cost, whereas LongLRM merges its tokens to a coarser granularity at an intermediate layer.
R3-Q4: Longer optimization.
Please refer to Fig.A2 in the revision. The quality-runtime curves neither converge nor cross up to 200 iterations.