- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents TriRender to address the cost and tessellation sensitivity of transformer-based rendering from triangle meshes. The core contribution is a surface-area weighting in the attention architecture, TriRender constructs spatially cohesive clusters, and regenerates coarse representations through the area-weighted pooling. The paper also utilizes a scene encoder to combine local triangle interactions with global coarse context, and an image decoder to expand the selected clusters based on visibility and attention relevance. TriRender is initialized from RenderFormer and further fine-tuned using synthetic scenes. The paper provide detailed comparisons and ablations in both the main paper and supplementary to demonstrate the improved rendering at high triangle counts and a quality–efficiency trade-off.
Critical strengths
-
The central contribution Surface-area weighting addresses a concrete tessellation-dependent failure mode in previous pipeline and the authors provide a coherent formulation. The surface-integral interpretation supplies a common measure for coarse and fine tokens, and the provided experiments on removing reweighting demonstrates that the proposed weighting has a substantial empirical effect.
-
The proposed hierarchical pipeline achieves a favorable measured quality–efficiency trade-off. Compared with dense attention using reweighting alone, the full model reduces runtime with minor PSNR degradation. The supplementary experiments further extend runtime evaluation to meshes containing one million triangles. These extensive experiments validates the effectiveness of the proposed framework.
-
The spatial hierarchy is well-supported by detailed ablation. The authors provide ablations by replacing the proposed component-constrained, area-balanced grouping with uniform clustering. The results show that the PSNR reduces reduces and worsens the other reported metrics. This provide further evidence to support the importance of preserving spatially coherent regions when constructing coarse representations.
Critical weaknesses
-
The architectural contribution is difficult to separate from additional fine-tuning. The paper fine-tuned the model on approximately 125k scenes, but comparable adaptation of RenderFormer and RenderFormer-V2 is not clearly specified. This leaves uncertainty about how much of the observed improvement comes from the proposed representation and attention mechanisms. Finetuning the baselines using the same datasets can further clarify the gains.
-
Some details are missing to characterize the practical scope of the efficiency gains completely. It is unclear whether timings include hierarchy construction and visibility computation, while the paper acknowledges that disconnected triangles can limit cluster compression. These missing details is important for readers to assess whether the measured gains transfer to other high-resolution mesh structures. I suggest the authors provide corresponding experiments.
-
More direct quantitative validations are required for the claimed tessellation robustness. In the paper, Figure 4 provides a controlled attention visualization, but Figure 6 compares scenes with different triangle counts. Measuring the final-image consistency under nonuniform retriangulation of fixed scenes would more directly test the central robustness claim. I also suggest the authors provide more qualitative comparison in the paper to support the robustness claim.
-
There are some details that need to be clarified for better presentation: a) The method describes hierarchical cross-attention but Table 1 in the paper refers to "LLCA stage-2", the abbreviation should be defined or replaced with consistent terminology. b) The default attention configuration should be stated explicitly. The authors discusses different cluster counts in the paper, but does not clearly collect the default cluster count, retrieval budget, and window size used for the full model. This should be stated explicitly for better paper presentation. c) A few grammatical errors should be corrected. In Section 5.2, “but increasing inference time” should be “but increases inference time”; in Section 4.2, “possibly because the reweighted attention” should be “possibly because of the reweighted attention.”
Questions for authors
For fixed geometry, materials, lighting, and cameras, how much do rendered images change under different nonuniform triangulations, with and without area weighting? I think addressing this by adding more qualitative comparisons can directly test the claimed output robustness.
I appreciate the architectural designs of the paper, but based on the aforementioned missing details and no "borderline option", I currently voted a negative score. I would consider raising the scores if author can address my concerns during the rebuttal period.
4 comments
Thank you for the rebuttal. I appreciate the clarifications, especially the tessellation robustness and timing and visibility part. I also appreciate the clarification for the terminology. Please include these details in the revised paper. Now I have the remaining suggestions for the authors:
- For the architectural contribution part, I suggest the authors providing the fine-tuned RenderFormer and RenderFormer-V2 results for a more comprehensive experiments.
- For the disconnected triangles and cluster compression part, I suggest adding this experiment in the paper and in the rebuttal discussion for a better presentation.
- Also, I think it would be better if you include more qualitative comparison for the area reweighting ablation to better present the contribution of this component.
Follow-up Response
Thank you for your feedback. We have uploaded a revised rebuttal addressing your comments.
- Table 1 now includes results for the fine-tuned versions of RenderFormer and RenderFormer-V2.
- Figure 11 and the accompanying text now include visual results and a more detailed description of the experiment.
- Table 3 and Figure 8 have been added to present the ablation results.
Thank you for the follow-up discussion and for revising the paper. I suggest highlighting the newly added figures and corresponding description in the paper so that AC can have better assessment of the paper. The results partly addressed my concerns and I have raised my score accordingly. Good luck!
Response to Reviewer CXGC
We thank the reviewer for their constructive feedback and the opportunity to clarify the remaining concerns. We hope the additional experiments and explanations below help address these points.
1. Architectural contribution. The main benefit of hierarchical attention is lower inference time. Tab. 1 and Fig. 7 indicate that most of the quality gain comes from surface-area reweighting. Removing reweighting reduces PSNR from 24.50 to 17.66 dB, while dense attention with reweighting reaches 25.02 dB.
We also fine-tuned RenderFormer and found that its rendering quality was close to that of the released checkpoint. We can use the fine-tuned version in the revised comparison if helpful. For RenderFormer-V2, we fine-tuned it and found that it performed worse than the released checkpoint. This degradation may be related to the broader range of scenes and higher image resolutions used in the original RenderFormer-V2 training. Notably, both TriRender and RenderFormer-V2 similarly combine local attention with scene summaries in the stage 1. Taken together, the W/o reweighting and Uniform clustering ablations help assess two design differences between the models by testing surface-area reweighting and component-constrained, area-balanced clustering, respectively.
2. Timing and visibility. TriRender's reported inference times include on-the-fly hierarchy construction and CUDA rasterization for visibility. Hierarchy construction, the Stage 1 forward pass, and the Stage 2 forward pass account for approximately 20%, 60%, and 20% of the total runtime, respectively. CUDA rasterization takes only a few milliseconds. We will include these timing details in the paper.
Disconnected triangles and cluster compression. In the Fox in the Wild scene (the first panel of supplementary Fig. 1), grouping all leaves into a single cluster reduces PSNR (by approximately 0.5dB on the entire image and 3dB measured over the region containing the fallen leaves) compared with assigning each leaf to its own cluster. With many leaves, however, one cluster per leaf can quickly exceed our target cluster budget. We will include this experiment in the revision.
3. Tessellation robustness. We compare TriRender with its W/o Reweighting variant on the original scenes (Original) and two variants with tessellated main objects (e.g., Lucy), named Dense and Very Dense. These sets contain an average of approximately 6k, 109k, and 435k triangles per scene, respectively.
We will include both quantitative and qualitative comparisons across these scene variants in the revised manuscript.
4. Terminology and defaults. LLCA stage-2 in Table 1 is a legacy abbreviation for Stage 2 hierarchical cross-attention. We use 512 clusters, retrieve the top 8 clusters per patch and attention head in Stage 2, and use a Stage 1 sliding-window radius of 64 positions in the triangle sequence. We will correct the wording in Sections 4.2 and 5.2.