- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper suggests a training-free method to enhance pre-trained 3D flow-matching models' texture handling. In practice, they suggest averaging features obtained from patches of images and combining these with the original image features in a dynamically scheduler-conditioned way. The suggested method achieves a boost in performance across 3 tested models.
Critical strengths
- The paper is mostly well-written and easy to follow.
- The qualitative results are impressive, and the suggested method looks practical.
Critical weaknesses
-
Novelty - the suggested method is too simple. While quantitatively effective, the suggested observation is neither deeply explored nor explained. And while functional, its novelty is very limited.
-
Image feature additivity - while interesting and a bit counterintuitive, the authors mention these observations with limited experiments backing them up. The qualitative visuals, while convincing, don't really explain the TSNE plot shown, which does show a difference in the semantic space. And the authors don't try to further explain this or explore it deeply.
-
Limited ablation studies - The authors show general component ablation, but do not explore different design choices like weighting the patches according to masks, different scheduling schemes for the dynamic integration, or even different aggregation methods that are not a simple weighted average.
Questions for authors
Please see weaknesses
5 comments
I thank the authors for their response. I acknowledge the empirical usefulness of the suggested method. But, I still hold the opinion that the observation in the paper is technically simple and under-explored (theoretically or in-depth empirically under various conditions) which really limits the contribution of the paper. While its hard to asses novelty, I'm still under the impression that the contribution in the paper does not qualify for a main conference paper.
Thank you for acknowledging the empirical usefulness of our method. We would like to clarify the methodological contribution and the evidence supporting it.
BTC3D introduces a training-free conditioning framework for preserving fine-grained details in pretrained image-to-3D generation. Its design builds on the empirical compositionality and compatibility of independently encoded local image features examined in Sec. 3.1. BTCemb uses these properties to construct a local condition through foreground-based tile aggregation, while DyCond adjusts the relative contributions of individual tiles during sampling, keeping the global/local fusion ratio fixed. Together, these components enable complementary local information to improve detail preservation through the pretrained generator’s existing conditioning interface.
The empirical investigation includes controlled frequency-response analysis (Appendix C.1) and global/local feature comparisons with same-category negatives across 210 objects from 105 categories (Appendix C.2). We have further added controlled comparisons in Appendix D.6 of the revised manuscript, using matched crops, encoder resolution, generation seeds, and global/local fusion coefficients for the tile-based variants. Foreground-mask weighting improves PSNR, SSIM, and LPIPS over uniform averaging, and dynamic conditioning further improves all three metrics. These analyses examine both the underlying feature properties and the contributions of the proposed components.
Regarding practical applicability, we demonstrate consistent improvements across TRELLIS, TRELLIS.2, and Hunyuan3D-2.1, covering DINOv2 and DINOv3 encoders on both 3D-Arena and Toys4K. This supports the applicability of the conditioning framework across different pretrained pipelines without retraining or modifying model parameters.
We would appreciate clarification on which specific aspect of the proposed framework you consider insufficiently novel, or which experimental condition remains insufficiently examined in light of these analyses. We would be happy to discuss these points further and provide additional clarification as needed.
We appreciate your feedback and recognition about our clear presentation, impressive qualitative results, and the practical value of our method. Below, we address each of your concerns.
W1: BTC3D provides a training-free conditioning framework for improving fine-grained detail preservation in pretrained image-to-3D pipelines. It combines local crop encoding, foreground-based feature aggregation, and dynamic conditioning while maintaining compatibility with the pretrained generator and keeping its parameters unchanged.
In our paper, global conditioning refers to the full-image DINO representation, including spatial patch tokens. BTCemb independently encodes local crops and aggregates their features using foreground-based weights, providing fine-grained local information that complements the global condition. This design is motivated by the empirical observations of image feature additivity and compatibility in Sec. 3.1, with further supporting analyses in Appendix C.1–C.2.
DyCond further adjusts the normalized tile weights during texture generation, changing the relative contributions of individual tiles. BTCemb and DyCond combine local crop encoding, foreground-based feature aggregation, and dynamic tile weighting to enhance detail preservation in pretrained image-to-3D pipelines without retraining. To further evaluate the contributions of these components, we have added controlled comparisons in Appendix D.6 of the revised manuscript. The results show that foreground-mask weighting improves generation quality over uniform averaging, while dynamic conditioning provides further improvements across PSNR, SSIM, and LPIPS. These additional results support the effectiveness of the proposed combination.
W2: In this work, image feature additivity refers to the empirical compositional compatibility of independently encoded tile features within the pretrained conditioning space. Fig. 2(a) illustrates the correspondence between global and averaged tile embeddings. The differences between them do not contradict this observation, since compositional compatibility does not require the aggregated tile embedding to be identical to the global embedding.
To complement the t-SNE visualization, Appendix C.2 reports a quantitative evaluation of global-local feature compatibility on 210 Toys4K objects from 105 categories, with two objects per category. We compute the cosine similarity between each global feature and its corresponding aggregated tile feature. We additionally compare against a non-matching global feature from the same category. The results are summarized below as mean [95% bootstrap confidence interval].
The averaged tile embedding remains aligned with its corresponding global feature, and BTCemb further improves this alignment. The positive same-category margins support input-specific semantic correspondence beyond coarse category separation. These results provide quantitative evidence for the empirical compositional compatibility of global and local image features.
At the generation level, Fig. 2(b) shows that averaged tile embeddings can directly condition the pretrained generator. Appendix C.2 further provides a complementary example in which the averaged conditioning embeddings of an original image and its color-modified version produce a result combining color characteristics from both inputs. Together, the feature comparisons and generation examples support the empirical observation motivating our method.
W3: We have added controlled comparisons of tile weighting and dynamic conditioning on all 101 images of 3D-Arena using TRELLIS.2. The tile-based variants share the same crops, encoder resolution, generation seeds, and fixed global/local fusion ratio. All configurations use the same total number of sampling steps.
Our method improves all three metrics over uniform averaging, and dynamic conditioning provides further improvements, achieving the best results among the evaluated configurations. These quantitative results and corresponding visual comparisons have been added to Appendix D.6.
The schedule ablations in Appendix D.2–D.3 further support the local-to-global tile expansion direction and the choice of β=2 among the evaluated settings. Appendix D.4 additionally provides intermediate renderings, detail crops, and tile weights to illustrate differences between static and dynamic conditioning.