- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Owner-Fusion3D, a training-free framework for mask-guided local image-to-3D fusion. Given a structure image, an image-plane mask, and a content reference, OwnerFusion3D transfers reference appearance to the selected region while preserving the complementary structure. A Mask-Conditioned Ownership Estimator (MOE) is introduced that lifts the 2D mask to a sparse 3D owner field by contrasting frozen cross-attention responses to selected and competing foreground patches. An Owner-Exclusive Hierarchical Routing (OEHR) is proposed that uses this field to restrict every sparse query to its assigned condition source throughout the generator hierarchy. For multi-part fusion, Categorical Ownership Resolution (COR) resolves competing part assignments before the same routing process. OwnerFusion3D requires neither training nor 3D supervision and uses no post-hoc mesh or texture editing.
Critical strengths
Formulating mask-specified local image-to-3D fusion as sparse ownership discovery followed by source-specific execution in a frozen image-to-3D generator. OEHR enforces source-exclusive pre-softmax access across the shape-to-texture hierarchy; COR resolves ownership conflicts in multi-part fusion.
Critical weaknesses
What is the “COR” in figure 1?The contributions of Introduction section should be more detailed presented. The paper organization should be revised, such as figure 2 should be located at the top of Page 3. What is the “e_i” in figure3? How to obtain the O_LR or what process is conducted for O_LR in figure 3? Please clarify. The font size of figure 2 and figure 4 is too small. In the main paper, these are no description of Table 1. The layout of Table 1 and Table 2 should be adjusted.
Questions for authors
There are many cross-attentions and generation designs are proposed for 3D generation or 3D fusion, such as [1] DyFusion: Cross-attention 3D object detection with dynamic fusion. [2] Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attention [3] Pixal3D: Pixel-aligned 3D generation from images [4] Wonder3d++: Cross-domain diffusion for high-fidelity 3D generation from a single image [5] Direct3d: Scalable image-to-3d generation via 3d latent diffusion transformer [6] Instant3D: Instant Text-to-3D Generation There methods should be compared and discussed. The similar designs should be ablated in the experiments.
How to identify which qualitative result is best in figure 5 and figure 6? Do these datasets have the ground-truth? The better fair and accurate qualitative comparison should be provided. The corresponding quantitative results are provided, which will be more convincing. The color appearance has significant changes after fusion for the proposed method, how to address this problem under this model.
In ablation study, existing Mask-Conditioned Evidence and Owner-Exclusive Routing designs from other methods should be compared and discussed.
4 comments
Q1. Related 3D generation and attention methods
We appreciate these pointers. The Related Work section now discusses DyFusion, Ultra3D, Pixal3D, Wonder3D++, Direct3D, and Instant3D, describing the generation, attention, or fusion setting addressed by each. We position them as complementary directions rather than treating general-purpose generation methods as directly equivalent regional-fusion systems.
Q2. Interpreting the qualitative comparisons
Thank you for raising this point. We evaluate the qualitative results according to the task’s stated objectives, rather than ranking them by general visual appeal alone. The structure image defines the asset to preserve, the mask identifies the region to edit, and the content reference specifies the appearance to transfer within that region. A successful result should therefore both reflect the reference inside the selected region and preserve the complementary structure outside it.
The same criteria apply to multi-part fusion: each mask is paired with its own reference, and each reference should influence its assigned region without leaking into other parts. Thus, when comparing Figures 5 and 6, we assess whether the requested appearance is transferred to the specified region, whether distinct references remain associated with their intended regions, and whether unselected regions retain the structure image’s appearance. We do not treat these figures as ground-truth rankings; the quantitative metrics and multi-view VLM ratings provide complementary evidence for these objectives.
Appearance changes inside a selected region are part of the requested transfer. Changes outside the selected region, or mixing between references in the multi-part setting, instead indicate a failure of locality or source separation..
Q3. Ablations of ownership evidence and exclusive routing
The paper already documents these variants in Section 4.4 and Table 3, while Appendix D.1 provides their qualitative comparison under identical inputs. Appendix B further explains the fixed calibrated block-head readout and the All-block-head aggregation. Table 3 reports the quantitative results, whereas Appendix D.1 illustrates the corresponding behavioral differences.
In w/o MOE, mask-conditioned ownership estimation is removed, so no owner field is available for source-exclusive routing. In w/o OEHR, MOE still estimates the owner field, but it is not applied as an exclusive attention gate and both sources remain accessible. All-block-head retains MOE and OEHR and changes only the fixed calibrated readout to an unweighted average of available block-head evidence.
These ablations isolate the roles of ownership estimation, ownership enforcement, and readout selection within the same generator. We discuss the cited methods in Related Work, but do not present their internal modules as drop-in ablations: they use different tasks and generator interfaces, so transplanting their components into TRELLIS would not be a controlled reproduction of those methods.
I have read the authors' response and authors generally addressed my main concerns. I decide to maintain my original score.
Thank you for taking the time to read our responses and for letting us know. We appreciate that our clarifications have addressed your main concerns. We understand and respect your decision to retain your original rating. Thank you again for your thoughtful feedback and time.
Weaknesses
Thank you for pointing out that the contribution description, COR, and the presentation of the figures and tables needed to be clearer. We have revised the Introduction and Method sections so that MOE estimates sparse ownership from the user mask, OEHR enforces source-exclusive access during generation, and COR resolves competing assignments in multi-part fusion. COR is now introduced explicitly as the multi-part extension, and its role is explained before routing.
We have also clarified the transition from the attention evidence to the ownership field. For each active sparse query, e_i is the normalized preference for selected foreground evidence over competing unselected foreground evidence, aggregated across the fixed block-head readout. O_LR is not the score itself; it is the discrete ownership field obtained by thresholding the scores and regularizing assignments on the structure-derived sparse support. The regularization removes isolated assignments and performs score-qualified neighborhood expansion only within that support.
We adjusted the figure placement and layout for readability, including positioning Figure 2 at the top of page 3 and improving the presentation of Figures 2 and 4. The text now explains the symbols alongside the method equations. We also added an interpretation after Table 1 and adjusted the layouts of Tables 1 and 2. In particular, the comparison shows that OwnerFusion3D achieves the best single-mask LPIPS, CLIP-I, and DINO-I, as well as the best multi-part CLIP-I and DINO-I. Fuse3D obtains a slightly lower multi-part LPIPS. Table 2 provides complementary blinded multi-view VLM ratings.