- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents PhysInsert, a framework for physically plausible reference-guided object insertion that focuses on bidirectional object–scene interactions and cross-view adaptation. The authors construct InsertWorld, a synthetic dataset based on BlenderKit 3D assets, which provides strictly aligned images with and without the target object, along with reference images under multiple viewpoints and lighting conditions. Building on Qwen-Image-Edit-2511, the method introduces Geometry-Guided Adaptation (GGA), Counterfactual Object–Scene Supervision (COSS), and Soft-Mask Spatial Grounding (SSG). The paper evaluates object insertion quality, geometric adaptation, and physical plausibility through the synthetic PhysInsert-Bench benchmark, real-image test sets, and a human evaluation.
Critical strengths
- The paper addresses lighting, shadows, reflections, and viewpoint adaptation in object insertion, making the task practically relevant.
- The dataset provides strictly aligned images with and without the target object, as well as reference images captured from multiple viewpoints and under different lighting conditions.
- The experiments show that the proposed method outperforms existing models.
Critical weaknesses
InsertWorld is entirely synthetic, and all of its assets come from BlenderKit. Compared with real photographs, these rendered images lack realism and cover a relatively limited range of object categories and scenes. Reliance on a single asset source further limits the diversity of the dataset, making it difficult to adequately capture the complexity of real-world objects, materials, lighting, and interactions.
The ablation study shows that most of the performance gains come from fine-tuning on InsertWorld. Compared with PhysW., the additional improvements introduced by GGA, COSS, and SSG are not substantial, yet they incur considerable computational overhead. The full method increases inference time by approximately 51% relative to the original model.
Phy-VLM is an important metric for evaluating physical plausibility in this paper, but it is not reported in Tables 3, 4, or 5, leaving the evaluation of key experiments incomplete.
Questions for authors
- What object categories are included in InsertWorld, and how many samples does each category contain?
- Most of the presented examples appear close to the scene distribution of BlenderKit. Can the method generalize to inserting subjects from categories such as people and animals?
3 comments
I thank the authors for their response, and my concerns have been addressed.
Thank you for your thoughtful review and constructive feedback. We appreciate your time and are glad that our response has addressed your concerns.
Response to Reviewer CT2c
We sincerely thank the reviewer for recognizing the practical relevance of our task, the value of our dataset, and our experimental gains. We address concerns regarding dataset diversity and generalization, the benefits and computational costs of our method, and evaluation completeness.
W1. Synthetic data and diversity
We appreciate the reviewer’s concern regarding the realism and diversity of synthetic data. While synthetic rendering cannot fully capture real-world complexity, InsertWorld covers 18 object-category subgroups and diverse material properties (Appendix C, Figs. S2 and S4).
More importantly, synthetic rendering enables systematic variation of lighting and viewpoint for the same object, providing reference diversity that is difficult to obtain through real-world collection (Fig. S3).
Furthermore, PhysInsert also generalizes to real-world images despite being trained on synthetic data. It achieves the best PSNR and FID across the evaluated settings on 50 PhysInsert-Bench-Wild and 40 DreamBooth cases (Table 4), and receives the highest overall rating in our real-image user study (Fig. 4; Appendix R).
We acknowledge that relying on BlenderKit as our sole asset source may limit coverage of some real-world object and scene types. Incorporating additional asset sources could broaden this coverage.
References
[1] Kim et al. ORIDa: Object-centric Real-world Image Composition Dataset. CVPR 2025.
[2] Jampani et al. NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotations. NeurIPS 2023.
W2-a. Improvements beyond dataset fine-tuning
We thank the reviewer for highlighting the substantial gains from fine-tuning on InsertWorld. These gains highlight the importance of controlled training data for physically plausible insertion, and InsertWorld itself is a key contribution. At the same time, dataset-only fine-tuning (PhysW.) can still produce incorrect object scale, perspective, and scene framing, as illustrated in the new Fig. S8 (Appendix H). The original Table 5 already shows additional gains from our full method: PSNR improves from 22.53 to 24.40 dB, and FID decreases from 48.61 to 41.96; newly added Phy-VLM scores also improve from 3.48 to 3.75. Together with the original qualitative ablations in Fig. 6(b), these results show the complementary contributions of the dataset and method.
W2-b. Computational overhead
We appreciate the reviewer’s concern about inference efficiency. COSS and SSG are used only during training and introduce no additional inference-time cost. The inference overhead comes from GGA, which requires online VGGT feature extraction and an additional geometry stream. We report the detailed efficiency measurements in Appendix N (Table S6) and acknowledge this limitation in Appendix A of the revised manuscript.
W3. Completeness of Phy-VLM evaluation
Thank you for noting the missing Phy-VLM scores. Our initial evaluation used GPT-5.5, whose API cost constrained its scale. The more cost-efficient GPT-6.1-Sol enabled broader evaluation. We therefore upgraded the evaluator while retaining the original scoring prompt and averaging three ratings per output. We re-evaluated Table 2 and completed the previously missing Phy-VLM results in Tables 3–5. The new entries are marked in blue and labeled Phy-VLM⋆; Table 2 retains the earlier GPT-5.5 scores for reference. Appendix B, Fig. S1 further analyzes agreement with human ratings.
Q1. Object categories and sample counts
Appendix C now organizes 1,710 insertion targets into 18 category–rigidity subgroups (Fig. S2), covering rigid/non-rigid objects, metallic/non-metallic materials, opaque/translucent/transparent surfaces, and emissive/non-emissive properties. We also report category-wise counts for 12,951 training scene pairs (Fig. S4) and the diversity of 977 reference HDRIs (Fig. S3).
Q2. Transfer to people and animals
We appreciate this question. We added qualitative examples of people and animals inserted into varied environments using the existing checkpoint, without category-specific fine-tuning (Appendix D, Fig. S5). Our DreamBooth qualitative results also include animal examples (Appendix G, FigS7; FigS10, FigS11). Together, these examples illustrate potential cross-category generalization.