- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Chameleon, a training-based framework for cross-domain object compositing. It addresses the scarcity of training data by proposing a reverse data generation pipeline (ChameleonDataset) that uses real stylized composites and input degradation. To preserve foreground identity while adapting to background styles, the framework utilizes a style-content disentangled encoder trained via Signed Style-Content Graph Learning (SSCGL) and injects these representations into a diffusion transformer using Style Gap-Aware Anisotropic Modulation (SGAM).
Critical strengths
-
Novel Reverse Data Pipeline: Inverting the standard synthesis process by starting from real-image composites and degrading inputs avoids training models on synthetic distribution artifacts. This data construction approach is well-motivated and supported by distribution error measurements.
-
Effective Parameter-Efficient Architecture: The combination of SSCGL for disentangled feature representation and SGAM for conditional injection achieves strong qualitative and quantitative improvements while training a very small fraction of the network parameters via LoRA.
Critical weaknesses
-
Reliance on an Unvalidated VLM Rubric: The claim of state-of-the-art performance relies heavily on an unweighted VLM-based scoring rubric. Since the test cases overlap with the user study, reporting the statistical correlation between the VLM rubric and human evaluations is necessary to validate this automated metric.
-
Missing Clarification on Benchmark Separation: It is unclear whether the evaluation benchmark is strictly disjoint from the training data, given that both originate from the same underlying source corpora.
Questions for authors
-
Dataset Disjointness: Is ChameleonDataset_ev strictly disjoint from the training split, and what are the exact steps taken to prevent data leakage between them?
-
VLM Validation: What is the correlation coefficient between the VLM rubric scores and the human user study results across the overlapping evaluation cases?
4 comments
Response to Reviewer jNiZ (Part 2/2)
[W2, Q1] Dataset disjointness and prevention of data leakage.
We thank the reviewer for raising this important concern. **ChameleonDataset$_{ev}$ is constructed independently of ChameleonDataset$_{tr}_{tr}$ is built from existing stylization datasets ([2–4], Sec. 3.1, L211–213), whereas ChameleonDataset$_{ev}$ is independently collected from Pexels, Pixabay, and Unsplash ([5–7], Sec. 4.1, L455–457, and Appendix A.5). Thus, the two datasets do not originate from the same underlying source corpora.
To further verify disjointness and check for potential data leakage, we conduct multi-level near-duplicate detection using feature-level (SSCD, DINOv3) and pixel-level (image hashes, ORB) similarity checks (Fig. 16(a)). For each of the 156 evaluation images, we compute its highest SSCD similarity against the training set. Only four exceed the 0.45 threshold used for relative deduplication in DINOv2 [8] (Fig. 16(b)). We manually inspect threshold-flagged and top-ranked candidate pairs retrieved by all detectors, covering both foreground and background images, and find no confirmed near-duplicates (Fig. 16(c)).
These results support the separation of the evaluation benchmark from the training data. We have clarified the distinct data sources in Sec. 4.1 and added the verification protocol and results to Appendix A.5 (Fig. 16) of the revised manuscript (marked in red).
References.
[1] Spearman. The Proof and Measurement of Association Between Two Things. The American Journal of Psychology, 1987.
[2] Li et al. StyleTokenizer: Defining Image Style by a Single Instance for Controlling Diffusion Models. ECCV 2024.
[3] Liao et al. The ArtBench Dataset: Benchmarking Generative Models with Artworks. arXiv 2022.
[4] Ju et al. Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes. CVPR 2023.
[5] Pexels. Pexels. https://www.pexels.com, 2026.
[6] Pixabay. Pixabay. https://pixabay.com, 2026.
[7] Unsplash. Unsplash. https://unsplash.com, 2026.
[8] Oquab et al. DINOv2: Learning Robust Visual Features without Supervision. arXiv 2023.
[9] OpenAI. Introducing GPT-4.1 in the API. OpenAI, 2025.
[10] OpenAI. Introducing GPT-5.5. OpenAI, 2026.
[11] Anthropic. Introducing Claude Opus 5.5. Anthropic, 2026.
[12] Google DeepMind. Gemini 3.1 Pro Model Card. Google DeepMind, 2026.
Thank you for the detailed response and the additional experiments. Most of my concerns have been addressed, so I'm inclined to maintain my score.
We sincerely thank the reviewer for taking the time to review our response and additional analyses. We are glad that we have addressed most of your concerns, and we appreciate your constructive feedback, which has helped improve our manuscript.
Response to Reviewer jNiZ (Part 1/2)
We appreciate Reviewer jNiZ's recognition of our reverse data pipeline and parameter-efficient framework, as well as their helpful comments.
[W1, Q2] VLM rubric validation against human preferences.
We thank the reviewer for this valuable suggestion. To validate the VLM-based evaluation rubric, we conducted a statistical correlation analysis between VLM rubric scores and human evaluations from our existing user study, comprising 50 participants and 30 overlapping evaluation cases (Tab. 4). Furthermore, to assess robustness across VLM judges, we additionally evaluate four VLMs: GPT-4.1 [9], GPT-5.5 [10], Opus 5.5 [11], and Gemini 3.1 Pro [12].
Specifically, the VLM scores each method on identity, style, and composition (0–3 per criterion, see Appendix H.1), while in the user study, participants select the best among five cross-domain compositing methods for each criterion, yielding human preference rates (win rates, see Appendix C.4). For each case, we compute Spearman's rank correlation (ρ) [1] between the method rankings based on VLM scores and human preference rates, and average the correlations across all 30 cases. The user study's “Overall” criterion corresponds to the VLM's “Composition and Harmonization” criterion (Appendix C.4, L1992–1995, and Appendix H.1), while the total comparison uses the sum of the three criterion scores (identity, style, and composition) for each VLM judge and the mean of the corresponding human preference rates (identity, style, and overall).
The GPT-4o judge used for the VLM evaluation reported in our paper achieves a total-score correlation of ρ=0.75, with 83% pairwise agreement. To assess robustness across VLM judges, we further evaluate GPT-4.1, GPT-5.5, Opus 5.5, and Gemini 3.1 Pro using the same inputs, evaluation prompt, and scoring criteria. Across all five judges, total-score correlations range from 0.66 to 0.82, with 71%–83% pairwise agreement (Tab. 15). Tie rate measures the proportion of method pairs with identical VLM total scores, while pairwise agreement excludes pairs tied in either evaluation. Moreover, our method consistently achieves the highest mean total score across all five VLM judges (Tab. 16).
These results demonstrate consistent positive correlations between the VLM rubric and human preferences. We have added the validation protocol and results to Appendix C.4 and referenced this analysis in Sec. 4.1 of the revised manuscript (marked in red).