- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes PhysLayer, a box-conditioned image decomposition framework. It separates a composite image into three layers: an amodal foreground RGBA layer, a clean background with the target removed, and a signed additive interaction residual for capturing shadows and reflections. To train the model, the authors build PhysLayer-30K, a synthetic dataset rendered with Blender Cycles using counterfactual object removal, and mix it with 10K samples from RevealLayer. The proposed Phys-MMDiT is built upon Qwen-Image-Edit-2511 and the OmniAlpha RGBA-VAE and is fine-tuned with LoRA using flow matching. The training also includes several regional, perceptual, reconstruction, and cross-attention alignment losses. The authors evaluate the method on foreground matting (RefMatte-RW100), object removal (OBER-Test), and three-layer decomposition. For the last task, the evaluation relies mainly on their self-rendered PhysLayer-Test split, which contains 150 images.
Critical strengths
- The proposed PhysLayer-30K dataset is valuable. Using Blender Cycles to render paired scene states—with and without the target object under fixed lighting and camera parameters—is a clean way to obtain aligned ground truth for amodal completion and effect removal, bypassing the hallucination artifacts common in 2D pseudo-labeling pipelines.
Critical weaknesses
1. Quality of the proposed PhysLayer-30K and PhysLayer-Test datasets
1.1. Reproducibility concerns
It is unclear whether PhysLayer-30K and PhysLayer-Test will be made publicly available. If not, this would raise reproducibility concerns.
1.2. Low diversity, asset reuse, and lack of transparency about the datasets
a. Limited diversity. Based on the visualizations provided in the paper and the statistics in Figure 2, PhysLayer-30K is centered on household scenes. There is a severe lack of human figures, animals, vegetation, soft, deformable objects and materials (such as clothing, hair, and fluids), and scenes involving complex interactions in natural outdoor environments, which significantly limits its practical value. This is echoed by Table 7: the final training dataset includes 10K external RevealLayer samples for foreground generation, in addition to the proposed PhysLayer-30K. These external samples are likely to contribute substantially to tasks related to foreground generation, such as foreground matting (Table 1) and layer decomposition (Table 3), which weakens the case for the usefulness of PhysLayer-30K.
b. Missing asset statistics. The paper does not provide necessary details about the diversity of PhysLayer-30K and PhysLayer-Test. It reports only the number of images, without specifying the numbers of unique foreground and background assets. Therefore, we do not know how much redundancy exists in PhysLayer-30K and PhysLayer-Test. For example, as shown in Figure 15, the last two test cases use the same background image.
2. Unconvincing generalization and selective evaluation
2.1. In-domain testing
Based on the visualizations and descriptions in the paper, PhysLayer-Test is generated using exactly the same Blender pipeline as PhysLayer-30K. Therefore, PhysLayer’s better performance than the comparison models and baselines on this test set is expected. Moreover, PhysLayer-Test is a small test set of only 150 images. Details such as the proportions of scenes involving occlusions, shadows, or reflections, as well as the proportion of normal scenes, are not provided. It is also unclear whether the dataset’s quality has been verified by humans. Without such details, the evaluation on PhysLayer-Test may be less informative and unrepresentative.
On the external RevealLayer benchmark (Table 10), PhysLayer underperforms the RevealLayer baseline across almost all metrics. Furthermore, the real-world comparison in Table 9 relies on a manually screened 150-image subset of PrismLayer Real, without specifying the selection criteria, raising concerns about cherry-picking.
2.2. Insufficient testing and evaluation of the core claim: effect separation
Residuals are evaluated only within the ground-truth interaction support, without comparison to a simple residual baseline. The evaluations do not establish whether the model invents effects elsewhere.
2.3. Ill-defined downstream utility of the proposed setting: amodal foreground and scene-locked residual
Although line 046 explicitly claims that “the residual represents target-induced effects rather than serving only as an auxiliary training signal,” the paper never demonstrates a single downstream application that actually uses the predicted residual . In fact, is completely discarded in matting (Table 1), object removal (Table 2), and even the iterative decomposition examples (Appendix, Figures 8–11). Worse, combining amodal foreground completion with a signed additive RGB residual creates a fundamental contradiction for downstream editing:
a. No relocatability. The main practical reason to hallucinate occluded foreground regions through amodal completion is to move, scale, or reorder the object. Unlike LayerDecomp, which represents shadows and reflections as transparent RGBA layers that can move with the object, PhysLayer predicts a position-locked RGB difference baked into the original background texture. As acknowledged in the paper, moving the foreground invalidates and requires synthesizing new effects from scratch.
b. Broken recomposition under occlusion. Because completes occluded regions while the occluder remains baked into , directly compositing causes the occluded target to appear in front of its occluder. Preventing this requires the visibility mask (Eq. 2), which the model does not predict at inference time. Table 11 relies on privileged ground-truth .
2.4. Missing user study
For image generation tasks, especially in this decomposition setting, human evaluation is necessary to assess the details of the decomposed layers. Given the authors’ claim in Figure 6 that existing real-world ground-truth backgrounds retain shadow artifacts, a blind human preference study is particularly essential to validate perceptual quality, effect cleanliness, and amodal plausibility on real images, yet none is provided.
2.5. Missing key ablations
The paper uses a mixture of training datasets: PhysLayer-30K and 10K external RevealLayer samples. Therefore, we do not know which part of the training data accounts for the improvements on the real-world test datasets, RefMatte-RW100 and OBER-Test. How does a baseline trained only on the 10K RevealLayer samples, with exactly the same architecture and losses where applicable, perform on RefMatte-RW100, OBER-Test, and the RevealLayer benchmark? Similarly, why does adding PhysLayer-30K lead to a performance drop across most metrics on the RevealLayer benchmark in Table 10?
Moreover, the w/o R_layer ablation also turns off , so the residual’s contribution is confounded.
2.6. Limited novelty
Considering the concerns discussed above, the relatively novel component is the residual layer, which is ill-defined and insufficiently evaluated.
Questions for authors
Please take a look at the weaknesses. That’s all I wanted to ask.