- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This article proposes AnyLayer, a unified framework for multi-layer image decomposition. Unlike existing methods that mainly focus on single-target decomposition or limited query modalities, AnyLayer supports heterogeneous queries such as text, point, box, and mask queries, and generates corresponding RGBA foreground layers and a background image simultaneously in a diffusion process. In order to solve the query–layer correspondence problem in multi-layer generation, the author proposes Layer-aligned Shared Position Encoding and Prompt-conditioned Attention Routing to reduce the impact of query order. The authors also design Hybrid Layer Attention to reduce the computational overhead of multi-layer inference. The experiment was conducted on RevealLayerBench and AnyLayerBench constructed by the author, and the results showed that the method can handle different query forms and maintain good performance and efficiency in high-cardinality layer decomposition scenarios.
Critical strengths
-
A targeted design has been proposed for the query–layer correspondence problem in multi-query and multi-layer generation. Existing methods typically focus on single-target decomposition, while AnyLayer studies how to maintain the correspondence between target queries and generated layers when multiple heterogeneous queries are input simultaneously. The combination of LSPE and PAR can alleviate the problem of target mixing caused by changes in query order, and relevant ablation experiments have also verified the effectiveness of these designs.
-
The experimental coverage is relatively rich, considering various query forms and high-cardinality scenarios. In addition to box/mask queries, the author also evaluated text, point, and mixed queries, and tested the performance of 5-15 layers. At the same time, the paper analyzed the inference efficiency and the role of different modules, and the overall experimental design was relatively complete.
Critical weaknesses
- The scale and reliability of the benchmark still need further verification. AnyLayerBench was constructed by the author themselves, with a test set size of 200 samples, and occluded regions and backgrounds were completed through GPT-Image. Although the author conducted manual screening, this ground truth constructed based on generative models may affect the reliability of the evaluation. For a task that emphasizes complex occlusion restoration and generalization ability, more validation on real-world layered datasets or manually annotated layer data is still needed.
- Lack of comparison with the most relevant baselines makes it difficult to fully demonstrate the advantages of joint generation. The paper emphasizes better efficiency and consistency compared to target-by-target processing methods, but does not compare sequential inference with existing single-target layer decomposition methods. For example, applying methods such as RLD/RefLayer to multiple queries separately and then combining them for output has not been validated for differences in quality, background consistency, and inference time compared to AnyLayer. In addition, there is currently a lack of sufficient competitive methods for comparing text/point/mixed queries.
Questions for authors
-
Invisible areas and backgrounds in AnyLayerBench are completed by GPT-Image. How can the author verify that this benchmark does not introduce evaluation bias related to generative models? Is there manual evaluation, real layer annotation data, or validation on other independent benchmarks? Additionally, are 200 test images sufficient to represent model performance for high complexity generation tasks?
-
The paper proposes that joint multi-layer generation has advantages over single-target decomposition methods, but why is there no sequential inference comparison with existing single-target decomposition methods? For example, how does RLD/RefLayer compare to AnyLayer in terms of decomposition quality, background consistency, and inference efficiency when combined after multiple runs?
-
What are the essential differences between LSPE, PAR, and HLA and existing shared position encoding, attention routing, and sparse/local attention methods? How do the contributions brought by these modules differ from the combination of existing methods? Suggest the author further discuss this in the supplementary materials.
-
"Order-agnostic" is mainly validated through permutation experiments. Can the author further analyze whether this property has structural permutation equivariance, rather than just empirical robustness obtained through training?
-
Modern generative image editing models can now perform image editing directly through text instructions. What is the practical necessity of explicit layer decomposition in this context? Has the author conducted experiments to verify that the layer representation generated by AnyLayer can bring practical advantages in subsequent tasks such as multi-round editing, asset reuse, and editing consistency? In addition, the current model still relies heavily on a large diffusion backbone. Does the computational cost match its actual benefits?
-
This paper mainly reports carefully selected successful cases, lacking a systematic analysis of failure cases and performance limitations. The qualitative results in the paper and supplementary materials mainly show visually favorable cases, but provide limited information about AnyLayer failure modes. For challenging generation tasks such as multi-layer image decomposition, reporting only successful examples is not sufficient to evaluate the actual robustness and performance boundaries of the proposed method. The authors should provide more challenging cases and analyze failure scenarios, such as severe occlusion, blurred object boundaries, similar objects, or complex transparency. For these situations, the performance lower bound is more convincing. Understanding when and why the model fails is crucial for evaluating the actual reliability of AnyLayer.