- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper addresses continual personalization of text-to-image diffusion models, where concepts are learned one after another without access to earlier data. CLASP replaces per-concept adapters with one fixed-size hypernetwork. The hypernetwork maps a task embedding for each concept to LoRA updates on the cross-attention layers of a frozen backbone. Task embeddings are orthogonalized with Gram–Schmidt, and an output-space regularizer keeps the updates generated for earlier concepts close to their previous values. The same hypernetwork also produces bounding-box-conditioned tokens for a gated attention branch, which controls where the concept is placed. On CIFC with SD-1.5, the authors report higher image alignment than CIDM at matched text alignment, about 4× lower forgetting, constant parameter cost up to 100 concepts, and correct quadrant placement in all tested cases.
Critical strengths
-
Solid experiments that support the main claims. Results are averaged over several seeds, and the authors define a significance threshold in advance. Forgetting is clearly lower than CIDM and sequential fine-tuning. The generated adapters perform on par with independently trained per-concept LoRAs, and inference cost does not grow with the number of concepts.
-
Analyses that are useful beyond this method. The ablations show that a generated adapter depends heavily on the output projection, and this holds on both backbones. They also show that attribute words in training captions compete with the adapter for encoding the concept's appearance. Both findings are relevant to other adapter and hypernetwork work.
-
Appearance and placement come from the same network. Spatial control adds no per-concept parameters. In the reported setting, the concept consistently appears in the requested region, and identity preservation improves when a box is given.
Critical weaknesses
-
Limited methodological novelty, and the paper's account of prior work is inaccurate. The content module largely follows von Oswald et al. (2020), combined with hypernetwork-generated LoRA updates of the kind used in UnHype (Wójcik et al., 2026). The paper describes UnHype only as a concept-removal method, which understates how close the two architectures are. The placement module combines known components: GLIGEN-style gating (Li et al., 2023), a parallel attention branch similar to IP-Adapter (Ye et al., 2023), and MultiDiffusion-style bootstrapping (Bar-Tal et al., 2023). Gram–Schmidt is presented as part of the design, but the paper's own ablations show no measurable benefit from it. Closely related work on grounded personalization, such as GroundingBooth (Xiong et al., 2024), and on continual personalization, such as ConceptGuard (Guo et al., 2025), is not discussed.
-
The comparisons are too narrow to support the scalability claim. CIDM (Dong et al., 2024) is the only main baseline, and its results are taken from the original paper rather than reproduced under the same setup. Scaling beyond CIDM's 37-concept limit is a weak reference point, because that limit comes from CIDM's implementation rather than from the problem. SeqLoRA (Parsa et al., 2026) already learns about a hundred concepts sequentially on the same backbone and dataset, and CNS (Liao et al., 2025) also avoids adapter fusion. Both papers are cited but not compared against.
-
The method depends on several practical assumptions. At inference, the concept index must be supplied, since the model cannot identify the concept from the prompt. Training requires captions with attribute words removed, and the captions for the added concepts are generated by an LLM. Placement training relies on segmentation-based composites, some of which needed manual mask selection.
References not cited in the submission
[1] Ye, H., Zhang, J., Liu, S., Han, X., and Yang, W. IP-Adapter: Text compatible image prompt adapter for text-to-image diffusion models. arXiv:2308.06721, 2023.
[2] Xiong, Z., Xiong, W., Shi, J., Zhang, H., Song, Y., and Jacobs, N. GroundingBooth: Grounding text-to-image customization. arXiv:2409.08520, 2024.
[3] Guo, S., et al. ConceptGuard: Continual personalized text-to-image generation with forgetting and confusion mitigation. In CVPR, 2025.
Questions for authors
Please see Critical Weaknesses.