- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies training-free composition of multiple LoRAs for image generation. It proposes two mechanisms: SR-LoRA uses cross-attention maps associated with each LoRA’s trigger words to spatially weight their noise predictions, while CLAC uses the overlap between attention maps to decide whether to blend the anchor LoRA’s attention keys and values into another LoRA’s generation pass. The paper evaluates these mechanisms on Stable Diffusion v1.5 across several concept combinations and reports ablations, hyperparameter sensitivity, and inference cost.
Critical strengths
- The paper evaluates spatial routing and cross-adapter attention conditioning separately, which helps clarify the role of each component.
- The experiments cover reality and anime subsets and report results across several concept pair types, hyperparameters, and inference costs.
Critical weaknesses
-
The evaluation lacks character+character compositions. The two-concept experiments mainly cover character+clothing, character+object, character+style, and character+background. When two characters appear together, identity mixing, missing subjects, and spatial conflicts may be more pronounced. The current experiments therefore do not sufficiently test the method in this important multi-subject setting. Related work such as OMG (ECCV 2024) evaluates man+woman, man+man, and woman+woman compositions, while LoRAShop also demonstrates compositions of multiple character LoRAs. I cite these works to motivate evaluating this setting, rather than to request additional numerical baselines.
-
The citation and description of the main FreeFuse baseline are inconsistent with the cited work. The bibliography attributes FreeFuse to “Liang Jian et al., 2025,” whereas the linked paper, FreeFuse: Multi-Subject LoRA Fusion via Adaptive Token-Level Routing at Test Time, is by Yaoli Liu, Yao-Xiang Ding, and Kun Zhou. Moreover, this submission describes FreeFuse as hard per-pixel argmax routing of multiple UNet noise predictions and states that SR-LoRA recovers FreeFuse as the temperature approaches zero. This differs from the cited FreeFuse paper’s routing of LoRA residuals at the token level. Because FreeFuse is a main baseline, this discrepancy affects the interpretation of both the comparisons and the claimed methodological relationship.
Questions for authors
- The choice of attention layers lacks an ablation. The method aggregates subject attention maps from the UNet mid block and up_blocks.1, but does not compare other layers or layer combinations, or directly assess the localization accuracy of the resulting maps. Both SR-LoRA’s spatial routing and CLAC’s overlap decision depend on these maps, so the effect of this design choice warrants further analysis.
- Could the authors clarify exactly how the “FreeFuse” baseline was implemented? Does it reproduce the cited paper? If the experiment instead uses a hard-argmax noise-routing baseline constructed by the authors, please distinguish it from FreeFuse and revise the citation and the statement that SR-LoRA recovers FreeFuse as the temperature approaches zero. Please also check the accuracy of the other references.
- Could the authors provide quantitative results and visual examples for character+character compositions? In particular, it would be useful to assess whether both characters appear, whether each retains its identity, and whether their identities become mixed.