- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper answers "whether stronger attention to references improves id-preservation" through a training-free intervention that adds a constant log α to the attention logits from all target-image queries to a selected set of reference VAE keys. On MultiID-Bench with Qwen-Image-Edit-2511 and FLUX.2-klein-base-9B, α = 1.5 improves both reference and ground-truth face similarity on every backbone–split combination, at the cost of higher copy-paste preference and slightly lower aesthetic scores; whole-image biasing is slightly stronger than face-local biasing on ordinary references, an edge that vanishes once injected attention mass is matched, whereas face-local biasing scores higher on a 49-example small-face set. The appendix contains extensive audits on copy-paste geometry, identity blending, completeness, a text-key pathway control, XVerseBench transfer, and a video extension.
Critical strengths
- Extensive experiments almost answer all the concerns I raised while reading the article. The statistical reporting is unusually careful for this area.
- Simple yet effective plug and play method.
- Some experimental insights are rather intriguing.
Critical weaknesses
- Practical method, yet no practical problem. My major concern is, the main problems answered in this paper are kind of, well, predictable. By FaceRoute, I thought there would be some routing method to solve the practical problems like blending issues or layout issues, but it seems that the proposed methods are too simple for an ICLR main track paper.
- No same-backbone trade-off comparison. The only comparisons are routed vs. unrouted and whole vs. face-local. Without other ways of increasing reference reliance on the same backbone (e.g., attention temperature, reference resolution or scale, identity emphasis in the prompt), plotted on the same (CP, simGT) or (preference, simGT) plane, it is impossible to tell whether FaceRoute is a better knob or simply a knob. The system-level comparison does not resolve this: WithAnyone is better than Qwen + FaceRoute-F (α = 2.5) on simref, simGT and CP simultaneously (Table 1).
Questions for authors
- Just out of curiosity, have you tried applying this to adapter-based methods like PuLID or WithAnyone? It seems simple enough to transfer this method to those cross-attention-based ID-preserving models. You can just answer no to this question since I agree that it is more valuable to orient your time to base models like Qwen and FLUX.
- Can you provide more discussion about M.8? Since many previous works adopted attention masks for isolation, I found this insight quite surprising.
3 comments
Revierwer Response
Thank you for the clarification. My questions are fully resolved.
I believe the insights presented in this paper are valuable to the academic community. For the record, I would like to note that I would raise my rating to somewhere between “Strong Accept” and “Weak Accept,” but it seems there is no such an option.
Thank you
Thank you very much for your time and for the supportive assessment. We are glad the additional experiments resolved your questions, and your suggestions made the paper stronger. All new results are included in the revised version.
Response to Reviewer 1JUc
Thank you for the encouraging review. Brief answers below; full details are in the new Appendix Z.
Q1. PuLID / WithAnyone. We tried WithAnyone (PuLID needs its own trained adapter and did not fit in the rebuttal period). WithAnyone has no reference VAE tokens in joint attention, so we added the same bias (α=1.5) to its SigLIP face branch. ΔSimGT: P3 −0.0002 [−0.0020, 0.0016]; P2 +0.0003 [−0.0007, 0.0014]. Nothing changes, likely because an identity-trained model already exploits its identity branch, whereas frozen editors under-use their reference tokens, which is where FaceRoute helps (App. Z.5).
Q2. Isolation (M.8). With FaceRoute-W on, we add hard masks between references (Qwen P3, α=2):
Isolation lowers identity and raises wrong-identity similarity. Our reading: prior mask-based works train with the masks, while a frozen editor was trained with all reference tokens mutually visible, so cutting paths at inference removes context it relies on. For frozen editors, re-weighting works better than cutting.
W1. Practical problem; simplicity. The problem is identity dilution in frozen multi-reference editors: faces drift from the references as the number of people grows. Existing fixes train adapters or require layout inputs; FaceRoute is a one-line, training-free bias that works on two backbones. On 50 new five-person groups (public MultiID-Bench P1 inputs, α=1.5 fixed in advance, FLUX.2-klein, CFG 4; SimGT is computed against each identity's P1 ground-truth image; paired 95% CI vs. baseline; paired 95% CI vs. baseline):
All 50 groups are shown in App. Z.6.
W2. A better knob or simply a knob? We ran the comparison you proposed: same frozen backbone, references, prompts and seeds, all on one (ΔCP, ΔSimGT) plane (P3, paired vs. the same baseline; Fig. 12, App. Z.1). Temperature divides the attention logits of the target-image queries by τ, over all keys; reference area changes the reference size actually fed to the VAE; the identity-emphasis prompt appends the same identity-preserving instruction to every prompt; K/V scaling multiplies the reference keys or values.
The FaceRoute arms are the only tested controls that improve identity while keeping image quality; the alternatives give no identity gain. On Qwen, aesthetics stay at the baseline level for FaceRoute (baseline 5.47, F 5.44, W 5.35) but fall to 3.80 for K ×1.25 and 4.37 for GRAG-style d=1.2. Reference resolution acts as an information bottleneck (the benchmark references are already tightly framed around the person), not as a substitute for routing. On Qwen, F matches W's gain at a lower CP. The WithAnyone row in Table 1 is cross-system context (identity-trained vs. training-free); the same-backbone plane above answers the knob question.
We hope this addresses your concerns and are happy to provide anything further.