- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
TRACE focuses on multi-objective alignment for text-to-image models, aiming to simultaneously improve compositional generation, text rendering, and visual preference alignment while mitigating gradient conflicts and forgetting across objectives. Training is organized into single-objective chunks, with anchor losses preserving capabilities associated with temporarily inactive objectives. Experiments on FLUX.1-dev and SD3.5-M show simultaneous improvements in GenEval, OCR, and PickScore, demonstrating the effectiveness of the method.
Critical strengths
- The paper provides a detailed analysis of multi-objective conflicts by examining both gradient compatibility during joint training and catastrophic forgetting during sequential training. The empirical measurements provide strong evidence supporting these observations.
- The paper presents extensive ablation studies that demonstrate the effectiveness of the individual components of TRACE.
- The paper provides a thorough analysis of forgetting mitigation. By experimentally comparing different anchor coefficients, the authors demonstrate a reasonable trade-off between retaining previously learned capabilities and adapting to new objectives.
Critical weaknesses
-
TRACE measures the optimization gains of different objectives at different denoising stages through short probing runs and uses these measurements to derive temporal routing weights. The same weights are then used to impose anchor constraints on temporarily inactive objectives. However, the rationale for using the same temporal routing weights for both optimization and forgetting protection is not sufficiently justified or validated.
-
The improvements brought by Tc-LoRA may partially stem from its additional parameter capacity. Tc-LoRA introduces a small number of extra parameters compared to standard LoRA. Including a parameter-matched standard LoRA baseline would help address this concern and better isolate the contribution of timestep conditioning.
-
The evaluation of multi-objective alignment is not sufficiently comprehensive. In particular, the experiments do not adequately demonstrate whether the model can simultaneously satisfy multiple objectives within a single generated image.
Questions for authors
-
The rationale for using the same temporal routing weights for both optimization and forgetting protection in TRACE is not sufficiently justified or validated.
-
The improvements brought by Tc-LoRA may partially stem from its additional parameter capacity. Tc-LoRA introduces a small number of extra parameters compared to standard LoRA. Including a parameter-matched standard LoRA baseline would help address this concern.
-
The evaluation of multi-objective alignment is not sufficiently comprehensive. In particular, the experiments do not adequately demonstrate whether the model can simultaneously satisfy multiple objectives within a single generated image.
If these concerns are adequately addressed, I would consider raising my score.