- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Blue Mage, a traceable training record system for text-to-image flow models. It records the samples, random variables, and conditioning information for each training slot, and stores concept exposure records, dense checkpoints, and recoverable training states. The authors train 0.5B to 3.9B MMDiT models on datasets ranging from 1M to 100M images, and use the full training trajectories to study attribute binding and memorization dynamics, including the relationship between exposure and learning, and how repeated samples and caption variation affect instance retrieval.
Critical strengths
1、The traceable training record itself is a useful experimental infrastructure. It links saved checkpoints with reconstructable per-slot training events, concept exposure histories, and recoverable optimizer states. Compared with common releases of open text-to-image models, this is clearly more complete and has the potential to support many future studies of training dynamics. 2、The memorization experiments are carefully controlled. The repeated, varied-caption, and loss-masked runs share the same initialization and training data stream, and differ only in the specified canary treatment. Compared with directly comparing independently trained models, this matched design makes the conclusions about memorization easier to interpret and more convincing.
Critical weaknesses
1、The evidence for generalizing training dynamics across runs is still limited. Most learning-dynamics conclusions are based on a single training realization for each condition. A large number of prompts, generation seeds, and canaries can characterize one training trajectory well, but cannot measure training-level variance caused by different initializations or data orders. This is especially important because a central question of the paper is when these phenomena emerge during training. 2、The binding conclusions rely heavily on an evaluator that may be sensitive to wording. The main binding analysis uses a single VLM judge, while the appendix shows that changing only the wording of the question can noticeably change entity-presence judgments on the same images. Since acquisition onset is defined by a threshold on this judge score, the robustness of some training-trajectory conclusions to the evaluator remains unclear.
Questions for authors
1、Have the main trajectory-level findings, such as the weak relationship between exposure and onset and the rise and subsequent decline of crossed binding, been reproduced in an independent training run? Replication even at a smaller model or data scale would be helpful. 2、How robust are the binding results to the choice of evaluator? Results from a second calibrated VLM evaluator or a small set of human annotations would help validate these conclusions.
Thank you for your response. I appreciate the clarification and find it reasonable. However, with respect, I would like to maintain my original evaluation.