- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents CoVA, a lightweight framework that improves flow-matching training by composing representations from a pretrained VAE without relying on additional pretrained visual encoders. The proposed method introduces an online latent composer trained with classification, masked latent reconstruction, and horizontal-flip consistency objectives to produce semantically informative and spatially structured features.
CoVA adopts a stage-adaptive training strategy: the composed features provide intermediate representation alignment during early training, while the composer's detached class posteriors are reused for sample-dependent soft label conditioning during later stages. The authors further investigate a magnitude confound in soft label conditioning, showing that changes in class-embedding magnitude can substantially affect generation quality and diversity independently of semantic interpolation.
Experiments on ImageNet 256×256 demonstrate improvements across three SiT model scales. In particular, CoVA reduces the unguided FID of SiT-XL/2 from 17.2 to 7.4 at 400K iterations while introducing only 8.5M training-only auxiliary parameters and no inference-time overhead. Extensive ablations investigate the composer objectives, training schedules, and direction–magnitude decomposition of soft conditioning.
Critical strengths
Strength 1: Efficient representation guidance with consistent improvements in unguided generation. CoVA provides an effective alternative to representation alignment methods that require large pretrained visual encoders. The proposed approach consistently improves unguided generation quality across SiT-B/2, SiT-L/2, and SiT-XL/2 while introducing relatively modest auxiliary training cost and no inference-time overhead. This makes the framework practically relevant for efficient generative-model training.
Strength 2: Insightful analysis of soft label conditioning. The direction–magnitude decomposition is a particularly valuable aspect of the paper. The experiments demonstrate that much of the apparent improvement from naive soft conditioning can be attributed to changes in conditioning magnitude, accompanied by a fidelity–coverage trade-off. The additional null-centered controls strengthen this observation. This analysis provides a useful methodological insight beyond the specific CoVA framework.
Critical weaknesses
Weakness 1: Unclear generalization beyond discrete class conditioning. The composer uses class supervision, while the late-stage SLC mechanism relies on an ImageNet-style class posterior and a learned class-embedding table. It is not clear how this component would extend to text-to-image generation, where the condition is typically a sequence of continuous text embeddings encoding compositional semantics. The current paper evaluates only ImageNet class-conditional generation, leaving the claimed broader applicability insufficiently established. This does not mean such an extension is impossible, but a concrete formulation or evidence is needed to assess its feasibility and significance.
Weakness 2: Insufficient comparison and positioning against related approaches. Self-Flow (Chefer et al., ICML 2026) also learns useful generative representations within a flow-matching framework without an external pretrained representation encoder and reports ImageNet 256×256 results with a SiT-XL/2 backbone. CoVA neither discusses nor benchmarks this closely related direction.
Because architectural details, training budgets, and evaluation protocols may differ, headline FID values alone are not an adequate comparison; a careful protocol-aware comparison is needed to establish CoVA's relative strengths, costs, and scope.
In addition, a matched early-stopped raw-VAE alignment (SRA2-style) control would clarify how much of CoVA's gain is due to the learned composer rather than previously established stage-dependent alignment.
Questions for authors
Q1. Generalization to text-to-image (central concern). How would the classification-supervised composer and the posterior-based SLC mechanism be adapted to continuous, token-level text conditioning? In particular, what would replace the class posterior and the interpolation over a class-embedding table, and how would the magnitude correction be defined? Please distinguish which components can transfer directly and which require redesign. A concrete technical formulation, or preliminary evidence if available, would materially affect my assessment.
Q2. Relation to Self-Flow (central concern). Could the authors discuss and, where feasible, compare CoVA with Self-Flow (Chefer et al., ICML 2026) under comparable backbone, training compute/steps, sampling protocol, and unguided FID/Precision/Recall settings? If matched experiments are not feasible, a clearly qualified comparison using reported results and a discussion of relative computational overhead and supported conditioning modalities would be useful.
Q3. Incremental contribution over VAE alignment. Does CoVA retain its advantage over an SRA2-style raw-VAE alignment baseline when both use the same early-stopping schedule? A controlled ablation of the composer versus the stopping strategy would strengthen the attribution of the reported gains. Potential score revision.
I currently lean toward weak rejection, but I would be willing to increase my rating if the rebuttal convincingly addresses the text-to-image extension and establishes a clear, fair comparison with Self-Flow and related baselines.
We added a text-to-image experiment to our General response Part2 and the revised manuscript. In text-to-image generation, the text condition is already a soft condition provided by a pretrained model, so intuitively there is no need to apply SLC on top of it during training. Our SLC analysis also shows that conditioning magnitude can change the degree of conditioning extrapolation during sampling. This principle can be applied at sampling time in any conditioning setting.
Both methods learn alignment targets without an external pretrained visual encoder. Self-Flow aligns a student processing tokens at two noise levels with deeper features from an EMA teacher that sees the cleaner noise level throughout. CoVA learns its targets from VAE latents using a lightweight online composer. On ImageNet, the same composer also supplies the posteriors used for late-stage soft label conditioning.
SiT-XL ImageNet 256x256 comparison.
Most experiments in Self Flow use different settings from ours. CoVA generally follows the experimental setup of REPA. The table below compares the results from both papers under the most closely matched evaluation settings.
Training cost.
CoVA adds 8.5M training-only parameters and increases SiT-XL/2 compute by 7.2%, with throughput changing from 8.1 to 7.0 iterations/s (Table 4). Self-Flow reuses the model’s EMA weights and incurs an additional teacher forward pass.
We added a unified ablation study to disentangle the contributions of the alignment target, early stopping, and soft label conditioning. Part 1 of our general response summarizes the findings. Table 1 and the accompanying discussion in the revised manuscript provide the full results (lines 324–347 and 366–373).