- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents a spherical flow matching framework. It improves image generation by aligning the geometry of pretrained VAE latents with the generative process. Specifically, the authors project latent tokens onto fixed-radius spheres, adapt the pretrained decoder, and perform flow matching along spherical trajectories.
Critical strengths
1.The paper provides an interesting and well-motivated perspective on the relationship between latent geometry and generative modeling.
2.The proposed framework is conceptually simple and can be applied to existing pretrained VAEs without modifying the diffusion backbone.
Critical weaknesses
1.Longer training evaluation. Although the authors provide results up to 200 epochs, it would be valuable to investigate whether the improvements persist with substantially longer training, such as 800 epochs, if computational resources permit. Such results would help establish the effectiveness of the proposed method at convergence. I would be happy to increase my score if the authors could provide these additional experiments.
2.Limited evaluation scenarios. The experiments are primarily conducted on ImageNet-256. Extending the evaluation to ImageNet-512 and text-to-image (T2I) generation would provide stronger evidence of the method's generalizability and practical applicability. I would be willing to raise my score if the authors could demonstrate consistent improvements in these settings.
3.More comprehensive CFG evaluation. While the paper reports results with classifier-free guidance (CFG), a more systematic comparison across different guidance scales would be valuable. This would help clarify whether the proposed method consistently improves generation quality under stronger guidance and whether its optimal guidance scale differs from that of the baseline.
Questions for authors
1.Longer training evaluation.
2.Limited evaluation scenarios.
3.More comprehensive CFG evaluation.
If the authors provide additional experimental results or analysis, I would be very willing to raise the score.
3 comments
Dear Reviewer UWnJ,
As the discussion period is ending soon, we wanted to check whether the new results address your three points.
To summarize briefly: at 200 epochs, FID improves from 21.58 to 16.83, the same relative gain as at 80 epochs. On ImageNet-512, our decoder reaches rFID 0.813 without any training at 512, compared to 0.815 for the original decoder. For guidance, we swept eight scales, and at each method's best scale Spherical reaches FID 4.61 vs. 5.26 for Linear.
We have uploaded a revised manuscript, with new text marked in blue. These results are in Sec. 5, Tab. A3, and Sec. C.14 and C.15.
You mentioned you would consider raising your score if these results were provided, so we hope they are helpful. If anything is still unclear, please let us know and we will answer before the deadline.
Best regards,
The Authors
Thank you very much for your efforts; the authors have provided additional experiments demonstrating the effectiveness of the proposed approach. I have decided to increase my score.
Longer training, ImageNet-512 and guidance results
We thank the reviewer for finding our perspective on the relationship between latent geometry and generative modeling interesting and well motivated. We are glad that the reviewer sees the framework as conceptually simple and applicable to existing pretrained VAEs without modifying the diffusion backbone. We address the reviewer's three concrete suggestions below.
W1: Longer training. We continued training the FLUX.2 SiT-B/2 pair of Tab. 3 with the same recipe (Tab. A1). FID-50K at CFG 1.0, Euler with 250 steps:
The relative improvement stays the same with longer training: 23% at 80 epochs and 22% at 200 epochs. The gain also holds for SiT-XL/2 at 200 epochs (Tab. A3): 9.15 vs. 8.35 at CFG 1.0 and 3.22 vs. 2.91 at CFG 1.5. We will add the full 800-epoch comparison to the final version.
W2: ImageNet-512 and T2I. Our method only changes the latent space, the decoder and the sampling path, so the backbone and the conditioning stay as they are. The projection is applied to each token separately (Eq. 5), so it does not depend on the resolution. Our spherical decoder, trained at 256, reaches rFID 0.813 on ImageNet-512 without any training at 512, compared with 0.815 for the original decoder (50K images). For T2I, the gains already hold with the FLUX autoencoders that current T2I models build on: FID improves from 38.00 to 26.07 with REPA-E FLUX.1 and from 26.14 to 20.21 with FLUX.2 (Tab. 3). We will also add a text-to-image comparison on COCO to the final version.
W3: Guidance. We swept eight guidance scales between 1.0 and 4.0 for the 80-epoch pair, with the same solver, steps, labels and seeds for both methods. At each method's best scale (50K samples):
Spherical also has higher IS and precision than Linear at all eight scales.
Along with this response, we have uploaded a revised PDF in which new text is marked in blue. In the revision, Sec. 5 summarizes the longer training and guidance results, with details in Tab. A3 and Sec. C.14. Sec. C.15 gives the 512 decoder result. We hope this addresses the reviewer's concerns, and we would appreciate it if the reviewer would consider raising the score.