- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes BIT, a bidirectional diffusion-bridge framework for text-to-image and image-to-text generation. Fixed continuous token embeddings and a lightweight decoder place text and image latents in a common representation space. The authors derive endpoint-conditioned forward and reverse SDEs with tractable training objectives, together with state-only drifts that match the bridge’s one-time marginals at the population level. Experiments evaluate conditional generation, cross-modal round-trip variations, and cell-fate modeling, with additional demonstrations of large-scale shared bidirectional modeling and qualitative image editing.
Critical strengths
The paper derives forward and reverse SDEs with tractable training objectives for text–image translation. Continuous token embeddings allow both modalities to use the same DiT backbone. The theoretical results clearly distinguish population-level guarantees from marginal matching and finite-step sampling.
The experiments show that starting from text representations can achieve T2I quality comparable to the controlled noise-to-data baseline, while reducing caption generative perplexity from 178.2 to 123.4 (Table 1). The billion-parameter shared model and the variation and editing examples further demonstrate that the approach works beyond the basic generation setting.
Critical weaknesses
-
Incomplete coverage and comparison of closely related bridge methods. The paper omits BBDM (CVPR 2023) and BiBBDM (TPAMI 2025). BBDM already studies direct domain-to-domain translation through Brownian bridges, and BiBBDM explicitly learns both translation directions with one model. The paper should discuss and compare these methods to clarify BIT’s specific advances in cross-modal modeling beyond direct data-to-data transport and bidirectionality.
-
The empirical tradeoff of shared bidirectional modeling remains unclear. The controlled results in Table 1 use separate models for the two directions The shared model in Table 2 also increases model size and training examples and changes several training settings. These results demonstrate feasibility but do not isolate the effect of joint training. A controlled shared-versus-separate comparison would clarify the quality–compute tradeoff and potential interference between the two tasks.
Questions for authors
Please address the weaknesses raised above, particularly the comparison with BBDM and BiBBDM and the empirical tradeoff between shared and separate directional models.
I thank the authors for providing additional results and conducting the experiments within such a short timeframe. Most of my concerns have been resolved. In particular, the inclusion of CrossFlow and FlowTok as additional baselines was important and helped strengthen the evaluation. One remaining concern is that the low FID appears to be largely attributable to the in-distribution data on which BIT was trained, as acknowledged by the authors. Evaluating on a separate dataset that none of the compared methods were trained on would further strengthen the work and provide a more convincing assessment of generalization. Nevertheless, since most of my concerns have been addressed, I will raise my score.