- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper extends LDLM (a latent language diffusion model that jointly trains the latent space and the diffusion process) to a flow map. Overall, the paper explores and analyses multiple axes such as self-conditioning, the "rollout depth", and alignment between the latent space and the flow map. Novelty is limited, with the primary contributions being around bringing together aspects from multiple papers and analysis of their interplay. Experiment results are strong.
Critical strengths
Strong empirical numbers on OWT and GSM8K.
Critical weaknesses
Writing is very poor. It is hard to make sense of what the paper is trying to convey and how the experiments tie to this claim. The central novelty is not well defined. Converting an existing flow into its associated flow map with other techniques such as self-conditioning that have already been explored for language diffusion is limited novelty at best. Experiments and results are inconsistent. The takeaways are different from dataset to dataset, and some settings that have positive impact for one dataset have negative ones for others. Citations, backgrounds and conclusions are weak/missing.
Questions for authors
What is the final conclusion from the paper? Is there a one-sentence takeaway for readers?
3 comments
Response to author rebuttal
Dear authors, thank you for the detailed rebuttal.
- The one-sentence takeaway is still not clear. There are multiple different statements in the provided one-sentence takeaway. I believe the paper would benefit a great deal from a rewrite that paints a simple picture and it is obvious to readers what that picture is. Enlisting all results and then providing post-hoc explanations makes it hard to draw a conclusion from the paper. The overall writing is also very hard to follow.
- I maintain that novelty is limited. As the authors point out, 1/2/3 already exist in the literature, 5 does not add significant value and 4 is important only in certain settings. Moreover, I believe decoder alignment (4) and latent space adaptation (5) are relatively simple ideas. I would suggest the authors add more value for readers through either non-trivial ideas that lead to performance improvements or show why their proposed improvements and experiments are important for the community. An interesting direction here would be examining why ELF* -> FMLM* fails to train but LDLM-FM does not, given these are very tightly related methods.
While the rebuttal adds more clarity to what the paper does, I don't think it resolves my concerns about writing quality and novelty. Thus, I choose to maintain my rating.
Response to Reviewer XtzW (2)
We thank the reviewer again for their time, the quick response and the close engagement with our rebuttal. We would like to highlight two aspects of the work.
-
Our work aims to answer open questions about latent language flow maps, rather than to propose a conceptually new method. Each of these questions (the components of our study) arises naturally as soon as one starts building a flow map. Our work answers exactly these questions and shows the best setting for each. We believe these results are helpful for anyone building a latent language flow map.
-
We also want to emphasize the importance of the joint space adaptation question. The latent space is a core part of the method, so which space is best to use? The trade-off between diffusability and decodability is still an active research question (Zhang et al., 2026). LDLM finds this trade-off automatically by training the space jointly with the denoiser. It is natural to ask the same for flow maps: would joint training reshape the space so that it becomes easier to denoise in few steps? This is the question we address in the paper: the jointly trained teacher’s space is already good enough for few-step generation, and further adapting it is worth it when higher pass@k matters, which may be useful, for example, for RL.
As for why ELF* -> FMLM* fails to train on GSM8K while LDLM-FM does not, we do not yet know. We find it an interesting direction and thank the reviewer for it.
References:
- Zhang et al. "Scaling and Distilling Text Embeddings for Better Diffusibility", arXiv:2610.01016 (2026)
Response to Reviewer XtzW
We appreciate the reviewer's time and honest feedback on clarity. It helped us see where the paper's message was not coming through, and we try to state it plainly below. Points shared with other reviewers are detailed in the general response (GR).
One-sentence takeaway. Our experiments suggest a recipe for training latent language flow maps: refine the target with the teacher, align the decoder to the map's outputs where exact tokens matter, and keep the latent space frozen by default, though adapting it jointly with the flow map raises pass@k on GSM8K and MAUVE on OWT — decoder alignment and joint space adaptation were not studied in prior flow-map LMs.
In more detail. A latent flow map generates text in a few steps. It works in the latent space of a latent diffusion LM, its teacher, and a decoder turns its output into tokens. We split the training of such a model into five components:
We ablate each component and pick its best setting (Section 5, Tables 1 and 2). In the default, frozen-space model, the same component settings work on OWT and GSM8K, except decoder alignment (below).
With this recipe, our model with 8 steps matches the 64-step GSM8K accuracy of ELF* and FMLM+, at a tenth of FMLM+'s FLOPs (GR-2, GR-4). On OWT at 8 steps, it has 40% lower gPPL than FMLM* at matched entropy (Table 3, GR-5).
"Some settings that have positive impact for one dataset have negative ones for others." In the default model, this holds for one component, decoder alignment, and it likely follows from the task: on GSM8K, one wrong token breaks a program, so alignment matters a lot (Table 2: +24 points at 8 steps). On OWT, a substituted token is mostly tolerated, so alignment does not help and we leave it off. All other components use the same setting on OWT and GSM8K, and it is the best or within run-to-run variation of the best once diversity is taken into account (Tables 1, 2 and 6). Adapting the latent space raises pass@k on GSM8K and MAUVE on OWT (Table 3: 0.92 vs 0.86 at 8 steps), which suggests better mode coverage on both tasks. On GSM8K, teacher-only training does not explain this gain: at N=2, pass@128 rises 6.0 points with adaptation but only 1.3 with teacher-only training (Table 9).
Background and citations. We reviewed the literature carefully and cited the work closest to ours:
The field moves fast, and we could not cover every related paper. If there are specific works whose absence changes the picture of our contribution, we would be grateful if you could point us to them.