- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies video pretrained-model causal fine-tuning for world modelling (e.g. autoregressive generation) for long-horizon tasks. The author explores different prior approaches and offers some insight into which one works best for longer generation on the Minecraft benchmark.
Critical strengths
- Long horizon generation is an important problem, and exploring existing techniques to know which ones work best is useful to be able to develop new ideas and offers practical insight.
Critical weaknesses
This paper reads mostly like a class project with little to no novelty. The paper writing is also not good enough; multiple non-standard issues. Background method, experiments details are intertwined in places. There's a very underdeveloped related work section. The experiments section lacks a standard structure for baseline, dataset, etc. description. Overall, the writing lacks clarity. The method itself is limited and only explores existing ideas, experiments with some of them and offers little novel contribution to the area. I think it's just an early report of exploration, and not a proper thesis of what the contribution/finding is. Of course, not yet ready for publication!
Questions for authors
None
3 comments
I thank the authors for the rebuttal. It is a challenging time for conference reviewing, and I want the authors to know that I acknowledge their efforts. I looked at the revised draft and the responses to my review and those of other reviewers. Let me reiterate that my main criticism is that this paper is clearly underdeveloped and lacks a clear thesis. Surely, there are some experiments along different axes of known approaches, which were further improved through the rebuttal responses and additional experiments addressing other reviewers' comments. However, I still do not see any clear findings or interesting insights that are significant. I read the document, and yes, there are different findings from trying out different things, but they do not form a cohesive contribution.
I'd like the authors to read their revised contributions themselves.
F1 A controlled comparison of the full pre-training and post-training pipeline at equal
pre-training compute. Evaluation over 1000 frame rollouts shows that recipe rankings
change after post-training.
F2 Evidence from predictions conditioned on ground truth and history noise experiments that
a mismatch between training and inference contributes to DF’s initial rollout deficit.
F3 An analysis of the distinct effects of post-training. Flow map finetuning increases dynamic
content across the three recipes, while Self Forcing improves overall rollout quality. The
complete post-training pipeline changes the preferred cache policy in favour of retaining
K/V as the window slides.
F4 Crossing students with teachers shows that the DF teacher stabilises the PF student.
-
These findings are all over the place. Yes, I read about the change in rankings between pre-training and post-training. But that does not help us conclude anything meaningful yet. I think this is a nice early-stage exploration, but it does not establish a single clear finding. It also sounds like someone conducted a lot of experiments and presented a summary of them -- lacking a general or robust understanding. Therefore, my review and score remain the same. The work is not yet ready for publication. The authors should spend more time on the focus and clarity of their contributions.
-
I'm not going into methodological and results details because I think the overall research question/importance/ contribution is lacking a lot. But, since the author wants me to stretch that too. I think it is important to establish this type of phenomenon across multiple datasets and model families, etc., to be able to make claims that the author is suggesting in this work.
-
One is not expected to read the appendix; most of the content is in the main paper, and the pages should be enough to write the paper. So, it's not a good practice to point reviewers to a long list of appendices to follow a paper (appendices can be useful for reproducibility and supplementary material, but not a prerequisite to read and understand a paper, AFAIK). Also, they should be written in a standard style of writing that we know of for machine learning papers. What I am trying to suggest is that it's hard for me to follow this paper! And I know the authors have the details somewhere in the appendix, but that is not an effort for the reader to be able to follow the work!
-
Also, on a side note, when did we start using the term "recipe" to describe settings and methods in machine learning? As I mentioned last time, the paper has a very unusual writing style. Also, we shouldn't take writing lightly if we think we're writing these papers for humans to read. Perhaps if it is written for AI, then it's up to AIs. But as a human, I'll keep my bargain: the writing and contribution of the work need to be much, much better for conference publication.
Thank you for taking another look at the paper. The success of large language models shows that post-training can substantially change a pretrained model. For autoregressive video world models, this raises the question: how do pretraining and post-training choices work together to shape long-horizon generation? We study how the pretraining objective affects the final model, what each post-training stage contributes, and how teacher choice affects the outcome.
Our main finding is that the pretraining objective that performs best before post-training does not necessarily produce the best model after post-training. In our experiments, Diffusion Forcing (DF) starts with the weakest long-horizon rollouts but performs best or comparably after the full pipeline. We also find that flow map fine-tuning and Self Forcing have distinct effects, and that teacher choice affects the final results.
These experiments address connected parts of the same question. The pretraining comparison shows that post-training can change the ranking of the models. The stage evaluations and teacher comparison help explain how the post-training process affects the final results.
Prior work commonly pretrains with prefix forcing and then post-trains with a DF teacher. Interestingly, our experiments show that pretraining with DF and post-training with a DF teacher performs better. When we fix the prefix forcing student, using a DF teacher improves mean FVD from 135 to 98.
We hope this clarifies our contribution: a controlled empirical study of how pretraining, post-training stages, and teacher choice interact in long-horizon generation for video world models.
Thank you for your review. We agree with your point that knowing which existing techniques work best "offers practical insight" and that is the aim of the paper. We also agree that the presentation can be easier to follow. In the submission, much of the information you ask for was in the appendix, and the main text did not point to it clearly enough. The revision fixes this:
The review does not name a specific soundness concern. Could you point to the claims or experiments you find unsound, and tell us what evidence would change your assessment? We will address them during the discussion.