- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper explores the possibility of relaxing the isotropic Gaussian regularization in latent world model training. To achieve this, they propose QCFReg, a regularization method that replaces the Gaussian distribution with a heavy-tailed Student-t distribution. Following LeWM, this paper compares models trained with SIGReg and QCFReg in success rate, latent geometry, rollout MSE, and different horizons. However, my concerns are: 1) this paper does not show why a heavy-tailed distribution is needed, 2) each task needs a different set of hyperparameters, which obscures the multi-task possibility, and 3) the success rates do not support the claim that QCFReg is better than SIGReg.
Critical strengths
- The comparison and analysis are clear and comprehensive.
- The motivation is clear.
Critical weaknesses
- The only difference between QCFReg and SIGReg is the target distribution, but there is no clear evidence of why this change is needed. In fact, some results show that this change hurts training simplicity and the possibility of multi-task prediction.
- No long-horizon and OOD tests are included. With the nearly saturated performance on these tasks, it is necessary to provide more tests in real-world scenarios.
Questions for authors
- I want to see clear evidence that this change to the target distribution is needed, not speculation.
2 comments
I appreciate the pollution experiment, as it provides evidence supporting the effectiveness of q-loss. However, given the limited room for improvement in success rates on in-domain and short-horizon tasks, it remains unclear whether the proposed method makes a sufficiently significant contribution to the community. Therefore, I will maintain my current score.
Response to Reviewer
We sincerely thank the reviewer for their remarks and comments. Your comments were very insightful and are shaping the new version of the paper.
Following, we tried to address your questions based on the new paper version. To help the review process, main changes are highlighted in blue in the new uploaded pdf.
What evidence shows that changing the regularizer target is necessary?
None of the previous evidence establishes necessity. We removed that claim and retain the Gaussian target in the main method. q-gaussian is a matched-variance control. Table 1 shows prediction improvements with q-loss under either target at 10% swapping.
Different hyperparameters for each task
The Push-T comparison fixes q=1.25, batch-median scaling, mean-weight normalization, target variance four, regularizer weight 0.09, and training budget, without per-arm tuning. We have a future work to address a learnable q during the optimization, avoiding a fixed q value.
Longer horizons, out of distribution, or in real-world scenario
This is interesting point, that motivated us to add a new section in the appendix. The paper reports prediction through horizon five, but broader horizon generalization, environmental distribution shift, and real-world robustness remain untested. Short fault pilots (paper Figure 6) improve on swaps and black frames but worsen on clean, frozen-frame, and mismatched-action data. We are planning real robot manipulation tasks for a future paper.
Table R3.3. Short fault pilots: one-step latent NMSE. Push-T, 6,000 steps, one seed per arm; Student-t target, q=1.25, mean-weight normalization. Lower is better.