- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper trains a world model to concentrate useful predictive information in the first few coordinates of a wide latent representation. A learned selector chooses how many coordinates to use, and MixSIGReg supports training with different prefix lengths. The authors analyze the resulting representations and use them for goal-conditioned visual planning.
Critical strengths
- Retaining a wide representation during learning while planning with a compact prefix is a useful design. Predicting the full next embedding from a short prefix encourages the early coordinates to retain the information needed for prediction.
- The experiments show that compact prefixes can improve planning performance. Comparisons with tuned fixed-width models span four tasks and three backbone sizes, and the controlled dynamical system and ablations help explain the learned representation. The paper also presents the full training scheme, rather than the selector alone, as its contribution, which matches the scope of the experiments.
Critical weaknesses
- The comparisons do not isolate the benefit of input-dependent capacity selection, one of the paper's central design choices alongside the wide representation and MixSIGReg. Nested Dropout changes both the capacity distribution and the regularizer, while the fixed-prefix evaluation changes only the inference-time capacity of an already trained model. Appendix D.4 shows that the selected capacity varies with goal distance, consistent with input dependence, but not that this variation improves planning over a learned global distribution. A learned input-independent distribution trained with MixSIGReg is the missing control.
Questions for authors
- To separate input-dependent selection from the learned capacity distribution, please compare (i) a fixed prefix-length distribution, (ii) a learned distribution shared across all inputs, and (iii) the current input-dependent selector under the same MixSIGReg, capacity support, and tuning budget.
We thank the reviewer for the careful review and for recognizing the value of our proposed approach. We also appreciate the positive assessment of the experiments and training scheme. We address the reviewer’s concerns below. Updates based on the reviewer’s comments are incorporated in the revised version of the paper.
(1) Separating capacity allocation from the regularizer:
Thank you for this valuable suggestion. We agree that the original comparison did not clearly separate the two changes. We have expanded the Nested Dropout comparison, now shown in Figure 4 of the revised submission, to include both SIGReg and MixSIGReg. Both Nested Dropout (ND) variants predict the full next embedding and sample capacities from a fixed distribution. In particular, Nested Dropout with MixSIGReg retains the same regularizer as ALeWM but fixes the capacity distribution to the prior, qψ=π0. This allows us to compare learned capacity allocation against fixed-prior training.
The following table reports test success rates for the best configuration per capacity shown. Results are mean success rate ± SEM over three training seeds.
For comparison, ALeWM uses the learned selector:
From the tables, neither Nested Dropout variant consistently outperforms the other across all capacities, although MixSIGReg achieves the highest Nested Dropout success on both datasets. ALeWM achieves higher mean success than either variant at every tested fixed capacity, while using shorter average prefixes than those at which Nested Dropout performs best. These results support that both components, the learned capacity allocation and MixSIGReg regularizer, account for the observed improvement.
(2) Comparing input-dependent selection with a learned global distribution:
Thank you for identifying this missing control. We agree that the fixed-prefix evaluation and the observed variation in selected capacities do not isolate the benefit of input conditioning during training. We have now added the requested learned input-independent distribution in Appendix D.5, Table 4 of the revised submission. This variant replaces qψ(k∣w) with a learned categorical distribution qψ(k) shared across all inputs. We retain the capacity network but replace its observation input with one randomly drawn vector that remains fixed throughout training and evaluation. The network remains trainable, so the capacity probabilities can change during learning, while remaining independent of the episode. The below table reports mean ± SEM over three training seeds of both variants:
Input-dependent ALeWM achieves higher mean success on both datasets, supporting the usefulness of conditioning capacity allocation on the observations.