- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes StyleCraft for visual RL generalization. It aims to separate task and appearance representations, then uses a frozen copy of the learned encoders and decoder to generate training views by interpolating style codes. A continuing task encoder is trained to produce consistent representations across these views. The paper reports results on KAGE-Bench, distracting control tasks, RL4VLA, and ManiSkill, including a real-robot evaluation.
Critical strengths
- Relevant objective and potentially useful augmentation mechanism. Using a learned appearance representation to generate additional training views is a meaningful extension of representation-invariance approaches, if the generated views preserve task content.
- Broad evaluation scope. The inclusion of multiple visual-shift settings and a physical-robot experiment makes the empirical question consequential, although the current design limits what can be concluded about the proposed mechanism.
Critical weaknesses
-
The claimed task–style disentanglement is not demonstrated. The paper assumes that its two encoders learn task-relevant content and visual style separately, but the training objectives do not guarantee this separation, and the paper provides no direct evidence that it occurs. There is no systematic factor-swapping analysis, task-preservation measurement, or visualization across the evaluated tasks. Final policy returns alone cannot establish that the proposed representation or generated views behave as claimed.
-
The experimental methodology and reporting are seriously inadequate.
- The paper contains no ablation isolating Stage 1, style interpolation, or the individual losses, so its central mechanism cannot be assessed.
- The headline RL4VLA and ManiSkill experiments each use only one training seed. More seriously, the implementation does not consistently follow the method presented in the main text: gradient reversal and style KL appear only in KAGE-Bench; ManiSkill is listed as single-phase; and RL4VLA runs Stage 2 separately, alongside additional color-diverse frames, a reverse curriculum, and SIL whose treatment in the baselines is unclear. The stage configurations and augmentation settings are insufficiently explained.
- Reporting discrepancies further undermine confidence: the KAGE improvement is stated as both 12.3% and 19%, while ManiSkill is described as having three held-out colors in the main text but 12 in Appendix Table 3.
- The reference list contains only 16 entries despite the breadth of the topic and omits directly relevant work.
Taken together, these are substantive obstacles to reproducing the experiments and attributing the reported gains, rather than minor presentation issues.
- The novelty relative to prior work is insufficiently established. Focus On What Matters: Separated Models For Visual-Based RL Generalization (SMG) already uses separate branches to learn task-relevant and task-irrelevant visual representations, together with reconstruction and consistency objectives, without relying on StyleCraft’s two-stage training scheme. SMG is neither cited nor discussed. Style interpolation may be a meaningful extension, but the paper does not isolate its contribution or explain convincingly what it adds beyond this closely related approach.
Questions for authors
- What evidence shows that the task and style encoders capture the intended factors, and that interpolated views preserve the original task state? In particular, how diverse are style codes paired within a minibatch?
- What is the performance of Stage 1 alone under the same total training budget? How do results change without style interpolation, or if pixel augmentation continues throughout training?
- Which stages, losses, data sources, and auxiliary training procedures are used in each benchmark? For RL4VLA, do PPO and RAD receive the same additional color-diverse frames, reverse curriculum, and SIL?
- Please clarify the uncertainty of the RL4VLA and ManiSkill results, each trained with one seed, and reconcile the reporting discrepancies: KAGE’s stated improvements of 12.3% and 19%, and ManiSkill’s three held-out colors in the main text versus 12 in Appendix Table 3.
2 comments
Thank you for the response. The additional probes and KAGE ablations address some of my concerns, but substantial issues remain. In particular, the three-seed KAGE ablation does not resolve the lack of independent training runs for the headline RL4VLA and ManiSkill results. Different environment seeds and manual object placements measure evaluation variability, not variability across independently trained policies. The conceptual advance over SMG also remains insufficiently established.
Overall, I consider the paper substantially below the standard required for acceptance at ICLR. The work needs a clearer justification of its novelty, more robust experimental validation, and more consistent methodological reporting. I therefore maintain my original score and encourage the authors to undertake a substantial revision.
Thank you for your review and feedback. We address your questions point by point in the appendix of the revised paper, where we clarify the experimental protocols and provide the relevant supporting results.