- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
Sparse-TD-JEPA adds an l1 penalty to normalized task embeddings, encouraging sparse representations to improve downstream reward inference. It preserves TD-JEPA’s architecture and inference procedure while reporting improved zero-shot RL performance.
Critical strengths
- Regularizing fixed-norm embeddings encourages sparsity without merely shrinking their magnitude. The method is simple but effective.
- The results are strong. Average performance improves over TD-JEPA across all 13 domains, covering 65 tasks.
Critical weaknesses
Lack some details, the baselines select the best final-checkpoint configuration separately for each seed, without a stated independent validation set. The sparsity coefficient’s value and search range are unreported, limiting reproducibility and assessment of tuning fairness.
Questions for authors
see weaknesses
Dear Reviewer 5QST,
We sincerely thank you for your positive and encouraging review.
We are glad that you found the method simple but effective and noted that the results are strong.
To ensure fair comparison, all baseline in Table 1 are tuned over their own method-specific coefficient, namely the orthonormality coefficient for TD-JEPA, FB, RLDP, BYOL and the Laplacian, and the goal-sampling probability for HILP and ICVF, together with their learning rate.
We tune the sparsity coefficient over [0,0.2] with a genetic algorithm (Appendix D.9).
To rule out that our gains come from this search, we added Table 10, which reports Sparse TD-JEPA with only a random draw of λsp, which matches the tuning budget of TD-JEPA.
Table 10: Base hyperparameters of Sparse TD-JEPA and zero-shot performance under an equal tuning budget.
Even under this budget, Sparse TD-JEPA outperforms TD-JEPA in all 13 domains.
To make the changes easy to find in the the revised paper, we highlighted all additions in green.
We would be grateful if you would consider these clarifications in your final assessment, and we are happy to answer any further questions.
We thank you again for your careful reading and your constructive comments!