-
[W1] AI-generated citations. I have not done a full analysis of the references, but the 'Overestimation, Overfitting, and Plasticity in Actor-Critic: the Bitter Lesson of Reinforcement Learning' citation in the references lists 'Mohammad Nauman' as the first author when the first author is Michal Nauman. I assume this is due to LLM hallucination. This is unacceptable and grounds for desk rejection in my opinion. The robosuite citation also lists Yuke Zhu twice. I also noticed that the Parseval paper lists William Chung as the first author when it's Wesley Chung! The authors also do not disclaim AI generated references and also claim they checked all LLM outputs. Based on the state of the references I cannot believe this is true.
-
[W2] No consideration of update-to-data ratio / UTD / replay ratio / RR. The FIRE paper considers the high UTD setting as this is where the effects of plasticity is encountered most strongly. There is no mention of this in the paper.
-
[W3] No fair reproduction of previous experimental results. FIRE had a specific experimental protocol that used DQN on Atari and Simba-v2 on HumanoidBench. The paper does not reproduce this experiment so it's hard to verify it outperforms FIRE on its own terms.
-
[W4] Missing baselines. The paper does not compare to or reference CrossQ+WN (Palenicek et al., NeurIPS 2025) or XQC (Palenicek et al., ICLR 2026) that achieve SOTA plasticity using batch norm and weight norm. Also the SIMBA papers (Lee et al. ICLR 2025, ICML 2025) which uses norms on the weights and activations.
-
[W5] Results nowhere near SOTA. Since the authors don't list the specific MuJoCo gym suite version it's hard to compare, but the results look nowhere near optimal based on the recent SOTA papers (see W4). Looking at the XQC performance curves (Appendix E.4) and listing rough numbers
| Env | Return | @ Steps |
|---|
| Hopper-v4 | 3000 | 250K |
| Ant-v4 | 7000 | 500K |
| HalfCheetah-v4 | 10000 | 250K |
| Walker2D-v4 | 5000 | 250K |
| Humanoid-v4 | 10000 | 250K |
The results in Figure 3 are nowhere near this therefore we can't tell if their proposed plasticity regularization is useful for achieving best possible sample efficiency.
- [W6] Lack of detail in related work. The baselines in this paper, FIRE, Parseval and PFO are not thoroughly described in the related work, which makes it hard to understand the experimental results. I see there is more information in the Appendix, but this is not ideal
Minor comments
W6. On line 86, \citep is used when \citet is required, i.e.
Dohare et al. (Dohare et al., 2024)
The title should have a space after the colon, i.e. 'AIPR: Adaptive Isometric...'
The text in Figure 1 has two typos: 'smail' and 'gemetry'