- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes Balanced Learnability–Coverage Replay (BLCR), an experience replay method that aims to prevent reducible-loss prioritization (ReLo) from suppressing transitions with large Bellman errors. BLCR combines normalized reducible-loss priorities with a logarithmically compressed TD-error floor and applies bounded per-sample loss weighting. The method is evaluated on MinAtar, 30 ALE-RAM games, and a preliminary SAC extension to MuJoCo. The results show improvements over ReLo across most evaluated discrete-control tasks, while comparisons with PER and uniform replay, where available, yield mixed results.
Critical strengths
None
Critical weaknesses
-
The presentation is overly repetitive, and the material is not appropriately organized across sections.
-
The proposed method combines several components, but the rationale for individual design choices is insufficiently justified, and the ablation studies provide only a limited assessment of their respective contributions to performance.
-
The main text includes excessive detail on minor hyperparameters and implementation settings, which substantially reduces readability. These details would be better presented in the appendix.
-
The experimental comparisons lack important baselines, particularly uniform replay and PER in the 30-game ALE-RAM benchmark.
-
Although the proposed method improves performance on some tasks, the results do not establish a consistent advantage over the evaluated baselines.
Questions for authors
See weaknesses.