- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
This paper provides a controlled partial-sharing structure UnCurl for organizing training-time task-level curriculum control(Learning Progress) and state-action level exploration(Information Gain) for better efficiency and performance, while mitigating potential negative transfer. A synthesis environment(CLCS) is applied for controlled calibration for gate components in terms of dependence, reliability and sharing-strength, and shadow posterior is provided as fallback when hard-gate conditions are not satisfied. The resulting adjusted structure is further evaluated in ALFWorld and WebArena-Lite with inprovements over the vanilla LP+IG baseline, at the cost of additional GPU hours.
Critical strengths
- The overall logical flow of the paper is fluent and the motivation is clearly presented. The method discussion incrementally progresses, making the question and solution raised reasonable.
- The figure explaining the sharing mechanism (fig.1) and the training/routing (fig.2) are well designed, making it easy to understand the main route.
- The author clearly distinguishes two objectives (LP and IG), and specifically designs statistical and reliability tests for both objectives to guide sharing. An independent shadow posterior is provided as fallback when the sharing conditions are not satisfied.
- Experiments are carefully designed with multiple controlled baselines and ablations, providing signals (negative transfer/learning efficiency/sharing dynamics under shift) in addition of accuracy, providing source for analyzing the behavior and effectiveness of the provided method.
Critical weaknesses
- Undefined symbol and terms greatly harms readability. There are numerous mathematical symbols and terms introduced without clear definitions(across section 2), and displayed equations are not numbered. The methods are stacked in table 1 without proper grouping, and the columns abbreviations require referring back to main text. The font size in fig.3 is so small that is almost not readable.
- The reliability of LP estimation in real training remains insufficiently validated. Though CLCS proxy calibration results are provided, how accurately the estimated LP reflects actual post-update learning progress in ALFWorld remains unclear. Subsequent dependence detection and sharing decisions might also me affected as well.
- The core sharing mechanism can still be further isolated in the ablation study. E.g. the contribution of the independent shadow posterior. Also, the comparison between fixed and adaptive partial sharing changes both the gate strategy and fallback mechanism, making it difficult to attribute the observed improvements to individual components.
- Some statistical design lacks sufficient justifications. For example, the weighted mean aggregation of state-action IG may discard information relevant to dependence detection, while the normalization and weighting of LP/IG/outcome losses during posterior training and LP/IG losses during gate calibration are not sufficiently explained.
Questions for authors
- How is the LP estimation validated during actual training? Could the authors clarify how one-step gain probes are constructed and report the prediction accuracy of LP proxies on ALFWorld, rather than only on CLCS?
- How sensitive are the sharing decisions to the statistical design choices? In particular, could the authors further explain the weighted-mean choice of IG aggregation and clarify how LP/IG losses are normalized and weighted? Would alternative aggregation strategies or loss weights significantly affect the gate decisions?
- Could the authors provide more targeted ablations of the adaptive sharing mechanism? For example, comparing adaptive gating with/without the independent shadow posterior, as well as fixed/adaptive gating under the same fallback setting would help isolate the contribution of fallback and clarify whether the improvements come from adaptive sharing itself.