- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper presents Hierarchical Latent Reasoning, which trains a small student to emit a plan vector and detail vectors, that are then fed to a teacher model to produce the final answer. Starting with textual annotations of plans and details, the training proceeds in a curriculum fashion replacing each plan/detail step with a latent vector while student+teacher combinations learns to produce the final answer with LoRA params. Experiments on 2 backbones on 5 datasets shows that HLR beats six other latent reasoning baselines.
Critical strengths
- Tackles an important problem and simplicity of the approach. Assigning roles to latent vectors is an interesting way to supervise latent reasoning methods and authors present a method incorporating roles in curriculum based training. Results and ablations show improvements.
Critical weaknesses
-
Unfair comparison with baselines and approach limitations. HLR uses a student+teacher setup, both trained with LoRA params, while CoCoNUT, CODI are student models being trained to answer. HLR, therefore uses substantially more params than others, this makes the comparison unfair. The proposed approach requires plan+detail annotations of existing problems which are not feasible to obtain for additional datasets. All experiments exhibit high variance, possibly due to small training data size (<1k). Authors are suggested to use a larger dataset (like GSM8k-Aug) and train till convergence.
-
Potential overclaiming and Unclear terminologies.
- Contribution (i) states "..plan latent is a direct ancestor.." which is just the latent being in context, while Contribution(ii) is the CoCoNUT training method.
- Training objectives (Sec 3.3 + Appendix A) introduce a lot of additional details without proper justification or reasoning. Figure 1 introduces a "Flat" reasoning baseline which is not mentioned later.
- Terms like "hierarchical", "counterfactual", are used multiple times in unexpected contexts without defining properly. A list of definitions explaining terms would really help.
Questions for authors
- Which baseline method does Figure 1, "Baseline" correspond to? Is it right to say that the only difference between the two is what each latent trained to represent?
- Are Table 2 and Figure 3 same data represented twice?
- Can you present an example of text plan + detail trace.
- Do you see training and validation loss converge well?