- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper trains a memory model with LoRA, to retrieve the success and failure history each, and create the task-wise failure hypothesis to guide the frozen solver. This paper starts from an observation that that reflection-based agents repeat a same failure explanations, therefore retrying do not help. This paper proposes to compound the previous cases with learned parametric memory to compound and create a diverse and grounded reflection.
They propose a hybrid method of two memory types managed across task: retrieved memory from a bank by embedding similarity and parametric memory which is learned into model weight.
Critical strengths
- The paper starts from a strong hypothesis: Failure analysis stay repetitive and superficial while diverse reflection leads to task success.
- The method is easy to understand and intuitive.
Critical weaknesses
- This paper does not show a direct evidence that diversity actually maps to true failure modes
- Limited novelty compared to ParamAgent-plus. The difference seems to be mainly using the search pairs as a input to parametric memory during SFT. This is closer to retrieval-augmented fine-tuning.
- Limited evidence on compounding vs additive. I need a clean ablation that compounding architecture is better than additive architecture.
Questions for authors
Is the improvement of the proposed method statistically significant compared to ParamMem? Can you report the result seed-wise and paired bootstrap on each problem case?