- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
FoT builds a shared insight library by extracting procedural knowledge from agents’ local reasoning traces and aggregating it through an LLM. The library is iteratively updated and reused across tasks and models. Experiments evaluate task performance, transfer, and research-insight discovery.
Critical strengths
The reported improvements on held-out tasks and the transfer of insights from weaker to stronger models suggest that sharing distilled experience has practical value. Comparisons with alternative aggregation methods provide some support for the proposed design.
Critical weaknesses
The quality of the figures and writing is poor. Figures 1 and 2 look like rough AI-generated sketches. I have no objection to using AI to create figures, but these figures have too many visual and presentation flaws to be acceptable in their current form. Many sentences also have a formulaic, AI-like style, leaving the manuscript insufficiently polished.
The resulting insight library seems little different from detailed instructions that a knowledgeable human could write, and may be less useful than a carefully prepared guide or system prompt. The paper does not convincingly establish what additional value comes from producing this guidance through multi-agent experience sharing, rather than directly articulating effective problem-solving strategies.
Questions for authors
What does FoT offer beyond a detailed guide or system prompt? Does it capture knowledge that such guidance would miss, or primarily automate its construction?
Incorrect Assesment
Dear PC, I would like to inform you that this is a completely incorrect assessment. My review is fully 100% written by me, not even the grammar or spelling correction were done by any tool/LLM. Being 100% certain, I request you to reject this claim and re-consider the AI-detection tool you are using. Best