- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper propose a two stage skill selection process which use gate to control what skill should accept and what should be remove out. Two stages are specifically 1. generate the cadidate skills and select skills 2. update the skill representation by different kind of structures. Paper varified on 6 different benchmarks and 3 different base models.
Critical strengths
This paper propose a two stage skill selection process which use gate to control what skill should accept and what should be remove out. Two stages are specifically 1. generate the cadidate skills and select skills 2. update the skill representation by different kind of structures. Paper varified on 6 different benchmarks and 3 different base models.
Critical weaknesses
Paper organization needs to be improved; repeated context makes the paper's structure not very tight strucrure and loses concentration. The efficiency of the method should be carefully evaluated. The method in stage one is not very novel; it only calculates the successful rate gain and uses a threshold to cut off skills below the threshold. The literature review is not comprehensive; the gate-based selection is not a new idea; the method should carefully position its contribution.
Questions for authors
1.How do sensitive scores work? In the paper, where is the definition of the sensitive function f? Not only f, many notations lack clear definitions, and it is unclear how they work. For example, "p", I see it as a very important score, but how do you get it? How do you know if the definition or the collection process is reasonable? Authors should explain p r, c, and carefully about what are they and how can it works.
-
Following up on question 1, the definition of the function f is not clear; the following equation 6 looks confusing and not reasonable.
-
The experiments part uses only GPT. It might be good to show more base model results because it will give a good evaluation of the method's performance stability and will provide a cost and efficiency evaluation of different methods.