- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper describes a new research of using separation logic, fuzz and LLM in spec generation.The main idea is to use symbolic approach first to generate spec candidates and then use fuzz method to generate test cases which rejects invalid specs. The authors also report experiments on large real programs.
Critical strengths
- This work targets large real programs.
- This provide informative ablation test results.
Critical weaknesses
-
This work does not generate correct separation logic spec and fuzz test seems unable to figure that out. In the appendix of this paper, one simple example and generated spec are provided. But the spec is clearly wrong. Not all used memory permission is described. The paper tries to clarify that fuzzing test is not full verification in another appendix. However, this does not mean that wrong spec should be allowed.
-
Separation logic assertions used in the materiel lack a clear definition.
Questions for authors
- What is the meaning of “it.begin()" in your separation logic assertion? Especially it can be a dynamic function. Or does your assertion language only allow read only functions?
- If in some C++ class "it.end()" is implemented using internally stored "begin" and "size", is it allowed to use "it.end()" in your assertion language? If yes, what is its meaning?