- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies failures of prompt search. It derives a risk frontier for the best legal text prompt in a coupled Gaussian attention model. It further characterizes first-layer vocabulary constraints in pretrained Transformers and explains why these constraints alone are insufficient to establish downstream task-loss lower bounds. Experiments on frozen language models and classification benchmarks show that a 32-vector continuous prompt outperforms several baselines.
Critical strengths
The problem studied is somehow interesting.
Critical weaknesses
The paper's presentation is unclear. It reads like an experimental report rather than a research paper. Here are a few examples, and I strongly recommend that the authors polish the writing to make the paper easier to read.
- The ''the two questions'' in the second sentence of the abstract is an ambiguous reference. Also, the meanings of in the abstract are unclear.
- The introduction is too short and does not provide enough motivation for this work.
- The definition of notations is unclear. For example, what does mean in Line 108?
- Every proposition and theorem statement is very long and difficult to understand.
Questions for authors
- Line253 says '' It is not a test of Theorem 1, Proposition 4 or Theorem 5, and no number here is a vocabulary limit.'' So what is the relationship between the results in Sec. 3 and the following experiments?
- Could the authors clarify the logical connection between the main sections? Section 3.1 studies an asymptotic risk frontier, Sections 3.2–3.4 analyze first-layer geometry, and Section 5.1 compares optimization pipelines. These sections consider different models and different quantities, but their roles in supporting the central contribution remain unclear.
- Could the authors explicitly define the objectives and procedures of the compilers , , and in the paper? These methods are central to Section 5.4, but their differences are not explained.