- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper seems to be about natural-language understanding, but unfortunately my own understanding of the paper cannot surpass this basic level. The abstract is convoluted and obscure, and even after a slow read of the first two pages—including the entire introduction—I still hadn’t learnt about the setting, challenge, or contributions.
The paper is clearly AI-generated, but somehow in a much worse way than one could expect from today’s frontier models.
Critical strengths
None
Critical weaknesses
- The paper is impossible to understand for somebody not familiar with ContractNLI, ProofWriter, etc. No attempt is being made to introduce the domain, motivate a task, describe challenges, etc.
- As an example, these are the first sentences of the abstract: “Evidence in a neighboring contract can agree with a target judgment yet make a model less likely to answer it correctly. On ContractNLI, deleting that neighbor’s target-consistent evidence corrects many pre-existing errors.” The abstract contains terms such as “contract”, “ContractNLI”, “optimizer-update memberships”, “ProofWriter”, etc., without any attempt to paint a bigger picture.
- Overall, this paper remains too arcane for me to make a judgment about its technical content. It is so poorly structured and written that I cannot even grasp its most basic aspects.
Questions for authors
What is the paper about?