- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates how models can fail in argumentative or persuasive tasks. Given an argumentative position a model can fail in two ways; it can drop the position under an attack even if the attack offers no reason to do so, or it can maintain the position in the face of good evidence that it should be dropped.
Critical strengths
I really had difficulty understanding this paper.
Critical weaknesses
The paper is not written to the standards of an ICLR paper, empirical or otherwise.
The abstract does not start out well:
"A model given a position can fail in two opposite ways: it can drop the position
under pressure that offers no reason, or keep it against evidence that offers a good
one."
This is quite unclear. I offered a rewrite in the paper summary. I hope it was accurate.
The paper is replete with oracular and impenetrable statements. Again just from the abstract: " discrimination
is whether its movements track what it was shown, read as an AUC on
which a quality-blind model scores 0.5 however firm it is." This sentence is needlessly obtuse; discrimination here should mean something like this: a model's ability to discriminate is measured by or corresponds to the degree its argumentative moves are responsive to the contents of the moves of its opponent. Or something like that. I have no idea what an area under the curve has to do with any of this. No equations are presented anywhere in the body of the paper.
The explanation of the paper's goal: "This is a measurement paper with a case study. Its contribution is the instrument; the interventions, including a method of our own, are what the instrument is applied to. It reports five quantities and two floors (Section 3)." As of p.3 I have no idea what this instrument is. Also I don't know what floors and quantities are being referred to. I take it that's what's being measured are the degrees to which models fail on the two dimensions I described in the paper summary, but I'm not even totally clear on that.
There are percentages wandering through the paragraphs from l78 onwards but I can find no clear statement of what they correspond to at least locally. This really isn't helpful for the reader.
The paper is replete with formulations that are needlessly obtuse: "A concession that follows a reason is a revision, and one that follows a raised voice is a retreat; on the record, they are the same sentence (Anonymous, 2026b)." |(3) What a claimed authority can revoke tracks the intervention, not weight-residence:"
The scope of the paper is also expressed strangely. Yes this is about public commitments not about whether the arguer is sincere or not. So then why not just talk about commitments and not beliefs?
The related work section is not clear either. And why not name it "related work" instead of the mysterious "what the field measures"? This just needlessly taxes an already overworked reader.
Section 3 gives us the details of floors and quantities, though the "instrument" is still not clear. And there are bits that are just not explained: Compiled modulation: a trained write function reads a typed belief tree (claims, arguments, and evidence with credences and SUPPORTS/CONTRADICTS edges) and emits, in one pass, a fixed rank-16 update to the residual stream at 11 of the host’s 32 layers."
In section 4, we are told again that "installation and hold are separate properties but they sound more like near contraries. They both can't hold absolutely and so Why only 11 layers?? The belief tree at issue here isn't defined, among other things. For the experimental design, it would really help to have some illustrative examples in the body of the paper.
In sum I suspect that a typical reader of ICLR will find the abstract and introduction incomprehensible and simply stop reading. I would strongly advise the authors to rewrite the paper from scratch with a clear outline.
Questions for authors
The authors should rewrite the abstract and introduction completely so that the reader has a clear idea of the problem addressed, the methodology used to examine the problem in models, the experimental design and a summary statement of the results. In fact the whole paper needs to be rewritten from beginning to end.