- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies the of verifying whether a description of an observation is accurate, when an agent must re-read the original observation to verify it. The results includes lower bounds and empirical analysis on the verification cost relative to the observation cost.
Critical strengths
Critical weaknesses
A major weakness for this paper is clarity. This paper does not clearly state what problem it is studying or clearly describe the problem setup, methodology, or results. The exposition is extremely obfuscated and the explanations and intuitions given use imprecise language, unexplained jargon, and makes claims without proper justification.
The lack of clarity begins in the abstract. It is extremely unclear to me what this means: “A price, however, is only half a verifier. Normalising by how much a verdict actually discriminates separates two quantities that behave quite differently: the nominal ratio is pinned by the interface, moving little across an order of magnitude of scale and uncorrelated with it, while the discrimination varies widely between backbones and is a property of the individual model.”
The main paragraph describing contributions in the introduction: “The verification price is therefore not a small additive constant on top of the channel’s price: it is bounded below by the channel’s own observation term, and the ratio approaches one exactly as the interface becomes more image-dominated.”
"What compression drops first (§4.5, Proposition 3): a derivation of why a capped description sheds the object–attribute pairing before either marginal, together with the measurement that refutes its natural rival, the typicality account."
Finally, the paper also not self-contained. It relies heavily, both in discussion of related work, exposition in various places, and statement and proofs of certain results on references of five different concurrent submissions. The "admission criterion of the companion analysis" is referred to often, but is not clear. Relationship to this concurrent work is only treated in the Appendix, not at all in the main body, and in similarly unclear language.