- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper evaluates Telegraph English (TE), a context-compression format that rewrites retrieved passages as compact relational statements (e.g., "Orin | adviser | Sana"). It reports two studies: a pre-registered encoder–consumer matrix and a distilled compiler.
Critical strengths
None
Critical weaknesses
- The paper is poorly written. The authors assume readers can understand a lot of complicated knowledge and jargons. For example, right in introduction, they introduce "reader’s evidence and its token cost". What is reader here? Or right after it, "Only 33 of 9,600 outputs in our budgeted generation study fall within the registered 98–100% target band. The two anchors’ median lengths exceed their requests throughout the measured grid." How are readers supposed to understand what outputs are these? Or which "registered 98–100% target band" are? The paper needs a substantial rewriting before it's ready for another submission. After reading intro section, I still don't get what the main contribution of the paper is.
- At the end, the paper is an evaluation paper, yet it's very hard to understand what the evaluation wants to deliver as result and recommendation. The paper's central scientific question goes unanswered, which leaves very little to evaluate as a contribution.
- The headline "failure" findings are largely by design and are not tested against simple fixes. Hitting 98–100% of a target length through free-form generation with a single count-feedback revision is a very strict criterion. A 33/9,600 hit rate is unsurprising and says little about relational compression itself.
Questions for authors
Please see weaknesses.