- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
As I understand it, the authors fine-tune Qwen3-14B so that, when a LoRA update that taught it one fact or one response habit is added to its weights, it describes what the update changed. On 100 unseen fact updates and 100 unseen behaviour updates, an LLM judge accepts at least one of 100 sampled descriptions for 2% and 16% of them. They then use the gradient of a desired self-description ("the update made me better at checking intermediate results") to prune or shift a few rows of the original model, and report the refusal rate, GSM8K, MATH-500, and BFCL.
Critical strengths
The question of whether a model can describe a change to its own weights is interesting, and the readout has sensible controls (empty, random, and swapped updates).
Critical weaknesses
I fail to see what either result enables. Fact readout works for 2 of 100 updates with 100 attempts each, and A.6 shows that a wrong update of the same type lowers the target loss by 0.097 nats per token against 0.223 for the right one, so almost half of the signal is not update-specific. The edits give small changes: 94.77 to 95.00 on GSM8K is about three problems, and 82.8 to 83.0 on MATH-500 is one.
Furthermore, the editing baselines do not isolate the Reader. For maths and BFCL, the only comparisons are a system prompt and a vague target of equal norm, which already reaches 43.68 of the 44.60 on BFCL. Missing are the same edit with gradients from the original model (done only for safety, Section 5.1) and a random direction of equal norm on the same rows. To recommend acceptance, I would need these controls and a clearer case for why the readout is useful at its current accuracy.
Questions for authors
What is Pass@100 when the Reader is given an empty update or a mismatched update of the same type?