- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies when a learned local representation remains reliable after being reused as a component of a larger computation. The central argument is that local output accuracy alone is insufficient for compositional reuse: a component must preserve the information required by its surrounding computation, and errors in this interaction information should be evaluated according to how they propagate through the assembled system. The paper formalizes these ideas as composition sufficiency and propagation geometry.
Critical strengths
- The controlled intervention is clean and convincing. Instead of training two complete systems and attributing their differences to “better representations,” the authors freeze the output model and composer and change only the interaction response. This isolates the phenomenon much better.
- The propagation result explains the effect.
Critical weaknesses
- The main conceptual claim appears substantially broader than what is theoretically or empirically established.
- The empirical evidence is narrow relative to the broad representation-learning framing. The headline controlled experiments are based primarily on two nonlinear elliptic reaction families with 32 and 16 held-out 2D cases respectively. The controlled error-direction study uses 72 assemblies, but these are again 1D cubic elliptic systems rather than a qualitatively different compositional learning problem
Questions for authors
Could you please explain or address the weaknesses raised above?
Dear Reviewers,
The authors have posted their rebuttals. As the author-reviewer discussion period is coming to a close soon, please read their responses and engage in the discussion. At a minimum, please acknowledge that you have read the authors’ responses. Thank you for your time and effort.
Best,
AC