- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies when neural modules preserve symbolic semantics through composition. It formulates correctness as containment of reachable neural states within the intended decoder cells and distinguishes canonical accuracy, terminal accuracy, and correctness throughout an execution.
The experiments examine modular arithmetic, representation perturbations, quantization, learned four-dimensional modules, and capacity attainment with fixed gates and learned translations.
Critical strengths
-- This paper connects a precise capacity bound to a constructive neural realization. -- The experiments demonstrate that high terminal accuracy can coexist with intermediate symbolic errors.
Critical weaknesses
-- Comparisons exist, but the local Lipschitz baseline uses interval masks and absolute-weight sensitivity propagation, which discard cancellations. Its failure does not establish an advantage over stronger local estimators.
-- No tested high-dimensional endpoint setting produces a positive target-centered inner-radius estimate, preventing application of the capacity theorem there. Successful learned regional certificates concern four-dimensional modules, with no complete three-operator family certified.
Questions for authors
see above
Thank you for the response. While your revisions address some of my concerns, they do not address my primary reservations about the work. The presentation still needs work, and the overall relevance of the work is not clear. For these reasons, I maintain my score.