- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Summary of contributions:
- The paper investigates mechanisms that could support compositional generalization in neural circuits: the ability to reuse learned components in previously unseen task combinations.
- Inspired by distributed cortico-cerebellar circuitry, the authors propose a cortical RNN augmented with cerebellar-inspired feedback mechanism that supplies task-dependent content and regulates cortical state retention.
- Across cognitive rule-combination and motor-sequencing tasks, the proposed model generalizes better than an approximately parameter-matched cortex-only baseline. The authors also report more robust performance as motor sequence length increases.
- The authors interpret these findings as a candidate circuit mechanism for compositional computation and suggest that the underlying computational organization could inform the design of artificial systems.
Critical strengths
- Clarity: The paper is clearly written and easy to follow. The architecture, experimental comparisons, and mechanistic analyses are presented in an accessible way, with no significant concerns about readability.
- Originality of contributions: To my knowledge, using cortico-cerebellar-inspired feedback to investigate zero-shot compositional generalization is an interesting and potentially novel computational experiment. The paper offers a useful model for exploring how interactions between neural circuits could support the flexible recombination of learned computations.
- Significance of results: The reported cognitive and motor results provide evidence that the proposed feedback architecture improves compositional generalization relative to the cortex-only baseline. Approximate parameter matching makes this comparison informative, and the longer-sequence results provide additional evidence of the proposed model’s flexibility.
Critical weaknesses
- Weak baselines: Although the principal comparison approximately matches the total parameter counts of Ctx and CtxFb, the width-sensitivity experiments (in Appendix D) vary CtxFb alone. I would like to see comparisons at several parameter budgets, increasing the widths of both architectures while maintaining approximate parameter matching. This would establish whether the observed advantage persists as model capacity increases. A diminishing advantage at larger widths would still be informative, because it would clarify the conditions under which feedback provides a useful inductive bias.
- Scope of claims: The claim that these findings inform the design of future AI systems is broader than the evidence presented. The experiments use relatively small recurrent models and structured cognitive and motor tasks. Modern AI systems differ substantially in architecture, training regime, and the settings in which compositional failures arise, so the relevance of this mechanism to those failures remains unclear. The results support a candidate computational mechanism in the studied setting; broader design claims should be qualified or supported by experiments in more representative AI settings.
Questions for authors
Please refer to my weaknesses above. Adding the comparison between Ctx and CtxFb models while sweeping their parameter budgets would be informative to address my questions about this paper's contribution.
As suggested, we have extended the width-sensitivity analysis to seven approximately parameter-matched budgets, spanning more than a 600-fold increase in parameter count. Specifically, the cortical widths of Ctx-cb are set to 24, 48, 96, 192, 384, 768, and 1536, while those of Ctx-only are adjusted to match the total parameter counts. All configurations are evaluated across 10 random seeds.
Ctx-cb consistently outperforms Ctx-only across all tested parameter budgets in both tasks, indicating that its advantage is not limited to small networks. Notably, Ctx-cb performance approaches saturation, whereas Ctx-only continues to improve with increasing model size. Even the smallest Ctx-cb model (4104 parameters) outperforms the largest Ctx-only model (2524732 parameters) in both tasks, despite the latter having approximately 615 times as many parameters. These results demonstrate the substantial parameter efficiency and computational advantage of Ctx-cb within the tested range. We will include these results and the corresponding discussion in the revised manuscript.
We agree that the current experiments, conducted using relatively small recurrent networks and structured cognitive and motor tasks, may not establish the general applicability of the proposed mechanism to modern AI systems. We will revise the manuscript accordingly to clarify the scope and limitations of our conclusions.
Please refer to our responses to the Weaknesses above.