- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether integrating recurrent dynamics with a cerebellar-inspired feedforward pathway enhances temporal learning. The proposed CB-RNN combines an Elman RNN with an expansion-compression module that modulates recurrent activity, with both pathways jointly optimized under a shared task objective. The authors report improved learning efficiency over parameter-matched RNN baselines across delayed match-to-sample and parity tasks under single-task, multitask, and task-switching settings, and suggest that the architecture enables an emergent, task-dependent division of labor.
Critical strengths
-
The paper is clearly written and well organized. Exploring cortico-cerebellar architectures as an inductive bias for brain-inspired computing is an interesting and potentially valuable research direction.
-
The proposed CB-RNN demonstrates substantial improvements in learning efficiency over parameter-matched RNN baselines across the evaluated temporal learning tasks and training settings.
Critical weaknesses
-
Although the proposed architecture is inspired by cortico-cerebellar circuits, DMS and Parity are generic temporal learning tasks without a clear link to specific cortico-cerebellar computations. Moreover, the evaluation is limited to two relatively simple binary sequence tasks, and the learning advantage is substantially reduced with a GRU backbone. It remains unclear whether the proposed architecture captures a general computational principle or primarily benefits specific tasks and recurrent architectures.
-
Although the architecture is motivated by the cerebellar expansion–compression circuit, the specific contributions of these operations remain insufficiently characterized. Increasing the expansion-layer size improves performance, but this may reflect increased feedforward capacity rather than a specific architectural benefit. Parameter-matched controls and representational analyses are needed to determine whether expansion and compression play distinct computational roles in temporal learning.
-
The experiments use fixed optimization settings without reporting systematic searches over learning rates, recurrent-weight initialization, or optimizer choices. Given the sensitivity of recurrent networks to these factors, it is unclear whether the reported efficiency gains reflect the proposed architectural inductive bias or suboptimal training of the RNN-only baselines. Comparable hyperparameter tuning across architectures is needed to establish the robustness of the performance advantage.
-
The authors interpret their mechanistic findings as evidence for an emergent, task-dependent division of labor between cortical and cerebellar pathways. However, the architecture contains two recurrent pathways: the internal recurrence of the RNN and the feedback loop through the cerebellar module. The latter introduces additional nonlinear transformations into the recurrent state update, potentially enhancing computational depth and expressivity. Thus, the observed advantages may reflect enhanced recurrent dynamics rather than functional specialization between modules. A unified causal analysis and appropriate architectural controls are needed to distinguish the effects of inter-module feedback from an emergent division of labor.
Questions for authors
-
Are the learning-efficiency gains robust to hyperparameter choices? Can the authors compare RNN and CB-RNN under different learning rates, weight initializations, and optimizers to rule out suboptimal baseline training?
-
How much of the performance gain comes from the expansion–compression structure rather than increased computational depth? Can the authors vary network depth and redistribute parameters between the expansion and compression layers while keeping the total parameter count fixed?
-
Can the authors evaluate a temporal cognitive task with established cortico-cerebellar involvement? The current DMS and Parity tasks are relatively simple and do not clearly reflect cortico-cerebellar computations. A more biologically motivated task would help establish the generality and neuroscientific relevance of the proposed architecture.
-
Does the learning advantage extend to other recurrent architectures, such as LSTMs? Given the reduced benefit observed with GRUs, it remains unclear whether the proposed architecture offers a general advantage or mainly compensates for limitations of simple RNNs.