- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MetaLearnNCA, a few-shot meta-learning framework based on two interacting Neural Cellular Automata. The Active-NCA performs prediction, while the Meta-NCA uses pixel-level residual errors from the support set to iteratively update a 2D spatial program. After adaptation, the program is frozen and used for query inference without explicit test-time backpropagation. The model is meta-trained only on Omniglot and evaluated on several OOD datasets, including MNIST, USPS, KMNIST, Fashion-MNIST, and MedMNIST. It outperforms several canonical meta-learning baselines on multiple target domains while keeping the model size around 118k parameters.
Critical strengths
-
The method is novel. The Meta-NCA modifies a 2D spatial program that steers the Active-NCA. This is clearly different from both MAML-style adaptation and prototype-based meta-learning.
-
The spatial task representation is an interesting design choice. Task-specific information is encoded in a spatial program. This preserves spatial structure and matches the local interaction bias of NCAs.
-
OOD transfer is competitive on several datasets. MetaLearnNCA shows clear gains on MNIST, KMNIST, and Fashion-MNIST across different shot regimes, with particularly strong improvements in some 10-shot settings.
-
The paper provides a relatively careful robustness analysis across random seeds. The adaptation trajectories are reported over 42 independent meta-training runs and 42 testing seeds, which gives more confidence that the observed dynamics are not due to a single favorable run.
Critical weaknesses
-
Key components are not sufficiently ablated. The current experiments do not clearly isolate the contributions of the cellular updater, spatial program, foreground masking, and long recurrent unrolling. The paper explicitly acknowledges this issue.
-
There is some concern about baseline fairness. ProtoNet, MatchingNet, RelationNet, and FOMAML all use a standard Conv4 backbone, while MetaLearnNCA uses a very different recurrent cellular architecture. It is therefore difficult to separate the effect of the proposed adaptation mechanism from the inductive bias of the NCA architecture itself.
-
Gradient-free does not necessarily imply computational efficiency. Test-time backpropagation is removed, but both NCAs require many recurrent updates. The paper does not report quantative results to prove the computational efficiency.
-
Some mechanistic explanations remain speculative. For example, the proposed interpretation of class-specific steering fields occupying quasi-orthogonal subspaces is explicitly described as hypothetical and is not empirically verified.
-
The authors are suggested to improve the quality of figures, especially Figure 1.
Questions for authors
-
Although the method avoids test-time gradients, it requires many recurrent NCA updates. How does its actual wall-clock latency, FLOPs, and memory cost compare with FOMAML and ProtoNet?
-
MetaLearnNCA underperforms FOMAML on MedMNIST and some USPS settings. What explains these failure cases? Are they related to foreground masking, spatial centering, or the structural similarity between Omniglot and the target domains?
-
It is unclear whether the gains mainly come from the Meta-NCA, the spatial program, foreground masking, or recurrent unrolling. Could the authors provide component-wise ablations to isolate their individual contributions?
2 comments
Thank you again for your detailed review, particularly your recognition of the architectural novelty and your suggestion to separate the adaptation mechanism from the NCA backbone. Following our revision update, we would like to summarise what the new experiments establish.
The revised paper includes retrained component ablations and NCA-ProtoNet as a simpler alternative. NCA-ProtoNet achieves similar average OOD accuracy at 5 and 10 shots, with no demonstrated aggregate advantage for the full model. This indicates that the backbone accounts for a substantial part of the transfer performance. The full model improves the 1-shot OOD mean by 2.2 percentage points (reported 95% CI: ±1.4), and improves 10-shot Fashion-MNIST and KMNIST by 8.6 and 4.4 points, while performing substantially worse on MedMNIST.
The remaining ablations show substantial performance reductions when spatial conditioning, masking, residual feedback, or Meta-NCA neighbourhood communication are altered within the tested architecture.
Table 3 now reports latency, FLOPs, and memory. The overhead is substantial. For example, approximately 66× FOMAML’s adaptation FLOPs on a 10-way 10-shot task. Therefore, we make no efficiency claim. We have also removed the speculative explanation based on quasi-orthogonal class-specific steering fields and revised Figure 1.
Regarding the failure cases, spatial sensitivity and domain structure are plausible contributing factors, but we do not regard them as established causal explanations. The NCA-ProtoNet comparison indicates that limitations of the adaptation mechanism also require further investigation.
We consequently frame the contribution as a proof of concept for biologically inspired, local recurrent adaptation of spatial task memory, with explicitly measured benefits and limitations. The backbone comparison also opens a complementary direction for exploring NCAs within other meta-learning methods.
We would welcome your updated assessment of whether this evidence addresses the concerns raised in your review.
In accordance with your review, we have added component ablations, NCA backbone for ProtoNet, and test-time compute cost. We have also removed any speculative paragraphs and improved Figure 1. As per your question about underperformance on certain datasets, this comes down to a mix of structural similarity between training and testing, as can be seen in the table in Appendix J, and spatial centring. As MedMNIST and USPS take up the whole image, feature placements can vary much more than in smaller, more centred datasets; this is also partially supported by the results in Appendix L.