- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Synaptic Morphogenesis, a biological inspired, task-adaptive framework that can select its components through a shared DQN to face different kind of tasks.
Critical strengths
The method incorporates the concept of biological neuronal modulation, enabling adaptive adjustment of network components and adaptation to entirely different types of data, such as traffic and EEG data.
Critical weaknesses
1: Task types need to be provided for this framework, yet the model not achieve the SOTA. Facing different kind of tasks, the task types must be clear and provided to the framework. Meanwhile, according to Table 1, SynMorph only achieves the best performances in classification tasks and failed in regression tasks. In Table 2, SynMorph failed in CHI R. Consequently, the advantages of the proposed method are not outstanding, it’s easier to choose different SOTA models for each task, because the task type is provided.
2: Clearer emphasis on novelty. Using reinforcement learning to select neural network architectures is not a new idea, as it was already explored in MetaQNN [1]. The authors should discuss the differences and better emphasize their novelty, such as what advantages synaptic mechanism provided comparing to the traditional RL method.
[1] Bowen Baker, et.al. Designing Neural Network Architectures using Reinforcement Learning, ICLR2017
Questions for authors
1: The training and inference process for the SynMorph I am not entirely clear on this point: does the framework use a task-type encoder during training, but a fixed network architecture for each specific task during inference? If my understanding is incorrect—for example, if the framework can automatically adapt its architecture to the characteristics of different datasets without relying on prior knowledge of the task type—I would consider raising my score.
2: The meaning of Figure 2 and Figure 3 It’s hard to understand these figures, what the authors want to emphasize in these Figures?
4 comments
Response to Reviewer RGG3 part II
Q1. Confusion of flexibility of SynMorph
Thanks for your comments. We do not assign a fixed architecture to classification or regression tasks. Instead, SynMorph automatically identifies and constructs a suitable neural architecture according to the input data, allowing the resulting architecture to fit the underlying data patterns. We would like to clarify the following two points:
-
Task-type encoding is necessary, because the task type must be specified to determine the type and content of the model output, which has been confirmed in Table 4.
-
Our core contribution lies in the data-sensitive nature of architecture construction. Even without domain-specific prior knowledge about the data, SynMorph can adaptively construct and adjust its architecture through data-pattern encoding and task encoding. Specifically, the state represents the current network structure together with data and task characteristics, while the reward provides feedback on the learning process, reflecting how well the current architecture fits the observed data. Through this feedback-driven process, SynMorph progressively regulates its architecture and learns a suitable structural configuration until the construction process converges.
Q2. The meaning of Figure 2 and Figure 3
Figure 2 illustrates that classification and regression tasks have different neural architecture preferences, which has been verified and corresponding to the design of SynMorph. Even when regression and classification tasks share the same input dataset, SynMorph exhibits distinct preferences for synaptic primitives, leading to different network architectures. This visualization highlights the interpretability of SynMorph's task-adaptive structural decisions.
Figure 3 illustrates the sequential synaptic selection process through a concrete example and helps better understand strategy construction process of our methodology. This example demonstrates how reward feedback guides the progressive construction of task-adaptive architectures. We appreciate you again for highlighting this ambiguity.
I thank the authors for their further clarifications and responses. Overall, these responses have partially addressed my concerns. However, several issues remain unclear to me, and I believe they cannot be adequately resolved through textual explanations alone.
- Regarding the task encoder: The authors emphasize that one of SynMorph's key advantages is the data-sensitive nature of its architecture construction process. However, removing the task encoder leads to a substantial performance degradation, which seems somewhat inconsistent with the claimed data sensitivity. Furthermore, even without the task encoder, task-related information is still provided through the loss function. This may explain why performance does not completely collapse after removing the task encoder, rather than demonstrating an inherent advantage of the architecture construction mechanism itself.
- Regarding novelty: I am not convinced that the construction of heterogeneous neural architectures constitutes a novel contribution, as this idea has already been explored in prior research.
- Regarding Figures 2 and 3: I appreciate the authors' further clarification, which has resolved my confusion on this point. However, I believe these figures and their accompanying explanations should be integrated with Figure 1 to provide a more coherent presentation of the proposed methodology, rather than being placed at the end of the paper. Therefore, I have decided to maintain my original score.
Response to the follow-up comments of Reviewer RGG3
Thanks for your further discussions on our work. We hope the following 3 points can one-to-one address your updated concerns:
-
Removing the Task Encoder means eliminating both the Task-Type Encoding and the Spatial/Temporal Descriptors, which jointly characterize task requirements and data patterns. Therefore, removing the entire Task Encoder eliminates not only task-type information but also data-dependent structural features, leading to performance degradation. To further investigate the data sensitivity of SynMorph, we conducted an additional ablation experiment on SIP by removing only the Task-Type Encoding while retaining the Spatial/Temporal Descriptors, i.e., SynMorph-Task type (MAE and Acc reported): SIP R:13.11 SIP C: 95.82. This experiment demonstrates that only data-pattern information can still effectively guide adaptive architecture construction without explicit task-type encoding.
-
Our core novelty lies in resolving the problem of constructing learnable neural architecture from scratch given task type and datasets. To resolve this, we establish a series of neural functional structures inspired by morphological diversity, which allows the complexity and flexibility of data flowing, and then propose a reinforcement based neural structure connection strategy to form the neural architecture from scratch. We believe that such a mechanism, integrating fine-grained functional composition with task-data-driven, feedback-guided architecture construction, has not been exactly explored in prior work.
-
Figure 2 illustrates the task-adaptive structural preferences learned by SynMorph across different tasks and serves as a further interpretation of our experimental results. Therefore, we believe it is more appropriate to retain it in the experimental analysis section rather than integrate it into the framework figure. Figure 3 illustrates the architecture construction and decision-making process and could indeed be integrated with Figure 1. However, since Figure 1 already contains substantial information, we present Figure 3 separately to avoid overcrowding and improve readability. Based on your suggestion, we can remove Figure 2 into the Appendix of our manuscript or merge Figure 2 with Figure 3 to make it more compact.
With the author–reviewer discussion period ending in about one day, we would appreciate your follow-up on whether our further responses dispel your concerns. We are happy to incorporate all these discussions and results into our revised manuscript to improve the overall quality of the manuscript.
The authors
Response to Reviewer RGG3 part I
Thanks for your valuable comments. Our experiments primarily aim to validate the effectiveness of SynMorph under heterogeneous task settings. Therefore, its strong classification performance also demonstrates the effectiveness of our approach. Regarding the tasks where SynMorph does not achieve SOTA performance, we believe an important reason is that existing specialized models often incorporate extensive domain-specific prior knowledge into their architectural designs, e.g., domain-informed spatial fusion in DeepAir, bidirectional diffusion-based recurrent modeling in DCRNN, and EEG-specific spectral-power extraction in ShallowNet. In contrast, SynMorph aims to construct neural architectures from scratch, primarily based on observable data and task information, without relying on additional domain-specific modules. Therefore, these approaches differ in their research objectives and reliance on domain priors. Our goal is to learn architecture-construction strategies autonomously using only observable inputs and necessary task information. Our results show that SynMorph achieves SOTA performance on 50% of the evaluated tasks and remains competitive on the others. These results suggest that, even without carefully designed domain-specific mechanisms, SynMorph can maintain strong performance across heterogeneous tasks, demonstrating its data-driven architecture construction capability and task adaptiveness.
Thanks for your reflective comments. Unlike MetaQNN, which uses Q-learning to sequentially select conventional CNN layers and their configurations, SynMorph progressively constructs neural architectures from scratch according to task requirements and data characteristics. Moreover, we construct a meta-synaptic pool where each unit constitutes a sub-neural architecture designed to achieve specific functions like spatial integration and information projection inspired by the morphological and functional diversity of neural synapses, and our RL controller performs feedback-driven regulation of this bottom-up structural growth. At each decision step, the current network state and data-task descriptors jointly guide synaptic primitive selection. As new mini-batches arrive, the data-dependent descriptors can be updated, allowing structural decisions to respond to changing input characteristics. Meanwhile, feedback from prediction performance, together with structural considerations, provides rewards to progressively optimize the architecture-construction policy.
Our existing results provide complementary evidence for this design. In Table 4, replacing learned primitive selection with random composition increases KnowAir MAE from 34.28 to 50.98 and decreases SIP classification accuracy from 96.89% to 85.24%, demonstrating the importance of learned functional composition. Removing individual primitive categories further degrades performance, confirming the value of functionally heterogeneous structural choices. Moreover, reinitializing the controller for each task reduces SIP classification accuracy from 96.89% to 91.52%, supporting the benefit of retaining construction knowledge across tasks. Figures 2 and 7 further illustrate task-dependent projection preferences and functional composition patterns, providing structural evidence of customized model construction.
Following your suggestions, we will expand the discussion of MetaQNN and clarify that SynMorph's novelty lies in task-conditioned composition of heterogeneous functional primitives and reusable cross-task architecture-construction policies, rather than the reinforcement learning algorithm itself.