- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes a modular language model architecture called FEM-ASM. It decouples contextual computation, external knowledge storage, and deterministic execution, and integrates information from different modules into neural states through typed residual assembly. The paper also investigates the feasibility of combining different components and discusses the limitations of the current implementation.
Critical strengths
-
The paper explores a new architecture that coordinates different types of external modules through a unified interface, providing a new perspective on how language models can be organized.
-
The experiments involve multiple components, and the paper clearly discusses the limitations of the current implementation.
Critical weaknesses
-
The core novelty and motivation are insufficiently justified. The paper does not provide enough evidence to demonstrate the unique advantages of the proposed architecture over existing approaches.
-
The scope of this research is somewhat too broad, while the experimental validation is insufficient. The paper also lacks a clear storyline, making it difficult for readers to follow the main idea and understand how the different experiments support the central claim.
Questions for authors
-
The motivation of this paper is not sufficiently clear. Why is such a modular integration architecture necessary? Current LLMs can already use various external tools and knowledge bases. In this context, introducing a new architecture seems somewhat unnecessary without demonstrating its unique advantages over existing approaches.
-
The paper may need a clearer storyline. The current presentation feels more like an exploration of several relatively independent research directions rather than a coherent investigation of a central problem. Organizing the paper around a specific research question might make it easier for readers to follow. This would also help clarify the core contribution and how each experiment supports the authors' main argument.
-
The paper uses too much defensive writing. Although this helps clarify the scope of the claims, repeatedly emphasizing what the paper does not claim tends to interrupt the flow of reading and makes the paper harder to follow.
-
The current experiments mainly demonstrate the feasibility of individual components under controlled settings. More comparisons with existing architectures may be needed to demonstrate the advantages of the proposed framework. For example, the external memory mechanism lacks a direct comparison with standard raw-text retrieval approaches, making it difficult to evaluate whether the additional architectural complexity is justified.
3 comments
Thank you for your explanation. However, it does not change my evaluation, and I will retain my score.
Clarification of the contribution being assessed
Thank you for considering the revision. We understand that you retain your recommendation.
For the final assessment, we would like to distinguish two claims. The paper does not establish that residual assembly is the best-performing integration operator. It does implement and evaluate an architecture in which document-state construction, artifact publication, and neural consumption have separate lifecycles, while memory observations and execution results enter the same recurrent computation.
The experiments examine successive interfaces in that path: retaining source information, locating an element, exposing its content, and rendering its contribution. Their component-level measurements make the integrated system diagnosable; they are not intended as unrelated proposals.
If the remaining concern is insufficient novelty or significance of this organization, we understand that judgment as distinct from a technical error in the reported construction or measurements. We would appreciate that distinction being reflected in the final assessment.
Response: coherent system contribution and the role of controlled experiments
Thank you for recognizing the unified interface for heterogeneous modules and for pointing out that the original narrative obscured it. Your observation about defensive writing was particularly useful: we have replaced repeated negative qualifications with a direct architectural explanation and a consolidated limitations section.
The motivation is an integration problem, not a claim that existing LLMs cannot use tools or knowledge bases. A document state, an execution result, and a contextual neural field have different update and verification requirements. FEM-ASM makes their boundaries explicit: local construction, versioned publication, support-aware readout, and shared neural assembly.
The architectural contribution is their combination in a working system. Memory workers do not update the core or synchronize document-state gradients. Published versions are consumed through fixed snapshots. Memory and VM observations use type-level rather than document-specific adapters. The revised algorithms describe these operations and the return path from external execution to neural output.
The experiments now follow this structure. Reconstruction evaluates retained source information; retrieval evaluates addressability; positional-readout comparisons evaluate access and rendering; fixed-core attachment evaluates the effect of newly available evidence. These are complementary tests of interfaces along one path, rather than independent proposals for four different systems.
We have also added the same-corpus 100B-token Transformer reference and retained explicit resource accounting. A matched raw-text comparison and an ablation against simpler injection operators remain open; we do not claim that the new reference resolves them.
We would appreciate reconsideration of the contribution as an implemented modular architecture with controlled interface evidence, rather than as a proposal for a superior standalone language model. The revision makes that intended contribution substantially more explicit.