- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper revisits latent memory generation through the What–Where–When perspective. On four Qwen architectures and four inference benchmarks, the authors verify that their method performs better under most evaluation configurations.
Critical strengths
- Relatively sound writing and presentation.
- From the results shown in this paper, the effect of the method is considerable.
Critical weaknesses
- The motivation of this paper needs further clarification. In general, research focuses on a class of strategies and methods that can solve the general problem in this field. However, the method proposed in this paper seems to be entirely incremental optimization for MemGen, and the proposed methods are also designed for the components in MemGen, which makes it difficult to agree with the rationality of the motivation.
- Furthermore, the authors analyze issues from a specific approach and scenario and solve them, which is more like an optimization of MemGen rather than new research work.
- It can also be seen from Section 3 that the innovation of the paper is designed for each module of MemGen. In this case, the paper does not introduce any comparison method (in other words, there is no other comparison method for this specific case), so the author needs to further clarify the motivation and research value of this paper. Or introduce more comparative methods to highlight technical contributions.
- Although providing code is not required, the paper provides links to a broken repository.
- The chart in the paper should include more captions, such as experimental setup, background, and a brief conclusion, to improve readability.
Questions for authors
My main questions concern the article's motivation and actual contribution. For me, this is an incremental optimization of MemGen, not an innovative work. The author needs to answer the following questions:
- Can the proposed approach be adapted to other frameworks?
- How can technical contributions be highlighted in relatively niche research scenarios?
- Is the proposed method optimized and designed for MemGen, or is it designed and optimized for problems that are common to the field?
- Is the proposed approach also applicable to future frameworks?
In general, the overall quality of the paper is considerable, but the author needs to clarify my concerns further and provide data support, and I will consider raising the score.
8 comments
Response to Reviewer NND4 [Part 2/3]
Response to Q1:
DAR provides a concrete example of a component that could be adapted to another framework. SoftCoT obtains continuous representations from an auxiliary model and maps them into a frozen reasoner through a trainable projection. This provides an interface in which the layer used to extract these representations can be varied. SoftCoT
A simple transfer experiment would compare final and intermediate layer readout in SoftCoT under matched training and evaluation conditions, with the projection trained separately for each configuration. This would test whether our findings on readout depth extend beyond MemGen. Such an evaluation is beyond the scope of the current study, and we leave it as a direction for future work.
Response to Q2:
Although our experiments use MemGen, the practical need they address is broader: how to supply useful information to a frozen reasoner through compact latent representations. This need arises in several application settings.
- Reasoning augmentation: Auxiliary models can provide continuous representations that support the reasoning of a frozen model, as illustrated by SoftCoT. Our findings can inform decisions about the reasoning information used for supervision and the representations supplied to the reasoner, both of which matter when enhancing reasoning without updating the main model’s parameters.
- Retrieval augmented generation: Frameworks such as CARE encode retrieved context into compact memory representations. In this setting, the amount and relevance of the supplied information are important design concerns. Our emphasis on selective retention addresses a related need: compression guided by task feedback aims to preserve useful information while reducing redundancy and the influence of irrelevant content. CARE
- Extended multimodal reasoning: As generation unfolds, a model may need to reuse visual evidence or reasoning constraints. DLMR illustrates this need through dynamic latent memory injection. Our investigation of invocation timing provides a design direction for determining when such information should be made available during reasoning. DLMR
These examples illustrate shared application needs and identify systems that could potentially benefit from our findings. We will make these connections more explicit in the revised manuscript, while distinguishing potential applications from the settings empirically evaluated in this work.
Response to Reviewer NND4 [Part 3/3]
Response to Q3:
Our methods are motivated by design problems shared by a class of latent memory augmentation systems, and MemGen provides the platform on which we implement and evaluate them. The underlying questions concern how to preserve useful reasoning information, select suitable memory representations, and determine when memory support should be provided.
| Component | Shared research problem | How we investigate it in MemGen |
|---|---|---|
| CSMC | How can useful reasoning information be learned and retained under a limited memory budget? | We examine richer CoT supervision and separately study the effects of compressing the generated memory before injection. |
| DAR | Which internal representations are suitable for supporting downstream reasoning? | We compare intermediate and final layer readout while retaining the same supervision and memory budget. |
| RSAT | How should memory access respond to the evolving needs of a reasoning process? | We use predictive entropy to select opportunities for consulting the memory controller, extending consideration beyond punctuation boundaries. |
For example, punctuation gating is a specific choice in MemGen. We choose predictive entropy because it reflects the model’s current predictive uncertainty at each decoding step. Beyond its role in RSAT, this choice highlights a broader research perspective: memory access can be studied in relation to the model’s evolving state and potential need for additional support. This perspective may inform other work on memory augmentation by encouraging the joint consideration of memory quality and the timing of its use, alongside improvements in memory construction and retrieval. Predictive entropy provides one concrete signal for exploring this relationship. Similarly, the supervision and readout choices in MemGen instantiate broader questions about memory content and representation.
We chose MemGen because it exposes all three choices within one architecture and allows controlled comparisons with a frozen reasoner. Our implementations and current empirical evidence are based on this platform, while the research motivation concerns these broader design problems.
Response to Q4:
We expect these design principles to remain relevant to future frameworks that use latent memory to support a frozen reasoner. They can guide the design of memory interfaces as information sources, memory generators, and invocation controllers become more diverse.
- What to remember: Future frameworks may combine information from retrieved documents, interaction histories, and specialized memory generators. These sources can contain overlapping information or content that is irrelevant to the current task. Applying this principle would involve selecting and consolidating useful information within the available memory budget, while reducing redundancy and noise. The selection criteria could also adapt as the task or available information changes.
- Where to extract: A framework may employ memory generators with different architectures, depths, or modalities. For generators that expose representations at multiple depths, the readout choice could be adapted separately for each generator according to how effectively its representations support the downstream reasoner. A shared projection interface could then map these different representations into the reasoner’s input space. This would allow a framework to accommodate heterogeneous generators without requiring them to use the same extraction depth.
- When to recall: Future controllers may jointly decide whether to invoke memory, which source to access, and how much information to inject. The reasoner’s uncertainty could serve as one input to this decision, alongside the available memory sources and computational budget. For example, an uncertain reasoning step could prompt the controller to consider relevant memory, while the controller determines whether an invocation is useful and which source is most appropriate.
In these settings, adaptation would involve incorporating the design principles into the new framework’s memory and control interfaces. The specific readout depths, compression ratios, and uncertainty thresholds would be selected and validated for the target models and tasks. This provides concrete directions for future evaluation as memory architectures evolve.
Response to Reviewer NND4 [Part 1/3]
We thank the reviewer for the constructive feedback on the motivation, contribution, and broader applicability of our work. We respond to each concern below.
Response to W1:
We agree that the current presentation does not sufficiently distinguish the broader research questions from their implementation in MemGen. Our motivation is to understand how generated latent representations can effectively support a frozen reasoner. This involves three key choices: what the memory generator learns and retains information, where the generated memory is represented and passed to the reasoner, and when the memory should be supplied during reasoning.
We chose MemGen because its architecture exposes all three choices within one system, enabling controlled comparisons while retaining the same frozen reasoner and memory generation interface. We will revise the Introduction to establish these research questions before introducing MemGen as the experimental platform, and clarify which conclusions have been demonstrated within MemGen and which require further validation across frameworks.
Response to W2:
The contribution lies in examining how supervision, representation extraction, and memory access affect the usefulness of latent memory under a frozen-reasoner constraint.
For example, our CSMC compression can also be understood as a process of denoising memory. By aiming to reduce redundancy and noise in memory representations, CSMC provides a potentially useful perspective for studies on latent memory. More broadly, existing memory-related work studies how to construct memories, how to retrieve them, and when to access them. Our RSAT investigates this timing question in latent memory generation. Specifically, token-level entropy can be used to characterize the model's reasoning state and identify candidate positions for consulting the memory controller. This criterion could be extended to a wide range of memory-based methods, providing a general mechanism for adaptive memory access.
Together, these comparisons address distinct design questions rather than attributing all improvements to a single modified system.
Response to W3:
We agree that comparisons restricted to MemGen variants are insufficient to establish broader applicability. We are supplementing the evaluation with a frozen-reasoner baseline using plain CoT prompting, the combined CSMC–DAR–RSAT system, and component ablations. These experiments cover Qwen2.5-7B on GPQA with and SVAMP(86.9% is the Qwen2.5-7B-Instruct result reported in CARFT (Zhu et al., 2025)) three random seeds and a maximum generation length of 1,024 tokens.
Table R1. Supplementary accuracy (%) under matched evaluation settings.
In future work, we will compare our method with other relevant approaches. However, due to current resource constraints, we first conducted the relevant ablation experiments to analyze the contribution of each component.
Response to W4:
We apologize for the difficulty accessing the repository. The URL in the submitted PDF was split across lines without an embedded hyperlink, which may have caused some PDF readers to recognize an incomplete address. We will correct this in the revised manuscript. The correct link is https://github.com/anonymous-researcher-coder/latent-memory.
We are still conducting ablation experiments and preparing the code for release. We plan to organize and upload the code, with the release tentatively scheduled for December 2026.
Response to W5:
Thank you for this suggestion. We will expand the captions to specify the experimental setting, comparison being made, evaluation metric, and principal observation.
For example, the caption of Table 1 will explicitly distinguish the effect of CoT supervision from the additional effect of compression and state the corresponding memory budget reductions. The captions of Tables 2 and 3 will specify the readout depth and triggering comparisons, respectively. The supplementary tables will also identify the number of seeds and explain how variability is reported.