- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
AQUI addresses retrieval of personal memory facts that are relevant to a query through an implicit connection rather than topical similarity. It adapts the query branch of Qwen3-Embedding-8B with LoRA while keeping fact embeddings fixed, using 2,414 synthetic training rows with implicit positive facts and topical general-fact negatives. The paper evaluates retrieval on ImplexConv-Opposed and a rewritten ActMemEval-hard dataset, and evaluates answer generation after optional GEPA-optimized LLM reranking. It reports substantial improvements over the pretrained encoder and a full-encoder InfoNCE baseline, alongside lower memory-construction overhead than TaciTree and ActMem. The practical retrieval gains are promising, but the experimental evidence does not yet isolate the claimed source of improvement sufficiently.
Critical strengths
-
The reported first-stage retrieval improvement is substantial and does not depend on an inference-time LLM.
-
The method offers a simple deployment path with useful cost evidence.
-
The synthetic data pipeline is well aligned with implicit memory retrieval, combining cross-topic bridges with topic-matched hard negatives to provide targeted training supervision.
Critical weaknesses
-
The central ablation does not isolate asymmetry from the adaptation parameterization.
-
The independence of model selection from the reported evaluation is not established by the documented protocol.
Questions for authors
-
Under the same LoRA rank, target modules, training data, negatives, and comparable hyperparameter tuning, how does symmetric query-and-fact LoRA perform relative to query-only LoRA? Does the claimed advantage of asymmetry remain?
-
Which examples and split were used for early stopping and for ranking the configurations in Tables 7–8? Were these configurations selected exclusively using synthetic validation data, with the displayed benchmark recalls computed only afterward, or did benchmark recall influence selection?
We appreciate the reviewer for thoughtful comments. We would like to offer clarifications for each point.
Weakness 1 and Question 1
We would like to clarify that both Naive-InfoNCE and AQUI embedding model training used LoRA adapters with the same rank. Both used the identical training dataset and epochs with different hyperparameters. We conduct hyperparameter search for each of them.
Please take a look into line 426 of the rebuttal revision.
Weakness 2 and Question 2
We apologize for the insufficient description and our oversight. Table 7 shows the results aligned with the ImplexConv dataset, and the best score of the ImplexConv dataset re-appears in Table 1. This is not how we intended to run the hyperparameter search. The benchmark recall should not have affected the selection. Our hyperparameter search intended to use a held-out validation synthetic dataset with the size of 10% of the training dataset. We used mean validation hit@{10, 20, 50, 100} and re-selected the hyperparameters. We update Table 7 in the rebuttal revision as follows.
We updated Table 1, 2, 10 and Figure 5 to account for this change. Most importantly, AQUI still outperforms the baselines in both ActMemEval-Hard and ImplexConv datasets by wide margins.
Please refer to line 757 of rebuttal revision.