- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies latent input tuning for a frozen LLM, where a small trained module produces continuous vectors that help the model reason. It first shows that for SoftCoT and EBM-CoT the injected vectors are nearly the same for every question: replacing each question's vectors by their average over the test set (or swapping them between questions) leaves CLUTRR accuracy unchanged (40.4 to 40.4, and 38.5 to 38.5), and 99.9 percent of their energy is a shared component. For LRT the loss is about 20 points. The authors then propose self prompted latent reasoners. The question is passed through the first 8 of the 28 layers of a frozen Qwen2.5 7B Instruct, the hidden state at each position goes through a trained mapper (a 3584 by 3584 matrix initialized at the identity, a bias for each round and a scalar gate, 12.9M parameters), is rescaled to the norm of the embedding table, and is added back onto the input embedding of the same token. The full model then reads the corrected question and generates the answer. Nothing is appended to the input and no auxiliary model is needed.
Results? Under a shared answer only protocol (32 new tokens), the method reaches 50.5 on CLUTRR, 88.0 on ProsQA and 99.6 on ProntoQA, above prompt tuning, SoftCoT, EBM-CoT and LRT. On GSM8K and AQuA with written solutions it is level with the trained baselines (78.7 and 61.3) and below zero shot CoT (84.5 and 80.3). Further analyses cover the choice of read layer, parameter matched comparisons, a read out probe, latency, repeated feedback rounds, depth breakdowns and a 3B host.
Critical strengths
The diagnosis of existing methods is clear, cheap to reproduce and results convincing. The average substitution and swap tests (Table 3, Appendix F) show that SoftCoT and EBM-CoT inject an essentially constant vector and that a single learned prompt does as well or better. This is a useful negative finding for anyone working on soft prompt style reasoning, and the test itself (replace per question signals by their average) is a good general sanity check that could be adopted by other papers.
Additionally, the proposed method is minimal and the supporting analyses are more careful than usual. The parameter matched comparison (rank 64 mapper reaches 76.3 on trained CLUTRR depths against 53.6 for a prompt of the same size) rules out simple capacity explanations. The read out probe comparison shows the answer is not simply decodable from the layer 8 state (probes reach at most 56.3 on trained depths against 88.8 for the method). The paper also reports its failures openly: repeated rounds with a constant read layer collapse (accuracy falls from 48.9 to 22.2 on CLUTRR, and to 0.25 percent on ProsQA from six rounds onward, where the model stops emitting a parsable answer), the unseen depths show no gain, and the arithmetic datasets show no gain.
Critical weaknesses
The main comparison is run under a protocol that favors the method, and an obvious baseline is missing. The headline multi hop results are measured with answer only supervision and a 32 token budget, which by design excludes written reasoning, so the host's own chain of thought cannot help. Where written reasoning is allowed (GSM8K and AQuA), no trained method beats the untrained zero shot CoT host, and the proposed method is slightly below prompt tuning (78.7 vs 79.6 on GSM8K). More importantly, there is no parameter efficient fine tuning baseline: a LoRA or similar adapter with a comparable parameter budget (about 12.9M) trained on the same data and loss is the natural alternative for adapting a frozen host to a task, and the related work argues against it on forgetting grounds without measuring forgetting. Without that comparison it is unclear whether question conditioning is what matters, or simply having a trained module that touches every input position. In addition, Appendix A states that the chat templates differ across method families and that the effect "has not been measured": the SoftCoT family is evaluated with a closed user turn and no assistant generation prompt, while the proposed method, prompt tuning and zero shot CoT use the host's chat template with the generation prompt. EBM-CoT also had one diverged ProsQA seed excluded from the reported mean. These are small details individually, but they all fall on the baselines' side.
Questions for authors
1/ How much does the chat template difference in Appendix A matter? Please rerun SoftCoT and EBM-CoT with the generation prompt appended, or the proposed method with their template.
2/ Were excluded runs (the EBM-CoT ProsQA seed) the only exclusions, and what is the mean including it?
3 comments
Response to cEW2 (part2)
Q2 on excluding seeds:
We thank the reviewer for pointing out this ambiguity. This was the only exclusion in the original paper. We have further tested 7 seeds for EBM-CoT on ProsQA, resulting in performance of 73.62, 70.12, 2.50, 68.00, 74.25, 73.38, 70.38. On seed 44, the training diverged. Given that this is not very frequent in EBM-CoT and for a fair comparison using EBM-CoT as a baseline method, we excluded seed 44. The ranking that our method is above EBM-CoT on ProsQA remain unchanged either way, and this exclusion only favored the baseline.
For the revision we apply the same rule to every method and dataset. A seed will be excluded from the table mean if its training diverges or if its test accuracy is more than 10 points below the median of that method's seeds on that dataset. We have provided all excluded unstable seeds and their effects on the statistics in Appendix A, and these will not influence our main claims.
Q1 and Q2 have been addressed
Thanks for the rebuttal, while my concerns on Q1 and Q2 have been mostly addressed, my biggest concern on LoRA remains. With LoRA at the same parameter count matching it, the method is no longer better than the obvious alternative, only different. I will hence remain my score.
Response to Reviewer cEW2 (part1)
We thank the reviewer for the detailed review and questions. Here we address each of the weakness and question:
W1 on parameter efficient fine-tuning baselines:
We thank the reviewer for pointing out this interesting comparison that has not been well tested in related latent reasoning works. We tested our method with LoRA on Llama-3.1-8B across the multi-hop reasoning benchmarks.
Our method remains comparable performance against LoRA with the similar amount of trained parameters. Note that our method does not touch the model’s own weights and is thus orthogonal to the fine-tuning family of methods. The more informative comparison is with the methods that keep the weights fixed, and in our measurements, other input-side tuning of a frozen model, performs below ours as shown in the main experiment. These results have been added to Appendix I, Table 13 in the revision.
On forgetting, we agree with the reviewer that weight adaptation’s forgetting was only supported through related literatures. This argument is not essential for our main contribution and has been removed.
On question conditions versus a trained model that touches every input position, we have tested in Table 5 in the paper replacing each question’s correction with the correction average over questions. The module still touches every position, yet CLUTRR accuracy drops from 50.5 to 8.4. Swapping in another question's correction gives 10.1. The gain is therefore carried by the part of the correction that is specific to the question. On the other side, LoRA does not contradict this. Its weight update is applied to each question's own activations, so its effect is also question dependent. What our method shows is that this question dependence can be obtained without touching the weights, using the frozen model's own intermediate state supplies it at the input as an orthogonal approach.
W2 on testing protocols:
Every trained method uses the same protocol: prompt tuning, SoftCoT, EBM-CoT, LRT and LoRA are all trained on answer-only targets and decoded with 32 tokens. Within the trained methods, the protocol therefore favours none of them. The untrained host's zero-shot CoT is given 2048 or 4096 tokens to write out its reasoning.
We also compare in two further settings:
These details have been added to Section 4 and Section 5.2 in the revision.
Q1 on SoftCoT and EBM-CoT evaluated without the generation prompt:
We thank the reviewer for pointing out this issue. We reran the written reasoning experiments (GSM8K and AQuA) with same template for every method, including the raw question in the host chat template with the generation prompt. SoftCoT and EBM-CoT keep their soft-thought paragraph.
Under one template, all methods are within about one standard deviation of each other and of the host. Given that the host had been trained on much better arithmetic datasets and already have the corresponding ability, the main purpose of this experiment is to show that our method maintain the host ability to handle arithmetic tasks while improving its multi-hop reasoning performance. We have replaced Table 2 with this table and update Appendix A. These results have been updated on Table 2 in the revision.