- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper introduces a framework, called Navalia, for training cowork agents which combines verifiable task synthesis with long horizon post training. The authors instantiate Navalia in the context of financial document analysis, showing gains over the base model on a suite of financial analysis benchmarks. For this framework, the authors generate syntheic data using a synthetic task generation pipeline, followed by long horizon reinforcement learning to train the specialize the model on these tasks.
Critical strengths
- The authors explain the methods used in a clear and coherent manner.
Critical weaknesses
-
The framework of synthetic task synthesis followed by reinforcement learning has been well established by many industry publications [DeepSeek-AI 2025, Chang 2026, Kabra 2026]. As a result, the novelty of the methods outlined in this work are unclear. I would hope for further clarifications for how this differs from prior work.
-
The paper lacks any ablations, making it unclear what design decisions lead to the performance increase. It would be nice to provide some ablations of other training methods (both end to end and replacing parts of the pipeline) to see what is necessary.
-
The paper should compare this framework to other possible frameworks for agentic training. At present, the only comparisons are to untrained large open and closed weight models.
[DeepSeek-AI 2025] DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models, https://arxiv.org/pdf/2512.02556
[Chang 2026] KARL: Knowledge Agents via Reinforcement Learning, https://arxiv.org/pdf/2603.05218
[Kabra 2026] Learning from Synthetic Data Improves Multi-hop Reasoning, https://arxiv.org/pdf/2603.02091
Questions for authors
- Can you clarify what the main novelty of this work is in relation to the aforementioned works? How does this differ from previously published agent training pipelines?
- Can you ablate data generation and RL pipelines? Specifically: is SFT necessary? How does this task synthesis compare to taxonomic synthesis as proposed by Deepseek?
- If I understand correctly, FIFO context management will hurt the KV cache during serving time? How would this compare to summarization?
3 comments
Response to Reviewer KxN8 (2/2): W2 / Q2, W3, and Q3
W2 / Q2
We use SFT as a cold start so that the model can first learn effective evidence retrieval, tool use, and multi-step analysis from high-quality teacher trajectories, providing a better initial policy for subsequent RL. For these long-horizon tasks, if the initial policy struggles to retrieve evidence and perform calculations effectively, rewards based on the final answer may provide insufficient learning signals.
We have added comparisons of training stages and sampling strategies. OfficeQA Pro accuracy is reported below:
| Setting | Accuracy |
|---|---|
| Initial model: Qwen3.6-35B-A3B | 39.60% |
| SFT: unbalanced sampling dominated by basic retrieval | 56.27% |
| SFT: balanced sampling | 59.94% |
| SFT + RL | 62.66% |
SFT improves accuracy to 59.94%, and RL further raises it to 62.66%. Balanced sampling improves accuracy by 3.67 percentage points over sampling dominated by basic retrieval. These results support our training recipe of a cold start with high-quality trajectories, balanced task sampling, and subsequent RL.
In addition, Table 2 in the original manuscript compares FIFO with a per-turn sliding window to examine the role of context handling, while Figure 2(c) analyzes evidence retrieval before and after training. We will add the new ablation results and their experimental settings to the revised manuscript alongside these comparisons and analyses.
W3
We would like to clarify that models such as Kimi and GLM have already undergone targeted training for agentic capabilities. For example, Kimi's public report describes large-scale tool-use data synthesis and reinforcement learning, while GLM's report describes multi-step tool-call trajectory synthesis and reinforcement learning for search and coding agents. These training processes directly involve tool use, information retrieval, and multi-step reasoning. It is therefore inaccurate to characterize these comparison models as lacking training in the relevant capabilities.
Table 1 evaluates Navalia's overall performance relative to these strong models. The additional SFT, SFT + RL, and task-sampling ablations further examine the roles of individual training choices in Navalia. We will add the training background of the comparison models, along with the new experimental results and detailed settings, to the revised manuscript.
Q3
Removing early interactions under FIFO can reduce KV cache reuse. We update the window once every 10 new turns; unchanged prefixes can still be reused during the intervening turns.
We adopt FIFO primarily to control context length and keep the context consistent between training and trajectory generation. Compared with summarization, FIFO directly preserves recent interactions without requiring an additional summary-generation step. Summarization can retain important information from earlier interactions, but rewriting the history can also affect cache reuse. We will briefly clarify this trade-off in the revised manuscript.
I thank the authors for their response and am grateful for both the comparison and ablations that were done.
I agree with the authors that these open models have undergone significant agentic training. However not in a similar targeted manner. For example, I would have liked to see comparisons of Navalia's method for synthetic question generation to DeepseekV3 and KARL pipelines, using the same base model and corpus. I appreciate the discussion, but it otherwise is unclear to me the exact quality of the method. For this reason, I will maintain my score.
Response to Reviewer KxN8 (1/2): W1 / Q1
Thank you very much for your careful review.
W1 / Q1
Navalia's main distinction lies in how it constructs analytical tasks from real documents with traceable evidence, actual computational dependencies, and verifiable answers.
Compared with DeepSeek-V3.2, the main difference is the environment the agent operates in and how tasks are constructed for it. Its General Agent pipeline builds databases and task-specific tools around task categories, then generates tasks that require using these tools. Navalia instead retains a document environment composed of real financial reports, where the agent must locate evidence across files and tables, reconcile metric definitions and reporting scopes, and perform calculations. Our task construction therefore focuses on selecting evidence from existing documents that jointly supports an analysis, and designing computational tasks from that evidence. The internally extracted structured facts are used only for construction and verification, and are not provided to the solving agent.
Compared with KARL, the main difference is whether an explicit computation chain constrains question generation. KARL generates question-answer pairs from retrieved documents, then checks the samples through repeated solving and quality filtering. Navalia first specifies which facts to use, which operations to perform, and how each step uses the results of preceding steps. It computes the reference answer before generating the question from this chain. The requested operations and final answer are thus grounded in an explicitly recorded computation chain, allowing us to check evidence sources, computational results, and dependencies step by step, followed by independent review after generation.
Compared with Kabra et al., the main difference is the task setting. Their work uses rules to generate fictional facts and relations, and places all materials needed to solve a problem directly in the model's input. It focuses on training models to connect facts within those materials and perform multi-hop reasoning. Navalia instead constructs tasks from real documents and requires the agent to independently retrieve supporting evidence from a workspace containing distractor documents, check reporting periods, metric definitions, and units, and then perform multi-step numerical calculations. The internal fact database and computation chains used during construction are not provided to the solving agent.
We will add these comparisons to the main text and Related Work discussion to clarify the task differences and the corresponding designs for evidence selection, consistency checks, and computation-chain verification.