- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
FinGym presents a framework for generating financially grounded environments and tasks for training financial agents. It combines financial knowledge, real-world data, and tools to create executable RL environments. Using 73 environments and 5,040 verified tasks, FinGym-trained agents achieve significant improvements over base models across five financial benchmarks.
Critical strengths
- The paper proposes a domain-specific solution targeting real problems in financial agent post-training.
- The trained models achieve relatively promising performance.
- The analysis experiments are relatively comprehensive, with interesting discussions on cross-scenario contributions and scaling.
Critical weaknesses
- Compared with general agent environment scaling methods, this paper seems to mainly add financial-domain grounding.
- The experimental comparison is not entirely fair: compared with EnvScaler-8B, AWM-8B, and TOUCAN-7B, this paper uses a more advanced base model and stronger models, and it does not compare the amount of training data used. Therefore, it is unclear whether the improvements over previous works come from the FinGym framework itself, or from the stronger base model, stronger models, or larger training data scale.
- Whether human involvement reduces environment scalability should be discussed more thoroughly.
Questions for authors
- What are the differences between the environments constructed by FinGym and real-world financial environments?
- How much does FinGym’s performance improvement come from the proposed environment synthesis framework itself, rather than the stronger base models or larger training data scale compared with previous environment scaling methods?
- How does the involvement of human experts affect the scalability and cost of constructing financial environments in FinGym?
4 comments
Response to Reviewer GxaC: second part
Weakness 2 & Question 2: Performance Gains Attributable to FinGym’s Environment Synthesis
Thank you for raising this important question. We ran an additional experiment to test whether FinGym’s gains persist when all methods use the same base model and number of training tasks. We used AWM, TOUCAN, and EnvScaler to generate 5,040 tasks each, then trained Qwen3.5-4B model on each dataset and compared the resulting models with FinGym-4B.
Table A: Effect of environment synthesis methods on Qwen3.5-4B.
| Synthesis method | FinMCP-Bench ↑ | Finova ↑ | FinVault ↓ | StockBench ↑ | InvestorBench ↑ |
|---|---|---|---|---|---|
| AWM | 33.94 | 59.32 | 31.75 | 0.72 | 0.93 |
| TOUCAN | 33.83 | 58.99 | 28.68 | 0.89 | 1.21 |
| EnvScaler | 33.14 | 59.79 | 31.90 | 1.08 | 1.09 |
| FinGym | 35.07 | 61.40 | 26.70 | 4.01 | 1.55 |
As shown in Table A, FinGym-4B outperforms all three baselines on all five benchmarks when the base model and number of training tasks are held fixed. Compared with the strongest baseline on each benchmark, FinGym-4B gains 1.13 points on FinMCP-Bench and 1.61 points on Finova, and lowers the FinVault aggregate score by 1.98 points. It also improves the StockBench Sortino ratio by 2.93 and the InvestorBench Sharpe ratio by 0.34.
We also observe that most retrained baselines outperform their corresponding released checkpoints in Table 4. For example, the retrained AWM model scores 33.94 on FinMCP-Bench and 59.32 on Finova, compared with 30.76 and 55.28 for the released AWM-8B checkpoint. This supports the reviewer’s point that differences in the base model and training setup can affect the comparison. We will include the experimental setup and results in the revised manuscript.
Weakness 3 & Question 3: Impact of Human Experts Involvement on Scalability and Cost
Human experts were primarily involved in two aspects of the framework. For rubric synthesis, they review financial rules informed by domain knowledge and failed teacher rollouts. These rules guide the construction of task-specific rubrics (Section 3.3). For environment synthesis, they review the specifications generated by the LLM and refine the selected components where needed to better reflect the user’s requirements (Section 3.2).
Importantly, the results of human review can be reused across tasks. Once reviewed, a financial rule can guide rubric synthesis for any task to which it applies. Similarly, a reviewed environment specification can be used to generate new tasks with similar requirements, supporting scalability while amortizing the initial human effort.
Moreover, the ablation results in Table 7 show that removing human environment calibration leads to only modest performance changes across all five benchmarks (only 0.24–0.97 points), indicating that the automated synthesis pipeline remains effective without human calibration, while expert involvement provides consistent additional gains.
Gentle Follow-up to Reviewer GxaC
Thank you again for your valuable comments. In our previous responses, we clarified FinGym's methodological and practical contributions, provided additional controlled comparisons against three environment synthesis baselines, and further analyzed the impact of human expert involvement on scalability.
We truly appreciate the time and effort you dedicated to reviewing our work, and your comments have been very helpful in improving the paper. We hope these clarifications and additional evidence have adequately addressed your concerns. If any concerns remain, we would be more than happy to discuss them further and provide any additional information needed to address them.
Gentle Follow-up to Reviewer GxaC
Thank you for your thoughtful review and comments
We have now incorporated the relevant revisions into the updated manuscript PDF, with all changes highlighted in and their locations summarized below:
- W1, Q1 (FinGym’s methodological, empirical, and resource contributions, and its relation to real-world financial environments): Lines 210-212, 204-206, and Appendices C.1.3 and C.2.
- W2, Q2 (Controlled comparisons and performance gains attributable to environment synthesis): Lines 387-389,and Appendix C.6.1.
- W3, Q3 (Expert involvement, reuse, scalability, and amortization of human effort): Lines 204-206, and Appendix C.2.
We hope these revisions help address your concerns. We would be grateful if you could consider updating your evaluation score based on the additional experiments and clarifications presented in the revised manuscript.
Thank you again for your time and consideration.
Response to Reviewer GxaC: first part
We thank the reviewer for recognizing the practical relevance of our domain-specific framework, the promising performance improvements, and the comprehensive experimental analysis, particularly regarding cross-scenario contributions and scaling behavior. We address your concerns and questions below:
Weakness 1 & Question 1: FinGym’s Contributions and Relation to Real-World Environments
Thank you for these questions. We would like to clarify the contributions of our work from three perspectives.
1. Methodological contribution: grounding task generation and reward construction through explicit financial environment specifications. Given a user requirement, FinGym composes reusable financial components into an environment specification defining participants, tools, objectives, financial constraints, and workflow dependencies. This specification guides task generation and, together with teacher execution evidence, informs task-specific rubrics. The financial knowledge thus shapes both what agents are asked to do and how their behavior is rewarded. Components and specifications can be reused to generate additional tasks as training requirements evolve.
2. Empirical contribution: demonstrating the value of financial knowledge integration and studying environment scaling. FinGym improves agent performance across five financial-agent benchmarks, supporting both the importance of financial knowledge and the effectiveness of our approach to incorporating it into tasks and rewards. We further investigate how performance changes as environment coverage expands, revealing overall gains from broader coverage and complementary training benefits across financial scenarios.
3. Resource contribution: enabling reuse, reproduction, and continued extension. We released our code, 73 financial environments, 5,040 verified tasks, and trained models. Users can directly use the released environments, tasks, and models, or apply our synthesis pipeline to construct additional environments and tasks tailored to their own financial requirements.
Regarding Question 1, FinGym preserves key requirements of real financial workflows. Agents gather evidence through tools, complete interdependent operations, and make decisions under financial constraints. These requirements apply to workflows such as fund information retrieval, product comparison, and authorization checks. In investment and trading scenarios, historical market data provide factual context where applicable, while the modeled constraints include available cash, holdings, transaction costs, and trading quantity limits.
The main difference from real-world financial environments is that these workflows run in a simulated, repeatable setting. Agents receive simulated tool responses without moving real funds or modifying real accounts, and tasks can be rerun from the same starting conditions. This supports repeated training and controlled comparisons while avoiding the operational risks of experimenting with real accounts. However, this controlled setting simplifies real-world complexity. The current task set may not fully capture rare market events, extreme trading conditions, or unexpected operational disruptions. We will clarify these contributions and the scope of the synthesized environments in the revised manuscript.