- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes two mechanisms for reinforcement learning in economic policy design. EI-MARL regularizes government policies toward classical economic rules with a decaying penalty and adds an Euler-consistency loss for households. MG-Coord combines communication between government agents with a gradient-conflict penalty while retaining separate institutional rewards. Experiments in simulated economic environments report improvements in sample efficiency, welfare, and joint policy outcomes.
Critical strengths
The paper considers a relevant policy-design problem involving fiscal, monetary, and pension authorities with distinct objectives. Explicitly retaining these separate objectives is a potentially useful starting point for studying interactions among policy authorities.
Critical weaknesses
-
The presentation is incomplete, and the underlying economic environment is insufficiently specified. Multiple references to sections, tables, and appendices remain unresolved, and Section 5.3 contains only a heading. More substantially, Sections 3 and 4.1 describe economic roles and interactions without specifying the budget equations, market-clearing mechanism, feasible action sets, transition dynamics, or precise reward functions. These details are repeatedly deferred to an appendix that is absent from the provided PDF; no supplementary-material link is visible on the submission page. Consequently, it is difficult to assess the economic consistency of the environment or interpret and reproduce the reported results.
-
The methodological novelty and justification for the design choices are insufficiently established. Section 4.2 uses policy regularization toward reference rules, an approach related to established policy-guidance methods such as Distral and Kickstarting. Section 4.3 combines attention-based communication with gradient alignment. The paper does not sufficiently establish what is technically new in these components or their combination. It also provides limited justification for why these particular techniques are well matched to the stated difficulties. Although the experiments include component ablations and a parameter-sharing baseline, they do not adequately distinguish the proposed contribution from relevant existing approaches to policy guidance and coordination.
-
The application does not establish a sufficiently clear economic insight. Economic rules provide reference policies, but their applicability to the simulated economy and the interpretation of deviations from them receive limited discussion. Likewise, the paper does not adequately connect conflicts between gradients in shared parameters to concrete policy externalities or institutional trade-offs. The experiments primarily report aggregate performance improvements without explaining the economic mechanisms behind them. Applying established techniques to economic policy design could be valuable, but the paper does not sufficiently demonstrate what new understanding of economic behavior or policy coordination this application provides.
Questions for authors
-
Where can the complete economic model and implementation details be found? In particular, how are budget feasibility, action bounds, and market clearing implemented, and what are the exact institutional reward functions?
-
What distinguishes the proposed mechanisms from existing policy-guidance and coordination methods, and what evidence supports their suitability for this setting beyond the reported component ablations?
-
What economic mechanism explains the reported coordination gains, and how does alignment of shared-parameter gradients correspond to the policy trade-offs among the three authorities?