- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper investigates the role of incentives on the long-term payoff of the firm in the context of strategic employees who might inflate their reports and an online learning system that learns from the data, An important observation is that the strategic employees would not only impact the current payoffs, but also the future payoffs due to their impact on the learning system. The incentives discourage the strategic inflation by imposing reporting costs. It is also shown how historical information might change the optimal long-term incentives, and how strategy-aware learning interacts with incentive design.
Critical strengths
The paper addresses a novel problem of how strategic agents can distort the results of learning by manipulating the inputs and how to address it through incentive design and history-sensitive learning. The formalization of this rather complex scenario is well executed and commendable.
The successful application of Fitted Q-learning is also interesting and worth noting.
Critical weaknesses
The paper addresses a somewhat narrow problem that is tied very closely to workforce management. It is not clear if there are any generalizable lessons here which are significant to the ICLR community. While the technical contribution here is strong, and the paper has some relationship to learning, it is not in the main stream of research on learning representations.
The formalization and the assumptions (eg, concavity) behind the theory appear very restrictive. It would be helpful if the authors provide a stronger justification behind them and address how relaxable they are.
The paper is highly mathematical and difficult to read. They should consider rewriting it in a way that the main paper is understandable to a broader audience with all the proofs moved to the appendix.
The experimental evaluation is quite narrow and based on synthetic data. The paper would be stronger if the theory is applied to more real world data.
Questions for authors
Can you provide more justification of the assumptions behind the theory, how restrictive they are, and if they can be relaxed in the future work? I am particularly concerned about the concavity assumption and the linearity of the learning model in the reported experiments. How critically do the theoretical and experimental results depend on these assumptions?