- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies the problem that delayed feedback may cause the actual optimization objective of a learner to deviate from the true objective. The authors distinguish Structural Loss and Routed Loss, introduce the Action-gap Distortion metric, and use three theorems to discuss regret transfer, objective conflict, and non-identifiability. Finally, they conduct experiments in simulated environments and on real-world datasets.
Critical strengths
- The distinction between Structural Loss and Routed Loss is reasonable, and helps to discuss the difference between feedback attribution and the true optimization objective.
- The mathematical formalization is relatively complete, and the main results also provide their corresponding conditions of applicability.
Critical weaknesses
- The authors seem to write many intuitive or even obvious conclusions as theorems. Theorem 1 is essentially just a perturbation bound between two loss vectors, and it can hold even without delayed feedback. Theorem 2 proves that two objectives with persistent conflict cannot both be optimized well, which is almost directly determined by its assumptions. I think the authors seem to be assigning mathematical symbols to common sense, and then proving that these symbols satisfy the expected relations.
- The main regret bound compares the results of the same action sequence under two loss functions. It does not analyze how incorrect feedback changes the learner's future decisions. In addition, the validation method proposed by the authors requires knowing enough true outcomes, but obtaining such information is exactly one of the most difficult parts in real-world applications. Although the authors spend a lot of space on mathematical derivations, they do not really solve the most difficult part of the problem. I am confused about the practical value of this framework.
- The experiments seem more like verifying answers that have already been written in advance. For example, Experiment 1 artificially creates feedback misalignment, and then shows that misalignment causes regret. Experiment 2 uses different advertising attribution rules and finds that different rules produce different results. These phenomena are really not surprising, and the latter experiment does not even provide evidence about which attribution rule is correct. Overall, these experiments look more like unit tests for the authors' definitions, rather than discovering any new scientific phenomena.
Questions for authors
The main theoretical results of this paper seem to be quite straightforward, and some conclusions do not even depend on delayed feedback. Could the authors explain more clearly what new theoretical insights these theorems actually provide compared with existing studies?