- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a method to improve reinforcement learning performance when reward corruption is weakly related to the context. They trained a model to predict a trust value, and used it to weight the loss function. The empirical results showed that their method improve the RL tasks performance under corruption.
Critical strengths
1)The statement of the logic of this paper is clear to me.
2)The assumption of this paper and the high-level idea of the corresponding method make sense to me.
Critical weaknesses
1)To my understanding, you use mostly average information from the context for the temporal part. But I’m worried that much information belonging to the MDP could be lost. Therefore, I doubt that by only using this information in the temporal part, the predicted trust value could be not that informative.
2)I hope the author can clarify the novelty of their method more clearly, as stated in my question part.
Questions for authors
1)To my understanding, you tried to train a model to judge if an (action, state_t, reward, state_t+1 ) pair follows(at least to some extent) the real local distribution of the MDP. I think it’s something that could be highly motivated when people study DRL problems under reward pollution or non-stationary MDP settings. I wonder if there are some close previous work that use similar methods?