- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies the statistical difficulty of selecting an optimal policy in a structured Markov decision process, particularly when multiple policies are tied and the transition model has low-rank singularities.
Critical strengths
Due to the poor presentation, I cannot fully understand this paper and verify the correctness and soundness of this paper. If we assume that the results are correct, then the possible strength is: this paper establishes an exact local asymptotic minimax characterization of structured MDP policy selection through a Gaussian decision problem, showing that difficulty depends on the alignment between feasible transition perturbations and policy-value gradients, rather than transition rank alone.
Critical weaknesses
The presentation of this paper is extremely poor and needs another round of revision. This makes this paper's argument untenable.
-
Many notations are not defined when used. For example, the abstract never defines what are , , and . In the introduction, what are the definitions of ?
-
The introduction is poorly written since the studied problems are not well-motivated, and the authors do not clearly contrast this paper with previous papers.
-
Throughout the paper, many sentences are claimed without any motivation, which makes readers lost.
Overall, the current version is hard to be understood by human.
Questions for authors
Please rewrite the paper in a more interpretable way.