- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ReAT, an action tokenization network based on residual quantization. Existing methods follow an tokens-in actions-out paradigm. The proposed method allows for multiple quantization passes and each pass encode the residual quantization error from previous rounds. The proposed techniques are evaluated on LIBERO, MetaWorld and RoboCasa and shows advantages over existing strategy such as FAST, OAT.
Critical strengths
The concept of having a close-loop action tokenizer that is aware of quantization error is a very interesting one. I like the novelty of the proposed approach.
Critical weaknesses
I feel like the paper is not exactly well written. Too many small paragraphs with lots of empty spaces left. It almost looks like the author has not much things to say and do space padding. Explanation also not exactly clear, like the state, update in algorithm 1 block and , are not properly explained.
My second concern is the solidness of evaluation. Table 2 shows the evaluation results on LIBERO, MetaWorld, RoboCasa, yet the overall numbers are very low. Like LIBERO best performance is only 71% and Metaworld is only 31%. Yet both of these two benchmarks are well regarded as saturated by today's standard. This makes me skeptical about the results.
Questions for authors
See Weaknesses.
Evaluation Protocol Configurations ?
Thank you for this interesting work. We work on action tokenization and would like to compare results across papers carefully. Could the authors clarify a few evaluation details?
Thank you.