- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces an interaction paradigm called the “Engagement Process” (EP) for modeling time in sequential decision-making. It first describes EP and argues why it is needed. It then injects time into an LLM by adding a rotary positional encoding of timestamps to the tokens, which the authors call TimeRoPE. The toy experiments compare modeling under EP against instantaneous clock advancement, and the LLM experiments compare supervised fine-tuning and post-training of LLMs with TimeRoPE inserted and the interaction modeled as an EP against the standard, non-time-aware setup.
Critical strengths
Many different tasks have been considered.
Critical weaknesses
The authors clearly did not put much effort into writing this paper, so I will keep my points short and list only the main issues without going into detail.
The formulation of EP is informal and inaccurate. Moreover, as the authors themselves point out, it can be defined as a single POMDP. The authors' argument for why a POMDP is insufficient is weak and inaccurate: if a POMDP can represent an EP, the different parts of the transition can be modeled separately, so there is no value in defining EP.
The authors present reinforcement learning under EP as part of their contribution, and the paper redefines all standard algorithms and terms for EP as new concepts, in jargon-heavy language. All of these definitions and descriptions are established concepts applied to a particular POMDP, or to their EP.
The idea of adding a time index to tokens has been explored before, but the authors do not cite any of that work, and the related work section appears only in the appendix. For example, "Rotate Both Ways: Time-and-Order RoPE for Generative Recommendation" explores the same idea.
All figures look AI-generated, and the authors did not spend time polishing them.
The experiment section is written very unclearly, with most of the important details deferred to the appendix while the main text gives only vague, high-level descriptions.
The toy experiments appear to be contrived: the comparison is against a variant of the authors' own method that does not see time, or from which the "wait" action has been removed, and is therefore not fair. The LLM experiments likewise evaluate on time-sensitive environments where the baselines are not time-aware.
Overall, I found the paper very hard to follow for what is a simple idea; it is full of jargon, unclear descriptions, and unclear experiments. There are many more issues and weaknesses in this paper, but I believe the ones listed above are sufficient grounds for rejection.
Questions for authors
None