- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper focuses on conditional generation and next event prediction: conditioned on events and predicting the time and mark of the th event. In addition to the point estimate, the proposed model STMix can also efficiently predict the probability of the immediate next event during some observation window by reusing the survival cache. In experiments, STMix is compared with four competitive baseline models for both next event prediction and window predictions in terms of quality and efficiency.
Critical strengths
The visualization is very good, such as Figure 1, which greatly helps explain the novelty of the task and approach.
Critical weaknesses
This paper contains incorrect knowledge about temporal point processes, and it does not demonstrate a good understanding of the existing literature. For example, a fundamental assumption of temporal point processes (TPPs) is that there are no concurrent (or simultaneous) events, i.e., the delta time between two consecutive events is strictly positive [1]. This paper predicts the next gap where can be positive or zero, which could have practical values, but it does not fall into the TPP definition/framework.
Additionally, the log-likelihood is defined in Eq. 5, where the survival term is missing for an observation window for a sequence log-likelihood (i.e., no event after the last observed event during the observation window). While this objective has been used in the literature and is especially common in density-based parameterization [2,3], this paper takes a CDF-based approach and compares it with other models where their sequence log-likelihood is defined to include the survival term (AttNHP, S2P2). A lot of experimental details are missing to interpret the results and ensure a fair comparison.
[1] Daley, D. J., & Vere-Jones, D. (2003). An introduction to the theory of point processes: volume I: elementary theory and methods. New York, NY: Springer New York.
[2] Intensity-free learning of temporal point processes, ICLR 2020.
[3] Transformers for Mixed-type Event Sequences, NeurIPS 2025.
Questions for authors
Following up on the weaknesses above, could the authors help elaborate on these questions:
- Many intensity-based marked temporal point processes model the joint distribution of event time and mark. What is the main difference from the proposed model (in addition to the CDF parameterization)?
- How is the event encoder initialized before any event? Can the STMix model also perform unconditional generation (i.e., predict the first event)?
- Where do the numbers in Figure 2 come from? For example, is there any hyperparameter sweep performed for each model before comparing the number of parameters and test NLL?
- Are the NLL comparisons fair for different baseline models? For intractable integrals of intensity-based models (AttNHP, S2P2), how was the NLL estimated?
- In the window prediction setup: how is the window log loss defined, and how is the window chosen for the experiments? I saw Eq. 22 (on page 24) in the appendix that defines the window log loss, but it would be good to formally define the problem in mathematical terms and equations, and explicitly document the experimental setup and metrics definition in the main text.
- How does window prediction work for the baseline models (Figures 3 & 4)? It is unclear how these models are adapted for the novel task and how they are evaluated.
Follow-up on our responses
Dear Reviewers,
Thank you again for taking the time to review our paper. Your questions and suggestions helped us clarify why STMix shares temporal components across event types and strengthen our comparisons with type-specific models.
We’ve replied to each review in its own thread and would welcome your thoughts on the revised paper.
Best regards,
The authors