- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the following question: given irregular response intervals, how can a model simultaneously describe the learner's state and the evolution of their uncertainty over time, and leverage this information in a targeted manner to predict the outcome of subsequent questions? Specifically, it explores how the model should refine its judgments before new evidence becomes available, and how it should make predictions for the next question while accounting for uncertainty. The proposed solution is that, during these response intervals, both the "state-of-mastery" vector and the "uncertainty" vector approach a balanced state, allowing the model to await the appearance of the next question. Upon the appearance of this question, the model then specifically assesses the learner's mastery level and degree of uncertainty based on the content of the question to predict the likelihood of a correct answer. After observing the actual response, the model performs further adjustments, while constraining the magnitude of each individual adjustment to prevent excessive fluctuations in its predictions.
Critical strengths
S1. The theories proposed by the authors have been validated by corresponding experiments; for example, separability with respect to time intervals corresponds to the time ablation test, while separability between states with identical means but differing uncertainties corresponds to the uncertainty ablation test. Table 4 in the appendix also directly lists the "Claim — Formalized Object — Experimental Verification — Falsification Pattern." S2. After observing varying results with time ablation, the authors further analyzed timestamp quality, the proportion of duplicate timestamps, and performance across different time intervals. This approach refocuses the experiment on "under what conditions the mechanism is effective," rather than merely reiterating that "this model outperforms the baseline." S3. The authors acknowledge that the model is not optimal for all datasets, report negative performance of the temporal mechanism on XES3G5M, and highlight limitations such as the simplicity of continuous-time dynamics and the fact that uncertainty is not fully captured in the posterior distribution.
Critical weaknesses
W1. The terminology is highly specialized; readers who are unfamiliar with this field or lack a solid foundation in mathematics may find it difficult to follow. At its core, your model relies on exponential evolution, additive updates, and conditional prediction—so why go to such lengths in its formulation? W2. The author repeatedly emphasizes that "time acts directly on the state, rather than merely serving as a feature," which provides a promising starting point. However, existing related work primarily organizes its content by KT categories, without conducting a detailed comparison centered on state evolution methods. While this approach allows me to discern the author's intended focus, it still raises the question: compared to existing temporal modeling approaches, what exactly are the novel mechanisms introduced in this work? W3. The theoretical content occupies the vast majority of the text; there is no clear distinction between the sections on foundational methods and innovative methods, and there is no need to elaborate extensively on the mathematical axioms. W4. The authors acknowledge that uncertainty is merely a learnable coordinate; however, there is no scientifically validated methodology to demonstrate why this approach is valid. W5. The main results employ the tuned configuration within the dataset, the time ablation study uses the diagnostic reference configuration, and the uncertainty ablation study disables supervision at any given time point. Although the authors have provided clarifications, readers still need to continually verify "which baseline should this specific line be compared against?" For instance, Junyi et al. (2015) report a value of 0.7717 in Table 1, whereas their dynamic transfer results in Table 9 are 0.7811; however, the paper fails to adequately explain why these two values differ. W6. The appendix contains redundant content; for instance, in both the auxiliary loss optimization and readout diagnosis sections, after presenting the results and their interpretations, the same conclusions are reiterated under the "Results Discussion" subsection. Meanwhile, critical issues that genuinely influence the overall assessment—such as which temporal trajectories should be disabled in ablation experiments without time intervals, how to handle event-wise truncation in block-scanning protocols, and how to select appropriate configurations—are not adequately addressed with equally clear explanations. Regarding layout, redundant concluding statements should be minimized, while more reproducible details should be expanded. W7. The full text contains no figures to visualize the experimental results, nor does it include model diagrams or motivation diagrams; this increases the difficulty for general readers to read and understand the content.
Questions for authors
Q1. UKT has recently become a well-known method for addressing the uncertainty knowledge tracking task; were its performance results on the AS2017 dataset truly that poor? How did you reproduce this baseline? Q2. How do you uniformly transform the knowledge points covered in the questions across the five datasets into the 'sq' term in the formula? Q3. Why does the event update not depend on the student's current state? The bridging displacement in Equation 15 is determined solely by the event characteristics and is not directly conditioned on the current state. Q4. Is it reasonable that, over an extended period, the system tends toward the same equilibrium state? "Are the equilibrium state and the decay rate shared by all students? If so, would a longer interval without interaction cause the states of different students to gradually converge?" Q5. Why is it required that predictions under different historical conditions (pi→j), (pk→j)remain consistent? Consistency loss comparison However, the latter has already obtained additional supporting evidence. This new evidence could reasonably alter the predictions; would forcing the two to converge potentially suppress effective updating? Could it also provide independent ablation analyses and clarifications on the applicable conditions? Q6. Please specify the respective training configurations for Table 1, Table 3, and Table 9.