- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes DualKT for question-level knowledge tracing. It combines a structured question representation incorporating question identity, question–KC graph structure, KC embeddings, and a difficulty residual with a Mamba-2 history encoder and a target-querying hierarchical Transformer(The entire work is a combination of existing technologies solid but with less innovation). The Transformer state is decomposed into components parallel and orthogonal to the Mamba state, followed by target-conditioned fusion and a transition-based correction. Experiments on five public datasets report competitive predictive performance, including the highest AUC on four datasets under fixed configurations and three datasets under unified TPE optimization.
Critical strengths
Broad empirical evaluation. The paper evaluates five datasets against 30 baselines and includes ablations, hyperparameter optimization, and a sequence-length sweep. The reported results establish DualKT as a competitive prediction system across several KT benchmarks.
Explicit handling of the prediction protocol. The manuscript describes student-disjoint splits, validation-based checkpoint selection, and question-level evaluation for multi-KC questions. The transition representation also explicitly uses the observed source response rather than the unknown target response.
Critical weaknesses
- The experiments do not establish the contribution of the central orthogonal-fusion mechanism. Section 3.4 reports that replacing the proposed fusion with Direct Fusion reduces macro-average AUC by only 0.05 percentage points, whereas removing the structured question representation reduces it by 3.23 percentage points. Moreover, Direct Fusion is a linear projection of concatenated states, while the proposed module includes target-conditioned routing, residual calibration, and additional correction networks. This comparison changes both the decomposition and the fusion architecture, so it cannot attribute the difference specifically to orthogonal projection. Figure 4 provides no uncertainty estimates for these small ablation differences. The largest ablation also jointly removes question identity, graph propagation, difficulty, and question–KC fusion, leaving their individual contributions unresolved. Consequently, the evidence supports the complete system more clearly than the specific mechanism emphasized in the title.
- The cognitive interpretation of the geometry is insufficiently justified. Equation 7 is a valid vector decomposition, but a component orthogonal to one learned state direction is not necessarily informationally nonredundant or a distinct cognitive fluctuation. The manuscript does not establish that alignment between the independently normalized branch states measures shared cognitive information. Furthermore, elementwise routing and calibration generally do not preserve orthogonality, and the correction networks in Equations 21–23 are not constrained to the corresponding subspaces. Thus, the initial projection does not establish that the downstream “aligned” and “residual” paths retain the proposed geometric interpretation.
- Distinct temporal roles are assumed more strongly than they are demonstrated. Appendix B.2 explicitly states that the Transformer memory covers the complete prefix and differs in resolution rather than using a separate temporal interval. Conversely, the Mamba branch has no explicit constraint requiring slowly varying states. The architecture therefore provides different ways of processing history, but does not establish a separation between persistent knowledge and short-term variation. Figures 6–7 show routing behavior and associations with prediction error on ASSIST2017; these observations do not demonstrate that the branches capture the claimed temporal factors or that orthogonal residuals provide uniquely complementary evidence. The single-branch and shallower ablations also change model capacity, complicating the attribution to temporal complementarity.
- The optimized comparisons leave important attribution and reproducibility gaps. Figure 3 tunes four competing methods, excluding strong Table 1 baselines such as DIMKT, UKT, and QIKT. It therefore establishes a ranking within that subset rather than across the broader competitive set. The submission also omits the concrete TPE search ranges, exact trial counts, and selected configurations; Appendix C.5 provides an additional figure rather than these details. No comparison equips a simpler encoder with the same structured question representation, despite that representation accounting for the largest reported ablation effect. Parameter counts, runtime, and memory costs are also absent, leaving the benefit of the additional architectural complexity difficult to assess. Overall, the predictive results are promising, but the submitted evidence does not sufficiently establish the independent value or scientific interpretation of the paper’s central contribution.
Questions for authors
Could the authors clarify how much of the reported improvement comes specifically from the orthogonal decomposition, given that the Direct Fusion comparison also changes the routing and correction components?
What evidence supports interpreting the orthogonal residual as complementary short-term cognitive information, especially since the subsequent element-wise routing and correction modules may alter the original geometric structure?
Could the authors clarify the exact TPE search spaces, trial budgets, and computational overhead used for DualKT and the compared baselines?