- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a sample-dependent tokenizer for fixed-budget intraday time-series representations. Given 240 one-minute market and order-book records, a local causal encoder predicts a positive rate for each minute. The normalized cumulative rates define a monotone time coordinate, and the minute representations are softly aggregated around 48 uniformly spaced centers in this coordinate. This produces a fixed number of ordered tokens with variable coverage in natural time. A causal convolutional Mixer then predicts stocks’ relative next-day returns. The model is trained on data from 2019–2023 and evaluated on a 2024 validation period. The reported comparisons favor sample-dependent allocation over fixed, uniform, and position-dependent alternatives. The complete system also reportedly achieved first place in an external competition with hidden evaluation data.
Critical strengths
- Clear and practically motivated method. The proposed tokenizer provides a simple differentiable mechanism for reallocating a fixed token budget across each stock-day. Positive rates guarantee chronological order, while soft aggregation avoids discrete boundary prediction and always produces a fixed-size representation.
- Encouraging matched comparisons. The matched-context experiment retains the minute encoder, projection, backbone, heads, and training procedure while changing the allocation mechanism. Sample-dependent allocation outperforms all three controls across the reported seeds, and the same ordering remains at the final training epoch. The paper is also clear about its evidence boundaries and limitations.
Critical weaknesses
- The paper does not provide independent evidence that the tokenizer generalizes to new data. All scientific comparisons use the same 2024 period for checkpoint selection and reported evaluation. Multiple training seeds do not address temporal generalization. The hidden competition result evaluates the complete system under a different training procedure and does not include a matched comparison between sample-dependent and fixed allocation. It therefore cannot establish that the tokenizer itself generalizes out of period.
- The empirical scope and comparison with prior work are insufficient for a general representation-learning contribution. The method is evaluated on one proprietary dataset, one market, one token budget, and one prediction task. There are no comparisons with recent adaptive patching or learned time-warping methods, despite the authors explicitly stating that such comparisons remain necessary. Runtime, token-budget sensitivity, assignment-temperature sensitivity, and aggregate behavior of the learned rates are also not reported. These omissions make both the generality and novelty of the contribution difficult to assess.
Questions for authors
- Can the authors evaluate sample-dependent allocation and the matched controls on an untouched later period using a checkpoint-selection rule fixed before examining that period? Alternatively, can the same matched ablation be evaluated on the competition’s hidden period?
- How does the method compare with existing adaptive patching and learned time-warping methods? Can the authors provide results on at least one public time-series benchmark so that the contribution can be reproduced and evaluated outside the proprietary financial dataset?
- How sensitive are the results to the number of tokens and the learned assignment temperature? Although soft assignment avoids hard boundaries, can the authors test whether the aggregation preserves abrupt or multi-minute market events rather than averaging them across tokens?
- Can the authors provide aggregate diagnostics of the learned allocation, including token-width distributions, stability across seeds and time periods, and relationships with observable quantities such as volume, volatility, and order-book changes?
- Can the authors provide exact definitions of IC, ICIR, Sharpe proxy, stress IR proxy, and the competition composite score, together with uncertainty estimates that account for temporal dependence and checkpoint selection?
Thank the authors for the responses. However, my main concerns still remain. The authors say "The independent-test concern remains valid.", which makes the paper's improvements not robust. So I will retain my rating.