- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes an extension of S2P2 Limit Order Book simulator. It modifies the S2P2 architecture by factorizing the decoder into a total-rate head and a categorical mark head. Experiments are conducted on data of three cryptocurrencies for seven days. A number of experiments showcasing different properties of the methods are provided.
Critical strengths
- The paper targets a weakness of neural point-process models, i.e., that a good teacher-forced prediction does not imply stable or realistic simulation.
- Experiments include different aspects relevant to LOB simulators, which are prediction, closed-loop simulation, rate calibration, and generation efficiency.
Critical weaknesses
- The dataset used for the experiments contains only seven days for three cryptocurrencies. This is very limited for supporting the claims for stable LOB simulator.
- The data is split on a per-day basis (70/15/15% for train/validation/test). This means that the training set contains information about the validation and test sets.
- Experimental comparisons are not done in a fair manner. S2P2 is substantially modified from its published version before it is tested and compared with the modified version SS2P2 presented in this paper. Also, the number of epochs used in the two papers is very different. The experimental protocol for the S2P2 is not followed. Is the clearly bad performance of S2P2 due to not sufficient training? A different protocol is applied also for SAHP.
Questions for authors
- How would the proposed method compare with the related works in a fair experimental setup (including the input received by each method, the training process, and parameter count)?
- Why did the experimental setup not use unbiased data splits?
- How would the results be if the experiments were conducted on multiple assets and for longer periods?