- Rating
- 3(+1)
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces JumpLie, a framework for discovering Lie symmetries of jump-diffusion dynamics from trajectory data and using them in downstream learning. It first fits and freezes a neural surrogate for the drift, diffusion, jump displacement, and Poisson rate, then learns infinitesimal generators using determining-equation, non-collapse, and Lie-bracket closure losses. The central distinction from diffusion-only symmetry discovery is an additional finite-jump compatibility condition. The paper reports sub-degree generator-subspace recovery on three low-dimensional systems and improved out-of-distribution coefficient estimation when the discovered generators regularize a fresh surrogate. It also explores a 3,072-dimensional CIFAR-10 ship-generation process, using a flow-plus-categorical-jump operator formulation to learn directions for edits without parameter updates at editing time. Finally, it applies discovered log-price symmetry to regularize next-day realized-variance forecasts for SPY, QQQ, and IWM, reporting improvements over a matched Jump-GRU and greater robustness to nominal-price rescaling.
Critical strengths
- The extension to finite-jump compatibility addresses a meaningful limitation of diffusion-only symmetry discovery.
A transformation that preserves drift and Brownian diffusion need not preserve the finite jump map. JumpLie explicitly incorporates this additional constraint into a trainable discovery framework, rather than treating jump-containing observations as ordinary diffusion data. The separation between surrogate fitting and generator discovery, together with normalization and bracket closure, gives a coherent approach to learning nontrivial symmetry directions. This is a useful extension of the trajectory-to-generator approach used by LieStoNet, with a clear motivation for systems containing discrete events.
- The controlled recovery experiments provide encouraging quantitative evidence, and some downstream comparisons are carefully matched.
Section 4.1 reports maximum principal angles of approximately 0.55°, 0.69°, and 0.84° across five seeds, using a basis-invariant subspace metric rather than requiring a particular generator basis. Table 1 shows lower mean OOD errors for every reported coefficient, including substantial reductions in the E1-B and E1-C jump-map errors. Appendix A.2 matches architecture, initialization, and optimization between the OOD branches. The finance comparison also uses a matched Jump-GRU and reports block-bootstrap confidence intervals. These choices support the potential usefulness of symmetry regularization, even though stronger attribution controls are still needed.
Critical weaknesses
- The high-dimensional experiment does not adequately establish that the learned editing directions are symmetries of the stated generative process.
The main formulation uses a deterministic jump displacement driven by a scalar, constant-rate Poisson process. Appendix A.3 instead uses state-dependent coordinatewise rates and categorical jump destinations, enforcing an operator commutator on randomly sampled test functions. This is a reasonable direction for an extension, but its relationship to the main determining equations and the adequacy of the sampled tests need a clearer justification. In particular, retaining the exact expectation over all destination bins does not by itself establish commutation on a sufficiently rich family of functions. Section 4.3 and Figure 5 show one base image and three edited outputs, without quantitative held-out symmetry residuals, finite-transformation compatibility, or comparisons with norm-matched random directions and unedited stochastic continuations. Different final images alone cannot distinguish genuine symmetry actions from arbitrary perturbations or rollout randomness. Consequently, the claimed scaling of symmetry discovery to 3,072 dimensions and its use for controllable edits remain insufficiently validated.
- The current controls do not isolate the benefit of discovering JD symmetry, and the finance stress test contains an unexplained consistency issue.
The LieStoNet comparison changes both the surrogate model and the symmetry constraints, so it does not isolate the finite-jump condition as cleanly as removing that condition from the same frozen JD surrogate would. For the OOD study, neither Section 4.2 nor Appendix A.2 specifies the exact training/test state regions or clearly states whether the initial surrogate and generator-discovery stages were also restricted to the same in-distribution region. This leaves the scope of the generalization claim unclear.
In finance, the relevant price-scale invariance is already known. Appendix A.4 mentions an oracle-symmetry GRU and HAR-CJ, but does not report their numerical forecasting results or a full forecasting comparison with the Return-only GRU. More concretely, that appendix defines the Return-only inputs entirely through returns and realized-variation features, which are unchanged under a constant rescaling . Nevertheless, its curve in Figure 6(b) shows nonzero changes in predicted RV. The stated deterministic feature construction would imply invariance; any additional normalization, inference randomness, or preprocessing responsible for this behavior needs explanation. Until these issues are resolved, the downstream results do not convincingly separate the value of learned JD symmetry from that of directly imposing known invariance or ordinary regularization.
Questions for authors
- Controlled discovery and OOD protocol:
Can you report a quantitative ablation that removes the finite-jump residuals while keeping the same frozen JD surrogate, generator capacity, and remaining losses? Please also specify the exact ID/OOD regions, the data used at every discovery stage, and where the OOD regularization collocation points are sampled. Were any OOD-region observations used to learn the frozen surrogate or generators? These details would materially affect the interpretation of the jump-specific and generalization results.
- High-dimensional symmetry validation:
How does the operator criterion in Appendix A.3 relate to the deterministic-jump determining equations in the main text, and what family of random test functions is used? Can you provide held-out commutator or finite-action compatibility measurements and quantitative editing comparisons against norm-matched random perturbations and unedited continuations, controlling the remaining rollout randomness? Such results would help establish that the learned directions represent symmetries rather than merely perturbations that produce different images.
- Finance consistency and baseline results:
Why does the Return-only GRU change its prediction under nominal-price rescaling when all four stated inputs are invariant? Please clarify preprocessing and inference during this test, and report absolute QLIKE values and paired differences for HAR-CJ, Return-only GRU, Jump-GRU, JumpLie regularization, and the oracle-symmetry GRU already mentioned in Appendix A.4. Does learned symmetry provide an advantage over imposing log-price translation directly with the same regularization weight and training protocol?
5 comments
Responses to reviewer gcKn (2)
(W1&Q2 continues)
For categorical jumps, we instead enforce operator commutation using smooth random ridge test functions, including linear, sinusoidal, cosinusoidal, and quadratic functions of random projections of the state. This formulation additionally accounts for state-dependent jump rates and destination probabilities. Training uses four smooth probes per state, and held-out evaluation uses 12 freshly sampled probes per state, with exact summation over all 3,072 coordinates and 32 destination bins. Thus, the evaluation tests compatibility with the full categorical-jump mechanism instead of only the sampled training constraints.
These findings establish strong quantitative and visual evidence for nontrivial, interpretable, and quality-preserving approximate symmetries of the learned high-dimensional stochastic generative dynamics. We have incorporated the results into revised Section 4.3 (page 8) and Appendix A.3 (page 13).
W2 & Q1. Necessity of finite-jump constraints and controlled OOD evaluation
We thank the reviewer for identifying the need to isolate the finite-jump contribution and clarify the OOD protocol. We conducted two additional controlled experiments: (1) a same-surrogate jump-constraint ablation and (2) a four-way downstream OOD comparison, with explicitly documented data access at each stage.
1) Isolating the finite-jump contribution. We compare full JumpLie against a variant that removes the finite-jump spatial and nonlocal temporal constraints, while keeping the same frozen JD surrogate, generator architecture, initialization, collocation points, and remaining losses.
| Symmetry discovery | Recovery MPA (°) ↓ | Jump residual MSE ↓ |
|---|---|---|
| Full JumpLie | 0.767 ± 0.003 | 0.0133 ± 0.0078 |
| Jump constraints removed | 88.589 ± 0.500 | 0.3727 ± 0.0080 |
(Five-seed mean ± standard deviation; smaller is better)
Removing the finite-jump constraints nearly destroys symmetry recovery, increasing the principal angle from 0.77° to 88.59° and the jump residual by approximately 28×. Since both branches use the same frozen JD surrogate, these results demonstrate that the finite-jump constraints are essential for recovering genuine jump-diffusion symmetries, beyond what continuous drift–diffusion constraints alone can achieve.
2) Downstream OOD controls. We additionally train fresh coefficient predictors using four regularization conditions, all with matched architectures and ID-start training data.
| Regularization | OOD drift RMSE ↓ | OOD diffusion RMSE ↓ | OOD jump RMSE ↓ |
|---|---|---|---|
| Full JumpLie | 0.0988 | 0.0909 | 0.0915 |
| No symmetry | 0.1417 | 0.1236 | 0.1000 |
| Continuous-only generators | 0.1496 | 0.0722 | 0.1594 |
| Norm-matched wrong generators | 0.7150 | 0.1540 | 0.2820 |
Full JumpLie reduces OOD RMSE relative to no symmetry by 30.3% (drift), 26.4% (diffusion), and 8.4% (jump). It also outperforms continuous-only generators on drift and jump prediction, although the latter achieves lower diffusion RMSE. The poor performance of norm-matched incorrect generators further shows that the learned symmetry directions matter, not merely the presence of an additional regularization penalty.
3) Exact data-access and OOD protocol. In this separate controlled rerun:
- Surrogate fitting. Training transition starts satisfy , . No shifted-OOD-start observations are used; observed transition endpoints are retained even when they cross the ID boundary.
- Symmetry discovery. Both learners use the same frozen surrogate and ID collocation points. Finite-jump constraints can evaluate fields at jump destinations outside the ID box.
- Downstream training. Fresh predictors use the same ID-start transitions. Symmetry regularization is collocated at ID points, with nonlocal evaluations at predicted jump destinations.
- OOD evaluation. We translate matched ID evaluation states by , holding and fixed. True coefficients are used only for scoring.
Thus, no deliberately shifted-OOD-start observations are used for fitting or discovery.
Together, these results directly establish the necessity of the finite-jump conditions for accurate JD symmetry discovery and provide controlled evidence of their downstream generalization benefit.
(continues)
Responses to reviewer gcKn (3)
Q3. Corrected finance consistency test and forecasting baselines
We thank the reviewer for identifying the inconsistency. The reviewer is correct that Return-only GRU should be invariant to constant nominal-price rescaling.
1) Cause and correction of the inconsistency. We traced the nonzero Return-only curve in the original Figure 6(b) to an error confined to stress-test preprocessing: normalization was applied across the full feature vector, including the nominal log-price channel (before removing that channel). Consequently, rescaling prices altered the normalization of the retained return-based features, introducing an unintended price dependence. However, training and standard forecasting evaluation used the intended preprocessing, thus this error affected the rescaling diagnostic, not the trained models or forecasting scores.
We corrected the stress test to use the original training-time preprocessing with fixed normalization statistics. Across all seven price multipliers , we verified zero change in Return-only raw features, normalized inputs, and RV predictions for SPY, QQQ, and IWM.
The corrected worst-case mean relative prediction changes are:
| Asset | Return-only ↓ | Jump-GRU ↓ | JumpLie ↓ | Oracle GRU ↓ |
|---|---|---|---|---|
| SPY | 0 | 0.5024 | 0.4617 | 0.4911 |
| QQQ | 0 | 0.4095 | 0.2723 | 0.3680 |
| IWM | 0 | 0.8108 | 0.2258 | 0.5340 |
(Five-seed means; lower indicates greater robustness)
JumpLie reduces rescaling sensitivity relative to Jump-GRU by 8.1% (SPY), 33.5% (QQQ), and 72.1% (IWM). This establishes improved robustness compared to other methods.
2) Expanded forecasting baselines. We additionally report absolute out-of-sample QLIKE against the classical HAR-CJ model, Return-only GRU, matched Jump-GRU, and Oracle GRU using the analytically known log-price translation.
| Asset | HAR-CJ ↓ | Return-only ↓ | Jump-GRU ↓ | JumpLie ↓ | Oracle GRU ↓ |
|---|---|---|---|---|---|
| SPY | 0.29357 | 0.28926 | 0.30157 | 0.26636 | 0.30597 |
| QQQ | 0.24455 | 0.25877 | 0.26370 | 0.24553 | 0.25552 |
| IWM | 0.23000 | 0.21761 | 0.21269 | 0.19389 | 0.21546 |
(Lower QLIKE is better; neural entries are five-seed means)
JumpLie improves mean QLIKE over the matched Jump-GRU by 11.7%, 6.9%, and 8.8%, respectively. It outperforms Return-only and Oracle GRU on all three assets, achieving the best overall QLIKE on SPY and IWM (HAR-CJ is marginally better on QQQ).
3) Learned versus known symmetry. The Oracle GRU uses the exact log-price translation, with the same architecture, regularization weight (0.1), and training protocol as JumpLie. The comparison therefore tests whether discovering a symmetry provides practical value beyond simply imposing the known transformation. JumpLie's stronger forecasting results demonstrate an empirical advantage of learned-symmetry regularization in this setting.
We have removed the incorrect finance figure and incorporated the corrected results and preprocessing description into revised Section 4.4 (page 9) and Appendix A.4 (page 15).
Responses to reviewer gcKn (1)
We sincerely thank the reviewer for recognizing the strengths of our work and for their thoughtful and constructive feedback. We appreciate the opportunity to clarify the key aspects of our approach and strengthen the empirical evidence through additional controlled experiments. In the following, W = Weakness, Q = Question.
W1 & Q2. High-dimensional symmetry validation
We thank the reviewer for emphasizing that visually plausible edits alone do not establish genuine symmetries. We have strengthened the high-dimensional experiment with three complementary quantitative tests: 1) held-out symmetry residuals, 2) finite-edit compatibility, and 3) generative-quality preservation. We additionally demonstrate interpretable control of generated images through the discovered symmetry directions.
1) Held-out symmetry residuals. Lower residuals indicate better agreement with the symmetry equations (0 = exact satisfaction).
2) Finite-edit compatibility. Lower MMD² indicates that editing before versus after stochastic continuation produces more similar distributions.
3) Generative-quality preservation. Lower FID indicates better agreement with real images. Results are averaged over eight generators and five random seeds (± standard error).
4) Interpretable control through learned symmetries. Beyond mathematical compatibility and generative-quality preservation, the discovered symmetries provide consistent, interpretable transformations of generated images. Revised Figure 5 (page 8) demonstrates that the same learned generator systematically changes the illumination and color of five distinct ship images: negative pseudo-times produce brighter, warmer scenes, while positive pseudo-times produce progressively darker, bluer scenes.
We quantify this visual effect across the five images:
In contrast, the displacement-matched random-edit visualization in Appendix A.3 (page 13) does not exhibit the same coherent illumination progression. This provides direct visual evidence that the discovered symmetry enables meaningful, interpretable control of an otherwise opaque high-dimensional generative process, without semantic editing supervision or model retraining.
Together, these results provide complementary evidence for meaningful high-dimensional symmetry discovery: (1) low held-out residuals demonstrate approximate satisfaction of both continuous and jump symmetry constraints; (2) near-reference finite-edit MMD² demonstrates approximate compatibility with stochastic continuation, unlike matched random edits; (3) near-unchanged FID establishes generative-quality preservation; and (4) consistent illumination/color transformations demonstrate interpretable, training-free generative control. Crucially, the discovered directions are not merely quality-preserving perturbations: they reveal useful, controllable structure in the learned 3,072-dimensional stochastic generative process.
Connection to the deterministic-jump equations and choice of test functions. The operator criterion in Appendix A.3 generalizes the main text's finite-jump determining equation to stochastic jump kernels. Specifically, for a deterministic jump map $T_J(x)=x+J(x) $ with constant jump rate, requiring the commutator $[H,\mathcal L_J]F=0 $ for all smooth test functions $F $ is equivalent (for the spatial generator H=ξ⋅∇ ) to:
DTJ(x)ξ(x)=ξ(TJ(x)),
which is precisely the main-text finite-jump condition $ R_J=0 $: applying the symmetry before or after a jump gives the same transformation.
(continues below)