- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies multi-horizon probabilistic forecasting for zero-inflated count series. To capture persistent runs of zeros (e.g., stockouts), the authors share a single context-conditioned latent variable across all forecast horizons to shift the Negative Binomial parameters, and train with the joint trajectory likelihood. They show theoretically that shared latents can represent cross-horizon dependence while independent per-horizon latents cannot. Experiments report quantile WAPE on one proprietary dataset and three public benchmarks, with joint calibration mostly checked on synthetic data.
Critical strengths
The motivation is practical and the method is easy to deploy. Standard multi-horizon heads treat zero occurrence independently at each step, whereas sparse demand often comes in runs of zeros. Sharing one latent variable across horizons is a simple way to couple the trajectory. The experiments are also broad, covering proprietary data, three public benchmarks, a sparse-demand baseline (SPADE-S), and a fine-tuned Chronos2 model.
Critical weaknesses
The link between zero patterns and a latent "regime" is not actually tested. The paper claims that captures a latent state from the arrangement of zeros. But is just a context-conditioned Gaussian noise variable with no posterior inference or KL term, making the model a continuous mixture of Negative Binomials. Nothing shows that encodes a state rather than just adding flexibility to the output distribution. Also, Sec. 4.1 only compares against a predictor that sees the overall zero rate, which does not apply to real sequence baselines. Without a direct test, the result just shows that a shared mixing variable gives a small WAPE gain.
Cross-horizon dependence is not compared against baselines that also model dependence. The theory and synthetic ablations only compare a shared latent with per-horizon independent latents. However, several baselines in the main tables (DeepAR, Chronos, and the copula models) already capture cross-horizon dependence. On real data, the paper does not compare joint calibration against these models, nor does it evaluate total demand over the lead time (the quantity that actually depends on cross-horizon covariance in inventory decisions). The main tables only report per-horizon WAPE, where differences are small.
Questions for authors
(Weakness 1) Does the model actually use the arrangement of zeros rather than just the zero rate? A simple check: shuffle the positions of zeros within each context window at test time (keeping the zero rate fixed), and report the performance drop for your model vs. a TCN/LSTM baseline.
(Weakness 2) On M5 (28-step horizon), could you compare against DeepAR and a copula baseline (DeepVAR or GPVAR-Copula) on the calibration of all-zero windows and on coverage of total demand over the lead time?
5 comments
W2&Q2
The dependence argument is not evaluated against the baselines that also model dependence... On real data, the paper does not compare joint calibration against these baselines
Response: We thank the reviewer for identifying this missing comparison. In the new real-data joint evaluations reported in our response to Reviewer s3rp, W1/Q1, Shared-Z achieves the best joint predictive scores on both Car Parts and M5. On M5, relative to DeepAR-NB, it reduces All-Zero Brier, All-Zero Log Score, and Energy Score by 3.5%, 23.8%, and 4.7%, respectively. These results show that the advantage extends beyond per-horizon WAPE to joint-event calibration and complete-trajectory distribution quality.
The evaluation compares matched Shared-Z and Independent-Z models, DeepAR-NB, and DeepVAR-Copula on common forecast origins and under the same evaluation protocol. Car Parts uses , and M5 uses . DeepAR-NB was selected because it performed strongly in our previous experiments, while DeepVAR-Copula provides a representative joint-distribution baseline.
The comparison also covers distinct mechanisms for constructing joint predictive trajectories. Shared-Z directly couples all forecast horizons through a common context-conditioned regime; DeepAR-NB propagates temporal dependence sequentially through autoregressive rollout; and DeepVAR-Copula models cross-series dependence through copula covariance while generating trajectories autoregressively. The results suggest that, for sparse series with persistent zero regimes, directly sharing a regime across the forecast window is better aligned with the relevant window-level dependence structure.
“On M5 (28-step horizon), could you compare against DeepAR and a copula baseline ... on coverage of total demand over the lead time?”
Using the same M5 cohort and forecast origins, we evaluated prediction intervals for cumulative demand over the complete 28-day lead time. We report coverage, mean width, and the standard interval score [1]. Coverage alone can be increased by widening the intervals, whereas interval score jointly evaluates calibration and sharpness.
| Method | 80% Coverage | 80% Width | 80% Interval Score | 90% Coverage | 90% Width | 90% Interval Score |
|---|---|---|---|---|---|---|
| Shared-Z | 0.880 | 14.256 | 28.867 | 0.941 | 18.557 | 40.515 |
| Independent-Z | 0.697 | 8.538 | 31.195 | 0.803 | 10.951 | 47.732 |
| DeepAR-NB | 0.758 | 10.118 | 37.009 | 0.847 | 13.222 | 55.570 |
| DeepVAR-Copula | 0.540 | 8.015 | 46.768 | 0.649 | 10.293 | 72.678 |
This result directly connects the empirical findings to Lemmas 2 and 3. The variance of cumulative lead-time demand satisfies
Under the Independent-Z construction, the horizon-specific latent variables are mutually independent, so the predictive cross-horizon covariance term is zero conditional on the context. When the true demand trajectory has positive regime-induced covariance, Independent-Z therefore tends to underestimate cumulative-demand uncertainty. This is reflected in its narrower intervals and substantial undercoverage at both nominal levels. Shared-Z allows this covariance term to be represented through the common latent regime, producing wider but substantially better-calibrated cumulative-demand intervals.
At the 80% level, DeepAR-NB is closer to nominal coverage, while Shared-Z is conservative but still reduces the interval score by 22.0% relative to DeepAR-NB. At the 90% level, Shared-Z is closest to the nominal coverage and reduces the interval score by 27.1%. Shared-Z achieves the lowest interval score at both levels, demonstrating the best calibration and sharpness tradeoff rather than merely improving coverage by widening the intervals.
This result is also operationally important because underestimating cumulative-demand uncertainty can lead to insufficient safety stock and stockouts. Together with the joint-event evaluation, it provides direct real-data evidence that Shared-Z more accurately represents predictive dependence across forecast horizons.
Reference
[1] Gneiting, T. and Raftery, A. E. Strictly Proper Scoring Rules, Prediction, and Estimation. Journal of the American Statistical Association, 2007.
I thank the authors for the responses and the additional experiments, which partially address my concerns about the principle of Independent-Z construction. I will maintain my assessment of the paper but positively evaluate the workload of the paper.
W1&Q1
Response: We thank the reviewer for raising this point. We added a controlled synthetic experiment with a known ground-truth regime generated by a persistent two-state HMM. The current state, St, governs the complete H=6 forecast window, while demand remains stochastic conditional on St. After training, we freeze the model and fit identical logistic-regression probes to predict the true state:
The latent mean mz retains nearly all regime information available in the encoder and substantially more than the zero rate alone. Thus, when the true state is identifiable, Z encodes the latent regime rather than merely adding unstructured flexibility to the output distribution.
The latent distribution is conditioned only on information available at inference time, and the same predictive construction is used during training and inference. It is therefore not a target-conditioned variational posterior requiring a VAE-style KL term; the decoding results show that the absence of such a term does not make Z state-agnostic.
We performed a stricter version of the suggested test on the controlled synthetic benchmark with a persistent two-state HMM and H=6. Within each context, we randomly permuted the complete demand observations, preserving the zero count, zero rate, total demand, and complete value multiset while destroying temporal order. Results are averaged over three seeds and ten independent shuffles:
All three models deteriorate after shuffling, showing that the temporal arrangement of observations, including persistent zero patterns, contains predictive information beyond the zero rate. Because the zero rate, total demand, and complete value multiset are preserved, the decline cannot be attributed to changes in sparsity or the marginal empirical distribution. No-Z TCN-NB and No-Z LSTM-NB show similar degradation, so this result is not specific to the TCN encoder. Shared-Z TCN-NB achieves the best joint-event scores under both original and shuffled contexts. The encoder extracts temporal regime information from the context, while Shared-Z propagates that information into a coherent joint distribution across forecast horizons.