- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes GGMP, an approach to overcome the computational burden of inference on mixtures of GPs, caused by the marginalization over assignments. The method introduces three-stage pipeline that avoids exponential complexity and works with scalable GP primitives.
The main contribution is the proposed three-stage pipeline and corresponding theoretical results. The authors also conducted rigorous experiments on various datasets and ablations.
Critical strengths
- The paper presents a methodology that can be useful in a field of Gaussian Processes as it provides a scalable training procedure for GP Mixture models.
- The proposed method is supported by the corresponding propositions and theorems.
- The authors conducted rigorous experiments on various datasets and on various metrics and important ablation studies.
Critical weaknesses
- The importance of GP Mixture models is not well-motivated in the Introduction and in general Introduction does not highlight the limitation of other probabilistic approaches in comparison to GP Mixtures.
- It is not clear from Experiments section if the goal of the paper is to provide a new probabilistic approach based on GP Mixtures that outperforms other probabilistic methods on specific metrics or the goal is the local improvement on GP Mixtures. If it is the first one, then the experiments do not fully justify it as for many examples in the paper MDN performs on the same level or even better. If it is the second one, it would be good also to compare with some other mixture method utilizing GPs, for example Nguyen, T. & Bonilla, E. (2014). “Fast Allocation of Gaussian Process Experts.” ICML 2014. Also it would be good to provide stds for CRPS metric as well.
Questions for authors
In section 3.3.1, appears without being introduced before, can authors explain it as it causes troubles with understanding this section.
If authors address Questions and Weaknesses, I would be willing to increase my score.
3 comments
Thank you for your response! Although I really appreciate the response, the authors have not provided stds for CRPS and have not commented on my propose to compare with some other mixture method utilizing GPs, and I have not found any modifications in the pdf file, so currently I would keep my score.
We thank the reviewer for following up, and apologize that the revised manuscript had not yet been uploaded when they checked. The revised PDF is now available, and we address the remaining concerns below.
CRPS standard deviations: We have now added CRPS standard deviations to the experimental tables. The principal comparisons at K=25 are:
| Dataset | GGMP-25 | MDN-25 | RFCDE |
|---|---|---|---|
| Synthetic | 0.4846 ± 0.0401 | 0.4934 ± 0.0801 | 0.4924 ± 0.1054 |
| Temperature | 4.7765 ± 1.2021 | 5.2364 ± 1.4933 | 6.0085 ± 1.8229 |
| Manufacturing | 0.1904 ± 0.0328 | 0.1663 ± 0.0742 | 0.1951 ± 0.0565 |
GGMP-25 attains the lowest mean CRPS on the synthetic and temperature benchmarks, while MDN-25 achieves a lower mean CRPS on manufacturing. We have revised the experimental discussion to emphasize these differences in mean performance rather than implying universal superiority.
Comparison with GP-based mixture methods: Our goal is to introduce a new GP-mixture-based probabilistic approach for repeated-measure conditional density estimation, rather than a local improvement to existing GP-mixture methods. We have added Nguyen and Bonilla (2014) to Section 2. Their method focuses on scalable regression through the allocation of pointwise observations among GP experts. In contrast, GGMP uses repeated observations to estimate local mixture distributions and aligns their components across inputs before GP regression. The methods therefore address different modeling settings. Our experiments compare against MDNs and RFCDE as general-purpose conditional density estimators applicable to the same repeated-measure task. We do not claim that GGMP universally outperforms these alternatives; but instead, the results demonstrate its complementary predictive and computational strengths in its intended setting.
We thank the reviewer again for the constructive feedback. We hope the revised manuscript and these clarifications address the outstanding concerns and would appreciate reconsideration of the rating.
Response to Reviewer MzG8
We sincerely thank the reviewer for the positive assessment of the paper, particularly the methodology, theoretical contributions, and experimental studies. We respond to the concerns below:
Motivation for GP mixture models: We agree that the Introduction could better motivate the use of GP mixtures over other probabilistic approaches. We will revise it to emphasize their advantages in repeated-measure settings, where GP priors provide smooth interpolation and uncertainty quantification across inputs, while mixtures allow us to model multimodal conditional distributions. We will also better highlight the limitations of existing CDE approaches in this setting and the computational challenges of conventional GP mixtures, motivating GGMP as an alternative.
Empirical performance and intended contribution: Our goal is the former of the two: to introduce a new probabilistic approach based on GP mixtures, rather than merely improve existing GP mixture methods. However, our objective is not to universally outperform MDNs or other conditional density estimators across every metric. Rather, we emphasize that GGMP provides a tractable and interpretable framework specifically for repeated-measure conditional density estimation, with theoretical guarantees. Our experiments demonstrate that GGMP is competitive with existing CDE methods while offering substantial computational advantages in the tested settings. We believe that the framework and the results together establish GGMP as a strong alternative in its intended setting, and will clarify this positioning in the manuscript.
CRPS standard deviations: We agree that including standard deviations for CRPS would make the comparisons more complete, and will add these to the revised tables.
Notation in Section 3.3.1: We apologize for the confusion regarding pi_n(k), which denotes the locally fitted component index corresponding to the globally aligned component k at input x_n. We will revise the prose to introduce this notation more clearly.
We thank the reviewer again for their constructive feedback. We hope our responses address their concerns and, as indicated in the review, would appreciate reconsideration of the rating.