- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
The paper proposes a copula process with a dependence modelled by a Gaussian mixture. One of the main sources of novelty is to make the parameters of this mixture dependent on the context through a neural network, parametrised in a way that ensures marginalisation consistency (as explained in lines 195-200).
The proposed model is then benchmarked against several appropriate competitors on synthetic data (5.1) and real-world datasets (5.2).
Critical strengths
The main strengths of the paper are
i) to impose a non-Gaussian (Gaussian mixture) dependence and still achieve marginalisation consistency, which, as the paper highlights, are two features that other methods fail to achieve jointly.
ii) empirical evidence that the GM copula outperforms the mixture of Gaussian copulas (synthetic experiment)
Critical weaknesses
I can identify two weaknesses, of different types.
i) Limited methodological novelty. The proposal mixes a number of concepts known in the community: Gaussian mixture copulas, context-dependent parameters, marginalisation consistency. This does not hinder the strength of the contribution per se, but:
ii) Though the experimental evaluation considers several appropriate benchmark models, I see two sources of concern. First, different experiments are needed to identify the proposed contribution relative to existing methods such as MOSES. For instance, comparing models with the same "capacity", e.g., encoder and comparable parameterisations, but different approaches to modelling marginals and dependence. Second, the empirical validation, though superior on 3 out of 4 datasets, mostly offers marginal improvements (wrt the stated error bars) against TACTiS-2
Questions for authors
-
How can the authors confirm that the performance improvements come from the proposed methodology (copula), and not from differences in the encoder, marginal parameterisation or training procedure? In particular, how can the effect of these contributions relative to other models be isolated?
-
Given how close TACTiS-2 and GMCP are, can you provide a statistical test to verify the proposed model's superiority?