- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes hierarchical Bayesian trajectory principal-manifold sampling (HB-TPM), which learns a family of smooth curves from ordered source tasks and adapts it to targets. The authors performed experiments on two synthetic, vector benchmark and synthetic photon arrivals, and one real dataset, cardiac frame reconstruction. The comparison with the implemented baselines show that the presented method offers the best mean reconstruction.
Critical strengths
The problem, where the new samples lie when a few observations reveal only fragments of a trajectory, the authors investigate is interesting. Current learning methods require a good amount of data to learn the distribution and then sample from it later.
Critical weaknesses
The experiments are weak. The authors performed experiments only on a single realistic dataset. Also, the number of examples generated rom the synthetic datasets are pretty limited. I would expect to see how the method performs with the number of samples changing.
One of the weakest points is that the baselines and overall comparison are in the level of ablations. For example, in Table 3, the authors presented the main result of the realistic dataset but it looks like ablation since the most comparisons are derived from the presented technique.
The other point about the experiments is that the baselines are extremely weak. I would expect to see at least couple of strong deep learning baselines such as VAE or beta-VAE. A comparison with deep learning method while changing the sample size would be very helpful to show the strengths and trade-offs.
The last point is that the overall presentation is poor. There are so much space where the authors can in the main manuscript and bring context from the appendix. The main manuscript is not even complete 9 pages while may details are buried into the supplementary.
Overall, I believe that the manuscript requires a major revision. And, its current experiments are far below the ICLR bar.
Questions for authors
Why not comparing with stronger baselines and using more datasets? The current evaluations are closer to ablations rather than main results.