- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper discusses the problem of sphere covering, and concretely the matched filter template placement for gravitational wave detection. It proposes isobank, a method that trains a normalizing flow to transform signals into a Euclidean space that represents the proper distances in the physical parameter space. It uses a loss that combines global and local objectives. The method is applied to 3-dim and 5-dim GW signal spaces, where it showed improved coverage and mismatch compared with state-of-the-art method mbank.
Critical strengths
- The proposed isobank builds on the idea of learning an invertible mapping into a representation space in order to construct a covering of the signal space. This is a clear motivation and reasoning, and produces performance improvement over state-of-the-art method (with a question to be answered below).
Critical weaknesses
- The result and contribution of this paper is mostly confined to the field of GW detection, and methodological contribution is rather limited. There are some interesting technical points in the paper but never expanded upon. For example for the loss function which is a sum of 4 objectives, while the paper motivates each at an intuition level, it did not provide evidence or concrete analysis (e.g. through ablation) to examine the effect of each loss on the overall objective. The hand-tuned weights for these terms is another concern, as the paper did not discuss the sensitivity to them.
- The key claim about performance improvement over mbank uses the default parameters, and it is not clearly explained to what extent that will undermine the claim. Since this is the centerpiece evaluation result, it should be presented with more clarity.
Questions for authors
- In section 6.3 it's mentioned that mbank was run with its default settings. What other parameters are tunable for mbank, and how sensitive is performance to them? Could the performance be improved by adjusting its parameters, and how large of a performance gain would remain?
Response to reviewer 3
Response to Reviewer 3
We thank the reviewer for their constructive feedback. We have uploaded a revised version of the manuscript, with all amendments highlighted in blue.
Response to comment 1 (methodological contribution, ablations and sensitivity analysis).
We agree with the reviewer that our work is currently focused on GW detection. However, a future avenue is to explore applications to waveform surrogates, where autoencoders have previously been used. The results in Appendix 8.5, comparing isobank with metric-preserving autoencoders, indicate that our method is more efficient for this task and could be extended to other sub-fields within GW physics. Applicability to other domains remains an interesting direction for future work.
We also agree that the individual contributions of the loss terms and the sensitivity to their weights deserved further investigation. We have therefore added an ablation study and sensitivity analysis in Section 6.3, with additional per-retraining results in Appendix 8.3.
The ablation study shows that Lloc, Lbnd and Ledge each measurably improve coverage in the eccentric space, whereas removing Lglob has no detectable effect on coverage in either the eccentric or aligned-spin space. Training with Lglob alone, however, results in substantially worse coverage. These results provide experimental evidence for the contributions of the loss components, while indicating that the global term could be omitted without measurable loss in the spaces considered here.
We also investigate sensitivity to the loss weights. The results are generally stable under factor-of-two changes to the coefficients of the local terms, although reducing the weight of Ledge or substantially increasing the tail-term weight (γ=10) degrades performance. This analysis provides a clearer understanding of the role of the different coefficients and identifies the edge term as particularly important for maintaining coverage.
We refer the reviewer to Section 6.3 and Appendices 8.3 and 8.5 for the full experimental results, as well as our response to Reviewer 2, Comment 2, for additional details on the ablation study.
Response to comment 2 (mbank parameter sensitivity and comparison).
The reviewer is correct that mbank may not be optimally tuned for our task. Another reviewer also pointed out that mbank may lack sufficient flexibility in our current setting. We therefore performed a sweep of minimal match and covering fraction with the default mbank model, as well as a brief fine-tuning experiment. Details are provided in Appendix 8.4. These experiments show that no tested mbank configuration achieves the same coverage with as few templates as isobank, demonstrating the efficiency of our method in the 5D eccentric space. We refer the reviewer to Appendix 8.4 for the detailed results.