- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a two-stage framework for early classification of time-domain sources. Specifically, the first part uses a generative model for estimating hypothesis of time-domain data. The second part adopts the generated hypothesis for classification. The two parts are trained seperately to prevent the data leakage issue. Additionally, this paper also conducts a detailed ablation study for supporting the claims in the paper (e.g., casaulity and physics-awareness).
Critical strengths
This paper is well written in a way that readers can learn a lot even though they are not from this specific field. The paper describes the data preparation and the method in details. The method also seems intriguing and indeed achieves little improvement on the used metrics.
Critical weaknesses
While enjoying reading this paper, I have some major concerns that seem not well addressed in the current version.
- Sec 3.2 is designed to address the physics-informed feature. However, the current setup seems only taking input data and metadata as input to the model. To me, this does not directly imply physics-informed features. I would expect to see how physical contraints (e.g., common light curve characteristics) are coupled into the model design.
- Student-t log density is adopted for estimating candidate score . Why do the authors pick this density? Does it provide any statistical advantage, or does it associate with physics?
- The and in Eq. (12) should be explained.
- The authors provide paired gain and CI shows superior performance over the baseline; however, it seems that baseline does not include any state-of-the-art methods. All the baselines are seemingly naive.
Overall, this framework is interesting, especailly its generatiion-then-verification structure. However, it does not show any strong evidence that this method can provide much better peroformance (on selected metrics) or physics-contrained features. The authors should consider to address this major concern as this is the last mile to a successful finish line.
Questions for authors
I listed some minor questions and suggestions here.
- Eq. (1) is like an orphen now. I understand equations can be more informative than words, but an equation without explanation of notations can be confusing. It is highly recommended to remove this equation and replace it with description.
- What is ?
- It is highly recommended to include more details about Eq. (8). That is, the detailed definition of each term.
- It's highly recommended to enlarge the font size in fig.1.