- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes a method for estimating the physical parameters of asteroids from photometric observations. Specifically, the method takes light curves together with geometric metadata as input and employs a neural network to estimate asteroid shape parameters. The model is trained and evaluated on a synthetically generated dataset.
Critical strengths
The problem studied in this paper is interesting and potentially valuable.
Critical weaknesses
In its current form of the paper, I believe there remains a substantial gap between the methodology, experimental validation, and overall presentation of this work and the standard expected for an ICLR publication. My main concerns are as follows.
-
The assumptions underlying the observation model may be overly simplified. Although the problem itself is interesting, asteroid photometric observations are likely influenced by factors beyond those considered in the paper, such as asteroid shape, the Sun-target unit vector, and the observer-target unit vector. For example, surface material composition, albedo variations, surface scattering properties, and other physical characteristics may also substantially affect the observed brightness. Ignoring these factors may introduce a considerable gap between the synthetic setting considered in the paper and real-world observations. The authors should more carefully justify the assumptions behind the synthetic data generation process and, ideally, investigate how robust the proposed method is when these assumptions are violated.
-
The practical availability of the geometric metadata is unclear. In addition to the light curve, the proposed method requires a 9-element geometric metadata vector as input. However, the paper does not sufficiently explain how these quantities would be obtained in a realistic deployment scenario. Are all of these metadata directly available from astronomical observations or ephemeris information, or do some of them themselves need to be estimated? If the latter is the case, the accuracy and availability of these quantities could significantly affect the practical applicability of the proposed method. This point should be clarified, and the sensitivity of the method to errors in these metadata would also be useful to evaluate.
-
The evaluation metrics are not used consistently in the experimental comparison. Section 5.1 introduces several evaluation metrics, including MSE, MAE, and . However, the comparison with baseline methods appears to rely only on . It is unclear why the other reported metrics are omitted from the baseline comparison. Providing MSE and MAE for all methods would enable a more comprehensive and fair assessment of their relative performance.
-
The baseline comparison in Table 3 requires substantially more discussion, and the results do not clearly demonstrate the advantage of the proposed method. The descriptions and implementation details of the baseline methods in Table 3 are insufficient, making it difficult to assess whether the comparison is fair and reproducible. More importantly, the "Random Forest + FFT" baseline appears to offer a particularly strong alternative to the proposed approach: it achieves a higher while also requiring less training time. Although its inference time is higher than that of the proposed method, the reported latency is still only on the order of milliseconds, which may be negligible in many practical applications. Based on the current results, it is therefore unclear what practical or methodological advantage the proposed neural-network-based approach provides over this baseline. The authors should provide a more detailed analysis of this trade-off and more convincingly demonstrate the situations in which the proposed method is preferable.
Questions for authors
Please see the weaknesses.