- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
Light curves are difficult inputs for machine learning: observations arrive at irregular times and with unequal uncertainties. Surveys also differ in filters, calibration offsets, and temporal coverage. The challenge is to extract a useful description of the underlying variability from these incomplete measurements and to reuse it when labels are limited or the observing survey changes. This paper focuses on the challenge of extracting a useful description of the underlying variability from these incomplete measurements and reusing it when labels are limited or the observing survey changes. To solve the problem, the authors present SEASTAR-TS, which learns representations directly from photometry by predicting masked observations while accounting for measurement uncertainty. The proposed method is evaluated on four datasets under different label bugdets and observing conditions. The experimental results shows the effectiveness of the proposed method.
Critical strengths
-
The paper addresses the challenges in astronomical tasks. The proposed framework are designed for the characteristics of astronomical data through its input encoding and self-supervised pretraining objective, rather than simply application of machine learning methods.
-
Unlike conventional MSE-based reconstruction, the faussian KL objective uses the measurement uncertainty. The ablation study in Appendix also shows that Gaussian KL achieves the highest performance across all label budgets.
Critical weaknesses
My main concern is the limited methodological novelty, as most components are based on established techniques. But the conbination of the methods is effective on an important scientific problem.
Questions for authors
-
What is the main novelty beyond existing masked reconstruction, uncertainty modeling, and semantic alignment methods?
-
Can the authors provide more direct evidence that the Gaussian KL objective is more effective than MSE, especially under different measurement uncertainties and noise levels?
-
How much of the improvement comes from the astrophysical information in class descriptions rather than the pretrained text encoder or class names?
2 comments
Response to Reviewer 2S42 (2/2)
Q3 Description content versus the text encoder and class names
For held-out classes on ELAsTiCC, Table 2 already separates these: random vectors reach 0.055 top-3 accuracy, class names 0.465 and descriptions 0.559 (AUROC 0.460, 0.771 and 0.780). Most of the ranking signal is thus available from the class name through the text encoder, and the descriptions add a further gain in top-3 and top-5 accuracy.
To isolate each factor we conducted a new experiment, a cross-taxonomy test. A model aligned with LEAVES labels classifies StarEmbed stars (7 classes, 3,477 stars that the model never saw with labels) from the StarEmbed class texts alone, without any StarEmbed label. The class descriptions of the paper (Appendix G) contain a physical part and a light-curve morphology part, and we test each part alone as well as the class names. Every row uses the same kind of text for the LEAVES classes during alignment and for the StarEmbed classes at test time. The reference row maps the predicted LEAVES classes to StarEmbed classes with a hand-written table instead of text (balanced accuracy, three seeds):
| Text | Text encoder | Balanced accuracy |
|---|---|---|
| Full description | Qwen3-Embedding-8B | 0.705 ± 0.002 |
| Class name | Qwen3-Embedding-8B | 0.617 ± 0.012 |
| Physics-only description | Qwen3-Embedding-8B | 0.706 ± 0.004 |
| Morphology-only description | Qwen3-Embedding-8B | 0.678 ± 0.002 |
| Full description | Qwen3-Embedding-0.6B | 0.692 ± 0.016 |
| Full description | e5-mistral-7b-instruct | 0.707 ± 0.003 |
| Class name | e5-mistral-7b-instruct | 0.607 ± 0.008 |
| Reference: expert-written class mapping | none | 0.694 ± 0.006 |
Descriptions assigned to the wrong classes score 0.04 to 0.10. The class name alone carries substantial signal (0.61 to 0.62). The description content adds to it (0.705 to 0.707), and the physical part of the description is sufficient to reach the full score. The result does not depend on the text encoder (Qwen3-Embedding, Zhang et al., 2025): a model from a different family (e5-mistral-7b-instruct, Wang et al., 2024) gives the same two numbers, and a model more than ten times smaller gives 0.692. Descriptions are also the only text that reaches the accuracy of an expert-written mapping between the two taxonomies.
Response to Reviewer 2S42 (1/2)
We thank the reviewer for the constructive questions.
Q1 On methodological novelty
We agree that masked reconstruction, Gaussian likelihoods and contrastive alignment are established, and we do not claim a new learning principle. The contribution lies in what their combination achieves for irregular astronomical photometry:
Q2 Gaussian KL versus MSE
Our evidence is the controlled ablation in Appendix C.1. The pretraining objective is varied while the data, the schedule and all hyperparameters are kept identical across configurations. Averaged over the other design axes, Gaussian KL has the highest test macro-F1 of the four objectives at every label budget (Table 12):
Gaussian KL is also stable: none of the ten collapsed runs in Table 13 uses Gaussian KL. We agree that Gaussian KL and simple MSE are close, especially once 5% or more of the labels are available, and we will say so explicitly in the revision. We also conducted a new experiment on noisier data, adding noise of 2 and 5 times the reported error to half of the observations, with the reported errors enlarged accordingly, for pretraining, fine-tuning and evaluation alike. With the recipe of Table 1 (light curves only), test macro-F1 over three seeds is:
The two objectives remain close at both noise levels. We therefore present Gaussian KL as a principled way to use the reported measurement uncertainty that is at least as good as MSE in our experiments, and not as a major source of the gains. We do not claim that it makes the model more robust to additional noise.