- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents MeteoText, a dataset aligning weather descriptions with meteorological variables and fields, and proposes MeteoOmni, a unified multimodal model for weather understanding and field generation. The method converts weather descriptions into numerical pseudo-observations using a Value Probe and incorporates them into field generation through TDOG.
Critical strengths
- The idea of using weather descriptions as observational constraints for meteorological field generation is interesting and has potential applications in historical climate reconstruction.
- MeteoText provides a relatively large dataset covering different geographic regions and meteorological conditions, supporting five understanding and generation tasks.
- The paper includes ablation studies examining the contributions of joint training, the Value Probe, and TDOG.
Critical weaknesses
- Since the model is trained on synthetic data, it remains unclear whether it can handle the inherent ambiguity and complexity found in natural language descriptions of weather.
- The "Value Probe" and TDOG methods proposed in the paper primarily combine numerical regression supervision with particle-based resampling; however, the paper fails to provide a sufficiently compelling argument regarding the novelty of these approaches compared to existing methods.
- The evaluation in real-world scenarios is limited to 739 weather warnings across 22 cities in China and covers only two tasks—a scope insufficient to support the authors' claims regarding the model's broader generalization capabilities.
- As shown in Table 4, the improvements gained from using real-world weather texts are marginal (the root mean square error, or RMSE, for temperature decreased from 1.759 to 1.747, and for precipitation from 7.737 to 7.693), and the paper lacks the statistical analysis necessary to verify the reliability of these differences.
- The "field generation" baseline model employed in the study differs significantly from MeteoOmni in terms of both architecture and capacity; furthermore, the paper fails to compare the proposed model against other methods that operate under the same constraints—namely, the use of identical textual or numerical observational data.
- Although the paper cites "historical climate reconstruction" as a key research motivation, the experimental section does not incorporate actual historical weather records; this weakens the evidence supporting the claim that the model holds practical, real-world utility.
Questions for authors
See above
5 comments
Answer of W2&3&4 To Reviewer EqMD
[W2]: Novelty of Value Probe and TDOG
[A2]: We sincerely thank the reviewer for raising this important concern regarding the novelty of our proposed methods.
We acknowledge that numerical regression and particle-based resampling are established techniques.
Our main contribution is a new framework that transforms natural language weather descriptions into spatially localized, station-like pseudo-observations and uses them to constrain meteorological field generation.
To realize this framework, we introduce Value Probe and TDOG as complementary technical components. The key innovation of TDOG lies in treating text-derived information as station-like observations and using local observation consistency to guide particle selection for whole-field generation. This design allows sparse, spatially localized textual observations to influence the generation of complete meteorological fields, rather than merely correcting individual grid cells.
To the best of our knowledge, this is the first attempt to use text-derived, station-like pseudo-observations as local physical constraints to guide the generation of complete meteorological fields through particle sampling.
[W3]: Real-World Evaluation and Generalization
[A3]: We sincerely thank the reviewer for highlighting the limited scope of our real-world evaluation.
We acknowledge that the real-world evaluation is limited to 739 weather warnings from 22 cities in China and two tasks.
To further extend the evaluation, we conduct an additional real-world text experiment on T5 using a different CMIP6 model, MIROC6, under the SSP2-4.5 scenario for 2021–2023. We pair the daily CMIP6 fields with contemporaneous real-world weather warnings for zero-shot evaluation.
| Setting | City-t2m (1×1) ↓ | City-tp (1×1) ↓ | City-t2m (5×5) ↓ | City-tp (5×5) ↓ |
|---|---|---|---|---|
| w/o real text | 2.9374 | 9.5225 | 3.1442 | 9.4751 |
| with real text | 2.2440 | 8.0776 | 2.6203 | 8.8280 |
| RMSE Reduction (%) | 23.61% | 15.17% | 16.66% | 6.83% |
As shown in the table, real-world text reduces the RMSE of both temperature and precipitation across all spatial ranges. The improvements on MIROC6 under SSP2-4.5 demonstrate that text-guided correction remains effective under zero-shot cross-model and cross-scenario transfer.
[W4]: Marginal Improvements and Statistical Reliability
[A4]: We sincerely thank the reviewer for pointing out the need for further statistical validation of the observed improvements.
The gains from real-world text depend on the background field. For T4, the unmasked ERA5 regions already provide reliable spatial context, so text mainly serves as supplementary local observational constraints, resulting in relatively modest improvements.
To assess the reliability of these improvements, we repeat the experiments using 5 different random seeds. We report the mean and standard deviation and paired statistical tests.
| Setting | Temperature RMSE ↓ | Precipitation RMSE ↓ |
|---|---|---|
| w/o real text | 1.7330 ± 0.0164 | 7.6830 ± 0.0402 |
| with real text | 1.7179 ± 0.0173 | 7.6457 ± 0.0385 |
| p-value | 0.0005 | 0.0482 |
The results show statistically significant improvements in both temperature (p = 0.0005) and precipitation (p = 0.0482), supporting the effectiveness of real-world text.
Answer of W5&6 To Reviewer EqMD
[W5] Baseline Selection and Comparability
[A5]: We sincerely thank the reviewer for raising this important concern regarding baseline selection and comparability.
We adopt meteorology-specific models as field generation baselines, following WeatherGFM [1]. A similar evaluation practice is also used in OmniWeather [2], which compares BAGEL-based unified model with task-specific models.
Our baselines use the same textual information and observations under matched input conditions, compared to our MeteoOmni.
We acknowledge the differences in architecture and model capacity. Therefore, these comparisons aim to evaluate the task performance of unified models against specialized models, rather than isolate the effects of architecture or model size.
[1] WeatherGFM (ICLR-25)
[2] OmniWeather (ICLR-26)
[W6] Historical Climate Reconstruction and Practical Applications
[A6]: We sincerely thank the reviewer for highlighting the gap between our research motivation and the current experimental validation.
We agree that our current experiments do not directly validate meteorological field reconstruction from historical weather archives. Historical climate reconstruction is a key motivation and potential application of our framework.
However, historical archives often lack explicit correspondence between weather descriptions and quantitative observations. Moreover, qualitative descriptions need to be interpreted against the climate conditions of their respective historical periods, requiring both paired text–observation data and period-specific climatological references.
Our real-world text experiments demonstrate two essential capabilities: extracting quantitative meteorological information from natural language and using text-derived observations to constrain field reconstruction. These capabilities provide a foundation for extending our framework to historical climate reconstruction. We will clarify this distinction in the revised manuscript and identify validation on historical archives as an important direction for future work.
Answer of W1 To Reviewer EqMD
Dear Reviewer EqMD,
Thank you for your valuable time and feedback. We hope our clarifications address your concerns.
[A1]: We sincerely thank the reviewer for raising this concern. We address ambiguity and complexity from two aspects.
Ambiguity. We account for ambiguity during synthetic data construction. Specifically, we define variable-specific numerical ranges based on national meteorological standards to guide qualitative text generation. Thus, descriptions correspond to numerical intervals rather than exact values. The grading schemes are provided below.
Table. ERA5 wind grading based on the Beaufort scale.
Table. ERA5 precipitation grading based on 24-hour accumulated precipitation.
Table. Standardized-anomaly grading for ERA5 temperature and CMIP6 variables.
Complexity. We evaluate MeteoOmni using real-world weather texts and different text generators to examine its adaptability beyond synthetic descriptions.
Real-world text reduces temperature and precipitation RMSE by 23.61% and 15.17% at 1×1, and 16.66% and 6.83% at 5×5, respectively.
T1: City Weather QA
MeteoOmni maintains broadly comparable performance across both GT settings and consistently outperforms GPT-5.5 across all three metrics.
T2: CMIP6 Text Quantification
MeteoOmni maintains comparable quantification performance under both input generators.
T3: ERA5 Text Quantification
MeteoOmni also maintains comparable performance on T3 under both generators.
Overall, MeteoOmni shows good robustness to test-time text generator changes. Its performance remains broadly stable across T1, T2, and T3, demonstrating adaptability to different weather text expressions.
Together, these experiments demonstrate MeteoOmni's adaptability to real-world descriptions and variations in text generation styles.