- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates in-season crop yield prediction from a world model perspective, aiming to predict crop yields under incomplete observations of vegetation development, and proposes PhenoBIID, which models vegetation growth dynamics to reconstruct unobserved vegetation trajectories and improve downstream yield prediction. The paper also introduces a benchmark for evaluating vegetation trajectory forecasting and crop yield prediction under partially observed growing seasons. The proposed PhenoBIID reduces RMSE by 0.12–4.74% relative to the strongest ML-based baselines with 10–70% unobserved windows.
Critical strengths
-
In-season crop yield prediction is an important task for agricultural monitoring and decision-making.
-
Modeling intermediate vegetation under a world model-based paradigm to predict final yield is an interesting direction.
Critical weaknesses
-
The motivation and novelty of the world model formulation are unclear. In-season yield prediction has been studied previously [1], but the paper does not clearly identify the specific challenges that motivate its proposed framework and benchmark. If the primary objective is to forecast vegetation dynamics for yield prediction, the distinction from a temporal forecasting model with a yield prediction head needs to be established.
-
The experimental evidence does not sufficiently justify the additional architectural complexity of PhenoBIID. Comparisons are primarily against traditional machine learning methods, yet the reported performance improvements appear relatively modest (e.g., Maize: RMSE decreases from 0.8689 to 0.8584; Soybean: RMSE decreases from 0.3243 to 0.3118), considering the PhenoBIID introduces substantially more architectural complexity.
-
Some minor weaknesses:
- Presentation and readability issues: Figure 2 is not in SVG format; Figure 11 in the appendix appears to contain AI-generated graphical artifacts (i.e., distorted symbols in the LightGBM residual head module)
- Essential methodological details, such as the Bidirectional relevance modulation module, should be included in the main paper rather than relying heavily on the appendix.
[1] You, J., Li, X., Low, M., Lobell, D., and Ermon, S. Deep Gaussian Process for Crop Yield Prediction Based on Remote Sensing Data. AAAI 2017.
Questions for authors
-
Is explicit vegetation trajectory forecasting necessary for yield prediction? As the proportion of masked observations increases from 10% to 70%, the RMSE for rice changes only slightly (0.8440 --> 0.8584), with similarly limited variation across other crops. How should these results be interpreted in relation to the role of trajectory reconstruction?
-
How does PhenoBIID compare with deep learning-based baselines? In particular, how does it perform against a model that directly predicts yield from available observations without explicitly reconstructing missing vegetation trajectories?
-
What is the unique contribution of the proposed benchmark? Could the same evaluation setting be established by masking selected observation windows in existing crop yield datasets? Moreover, given that the benchmark is a main contribution, it's better to introduce its construction details in the main paper rather than primarily in the appendix.
-
The variables included in the context are not clearly specified, and initinitialization of (S_0), particularly how (V^{prev}) and the context are fused, is not adequately described.
-
In Equation (1), the transition operator (i.e., C_p) is introduced without a clear explanation of its underlying operations. The variables (u_{p,k}) and (F_p) in Equation (2), as well as (X) in Equation (3), are not sufficiently defined.
-
Do the encoders and BIID modules share parameters across stages, or does each stage use a separately parameterized module? How are these modules trained?
-
How does the modified hidden-window completion rule in Section 5.3.1 differ from the original setting? The reported RMSE reductions for rice are consistently negative under this setting. Could the authors discuss the potential reasons for this deterioration?
6 comments
Dear Reviewer J8C5,
Thank you again for your thoughtful feedback. We wanted to briefly follow up on our response, particularly the capacity-matched comparison and the rice diagnostics we added in response to your questions. If you have a chance to review these results, we would appreciate hearing whether any points about the value of explicit trajectory forecasting still need clarification.
Thank you for your time.
Response to author
Thank you for the detailed response and additional experiments. The authors have addressed some of my concerns, and the new experimental results further strengthen the contributions of the proposed method.
However, several concerns remain unresolved:
-
Motivation for using a world model. I am still not fully convinced of the necessity of a world model for this task. Conventional prediction models can also use recurrent conditioning to update hidden states based on observed feedback and perform multi-step rollouts to progressively predict future vegetation states. Therefore, the authors should further clarify what unique capabilities the proposed world model provides beyond existing temporal prediction frameworks.
-
Performance on rice. The proposed method still does not achieve state-of-the-art performance on rice. Could this be related to differences in the rice data distribution compared with other crops? A more detailed analysis would help explain this performance gap and clarify the limitations of the proposed method.
So I keep my original socre. and I believe addressing these remaining concerns would make the paper more convincing and strengthen it for a future submission.
Dear Reviewer J8C5,
Thank you for your thoughtful feedback on our submission. With the discussion period coming to a close, we wanted to follow up on our reply to your review. If there are any points you would like us to elaborate on or any questions we have not fully addressed, we would be glad to provide further clarification.
Thank you again for your time and for helping us improve the paper.
Best regards, The Authors