- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper presents an approach to predict from multimodal data, including low resolution satellite data (Sentinel-2), weather and static geospatial variables the yield of crops. This is definitely a topic worth exploring and the ideas presented seem well motivated and sound. The presentation of the proposed approach is a bit difficult to follow, especially the notation and operationalisation of the problem could be improved with respect to clarity.
Critical strengths
Interesting, timely and relevant topic
Dedicated preprocessing pipeline with substantial domain expertise.
Well embedded in scientific literature
Critical weaknesses
The main problem when reading the modelling approach is that many of the variables are not easy to understand. It is not clear what „process“, "causal observation boundaries“, „frozen protocol“ or „persistent-action tiers“ refer to.
Additionally some of the notation could be clarified a bit better. For instance, whether variables are scalars, vectors or matrices, which dimensionality they have, what indices refer to etc. in line 141 for instance it’s not clear was X_i and the context u_i is. Are modalities indexed? Or are they assumed to be represented via the multivariate nature of the variables X_i? Examples could be helpful to illustrate this.
Many decisions of the modelling are not easy to follow - if it’s standard in the application scenario, it would be good to mention references or additional motivation, why three checkpoints are needed for instance. Also, why the process coordinate has to be monotonous (and what the process refers to).
For the empirical results it would be good to have error bars (ideally quantiles) to assess the differences between methods. The comparisons Table 1 could be explained a bit better in terms of the exact experimental settings. An important question is for instance, whether all preprocessing parameters and procedures were the same and only the ML model was changed? It seems that the advantages of the proposed model could be due to the preprocessing hyperparameters, and in that case it’s a bit misleading to present the proposed methods as the winner, it’s just a tree based model, right?
Questions for authors
Does the approach present a new model or is the contribution the preprocessing pipeline?
Were all hyperparameters of the preprocessing pipeline optimised with some standard HPO procedures (grid search, random search, bayesian global optimization,...)?
4 comments
R2. Why GDD, why three looks, and how settings were chosen (W3, Q2)
GDD increments are nonnegative, so later checkpoints include earlier observation histories. It also aligns fields by accumulated heat, which is closer to crop development than calendar time. In the controlled comparison, GDD gives RMSE 1.0361 versus 1.0961 with calendar-day alignment (paired 95% CI for the difference ; HZZH R4, Table R4a).
The three look thresholds at 35/50/65% of crop-specific median seasonal GDD provide an early reading, an update, and a later decision. The 278-field development sensitivity experiment shows Action FPR/recall of 0.43%/13.33% for the original schedule, versus 3.00%/24.44% for four looks and 3.86%/28.89% when three looks shift later (HZZH R4, Table R4b). These results demonstrate the trade-off; the original schedule was not selected to maximize recall.
Preprocessing involved three categories of design choices: fixed agronomic/data definitions (SCL classes 4/5, four indices, GDD base 5°C and cap 25, six sampling positions); training-fold estimates (crop-specific GDD cutoffs, imputation, country–crop target normalization and q20 thresholds); and development selection (11-point mixture grid on 154 farm-disjoint early-stop fields, giving , plus the original alpha spending and persistence rule). We did not perform an exhaustive grid, random, or Bayesian search across all preprocessing and model configurations. Normal-field scores from early-stop were reused in the original pooled null, with the formal consequence explained in PrXb R1.
R3. What is new, and what is being compared? (W4, Q1)
The main contribution is a progress-aligned multimodal representation and an integrated monitoring framework, rather than a new regression architecture. GDD defines both observation boundaries and a common temporal coordinate; a constructed 131-dimensional vector enters ExtraTrees/HGB; risk scores support screening and optional, conservative escalation. The mean-preserving spatial branch adds 10 m within-field evidence without changing the field prediction (original paper, Fig. 4: median localization AUROC 0.7316).
The full baseline comparison in HZZH R1, Table R1a evaluates complete pipelines, not the same preprocessing with only the predictor swapped. Architecture-specific inputs differ: aligned tabular features for trees, sequences for temporal models, frozen image features for AgriFM, and adapted modality fusion for MMGF. We therefore use separate controlled ablations for the representation: the same predictor and causal prefix under calendar vs GDD alignment (HZZH R4, Table R4a) and modality removal on the development challenge (full 1.0361, without weather 1.0936, without static context 1.0496, without indices 1.0521, Sentinel-2 only 1.1419 RMSE).
Model settings were fixed or selected by model-specific development early stopping; no common exhaustive HPO was used. The MLP's 15% internal validation was not farm-grouped and belongs only to the fixed-split comparison. The ExtraTrees/HGB mixture gives a small fixed-split benefit over aligned ExtraTrees (1.0361 vs 1.0459), but five-fold farm-disjoint OOF RMSE is essentially tied (1.2224 vs 1.2212, paired 95% CI [−0.0087, 0.0130]; HZZH R2, Table R2a). Our evidence therefore points primarily to the representation and integrated monitoring use case. The incremental advantage of the mixture itself is limited. A direct same-calibration policy comparison (PrXb R3) finds that Persistence reduces false alerts but also substantially reduces recall; its value depends on the costs of false alerts and missed fields.
Thank you very much again for your thoughtful review and for taking the time to consider our detailed response.
We sincerely hope that our clarifications have helped address your concerns. We would be very grateful if you could let us know whether there is anything else we might clarify or improve. We would be more than happy to provide any additional explanations or evidence that could be helpful for your assessment.
We truly appreciate your time and patience, especially during this busy reviewing period. Thank you again for your consideration!
R1. Meaning of the terms and notation (W1, W2)
Thank you for flagging the unclear notation. Here, process means crop development indexed by cumulative thermal time; causal observation boundary is the crop-specific GDD cutoff for a decision; frozen protocol means the preprocessing, prediction, calibration, and alert settings fixed for the original audit; and Persistent Action is an alert after two consecutive Watch crossings.
The progress coordinate is
gi(t)=∑u≤tclip(Ti,umean−5,0,25)
a non-decreasing scalar. At look k, crop ci has a scalar threshold Lci,k. The causal prefix is defined as Xi(k)=(xi,t)gi(t)≤Lci,k , containing only observations available up to this cutoff in their original temporal order. These prefixes are nested across successive checkpoints.
Table R1a. Main symbols and dimensions.
Modalities are identified by channel position, rather than a separate modality index. The 18 dynamic channels are sampled at six positions (108 values), then concatenated with 23 static features; see HZZH R5.
The alert rules are
\qquad A_{i,k}=W_{i,k-1}W_{i,k}.$$ We will add these definitions and a step-by-step input schematic to the methods section.