- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes WUIRL, a physics‑constrained reinforcement‑learning framework. Using only limited post‑wildfire damage records and coarse temporal data, it reconstructs building ignition‑spread pathways in the wildland‑urban interface. On the 2025 Eaton fire case study, it achieves a reasonable balance between predicting burned and surviving buildings. Still, it suffers from inaccurate temporal reconstruction, training performance degradation, and a lack of cross‑fire generalization validation.
Critical strengths
This work innovatively couples a fixed domain‑specific physical simulator with reinforcement learning. The RL agent only learns to select fire‑exposure pathways instead of replicating intricate combustion physics, lowering the learning burden for RL and offering a novel scientific‑machine‑learning paradigm for post‑hoc wildfire temporal reconstruction.
Critical weaknesses
- Poor POMDP handling. Though recognized as a partially‑observable setting, no POMDP‑specific solutions are adopted. Vanilla memory‑free PPO is directly applied without recurrent networks for history encoding. The policy relies on static GraphSAGE embeddings and pooled statistics, which discards temporal information and may harm pathway‑selection quality.
- Heuristic reward design with insufficient ablation. Key reward hyperparameters (temporal/final‑outcome weighting, doubled weight for boundary buildings) are ad‑hoc without calibration. Potential conflicts between temporal and final‑outcome objectives are observed, yet ablation studies are missing to show performance trade‑offs under varied reward weights.
- Incomplete SMDP treatment and ambiguous credit assignment. Multiple actions can happen within one physical time window under the SMDP formulation. Despite time‑dependent GAE usage, concurrent‑action credit‑assignment challenges are undiscussed. This is a plausible cause for the observed training degeneration but receives little analysis.
- Risk of RL compensating physical‑model misspecification. The physical ignition simulator contains many assumed, fitted and extrapolated parameters. The RL policy could learn physically unrealistic pathways to compensate simulator errors and still match ground‑truth burn labels, threatening the physical plausibility of reconstructed trajectories.
- Incomplete ablation suite. Physical‑mechanism ablations are only executed at evaluation time (no retraining), limiting their interpretability. Systematic ablations for core RL components (GraphSAGE encoder, temporal reward, factorized action space) are absent, making it hard to quantify each module’s actual contribution.
Questions for authors
- This task is formulated as a POMDP, yet memory‑free vanilla PPO is used without LSTM/GRU‑style recurrent modules for history encoding. The GraphSAGE encoder is also pre‑trained purely on static building attributes. Please analyze biases induced by partial observability, justify the omission of recurrent architectures, and provide arguments that static graph embeddings are sufficient for dynamic fire‑spread pathway selection.
- Hyperparameters including temporal‑term weights, the scaling factor for final‑outcome term, and doubled weights for boundary buildings are set heuristically without sweeping or ablation. Please justify these hyperparameter choices and supply reward‑weight ablation experiments to demonstrate trade‑offs between final‑damage metrics and temporal‑reconstruction performance.
- This is an SMDP environment permitting multiple concurrent actions per physical time window, creating challenging credit‑assignment conditions which may contribute to training degeneration. Please explain how credit is assigned across co‑occurring actions and diagnose to what degree SMDP‑related credit‑assignment issues drive training degradation.
- The ignition simulator contains numerous assumed and extrapolated parameters. There is risk that the RL policy learns physically implausible exposure pathways to compensate for simulator defects and fit burn labels. Please provide diagnostic analyses or experiments to disentangle performance gains originating from physically plausible pathway reconstruction versus policy compensation for model misspecification. Also discuss whether evaluation‑time physical ablations could be biased by such compensation effects.
- Current physical‑mechanism ablations are executed at evaluation time without retraining, and ablations over core RL components are lacking. Please add controlled retrained baselines where physical modules are disabled from the start of training. Also perform component‑wise ablations over the GraphSAGE encoder, temporal‑reward term, and factorized action space to validate their individual contributions. Further discuss whether ablation conclusions are bounded by the single‑fire dataset.
7 comments
The five weaknesses correspond to the five questions (Q1–Q5), so we answer each briefly here and give the full experiment under the matching question.
WUIRL handles partial observability through the physical state rather than a recurrent network (Sec. 3.3, lines 225–228), since each building's accumulated dose carries its exposure history (Sec. 3.2, lines 200–204). Adding the two quantities the policy cannot see and retraining gives no improvement (reconstruction score −4.39 with the added inputs vs −4.32 without) (Q1). We will add this test to the appendix.
The weights are design assumptions set from observation reliability (Appendix D.1, lines 1242–1266) and checked on a synthetic fire before training. We swept every weight the reviewer names and retrained. Timing and final damage do not conflict once training is stable, removing the boundary doubling costs 0.34 in score, and outcome weight 1 is the only setting stable at 500k (Q2). We will add the sweep to the appendix.
We agree that same-minute decisions share credit (Appendix E.7, lines 1614–1644). We retrained with two changes that leave same-minute credit untouched, a shorter horizon and a smaller outcome weight. Both remove the collapse (reconstruction score at the 500k checkpoint −4.447 and −4.445, against −5.486 for the paper's setting), so the delayed final-damage term caused it, not concurrency (Q3). We will add this diagnosis to Section 4.7.
The policy can choose only pathways the physics admits, and the physics alone decides ignition (Sec. 3, lines 157–161), using published relationships (Appendix B). We retrained without each mechanism and reran the trained policy under perturbed parameters. No policy fits without radiation or firebrands (reconstruction score −5.52 and −5.47, against −4.39), and the policy's score lead over an untrained one holds under ±20% heat flux. The policy is therefore not compensating for the physics, with the exception of firebrand timing, the one parameter without a published value (Q4). We will add these tests to the appendix.
We retrained every mechanism, and the RL components the review names. Radiation and firebrands dominate (removing either costs over 1.0 in reconstruction score), followed by vegetation (0.33). The learned receiver stage contributes 0.16, the GraphSAGE embeddings 0.10 and the hourly reward term 0.08 (Q5). We will add the retrained ablations to Section 4.4.
Q1. The physical state already carries the relevant history, so a learned memory adds little. The policy's observation is defined in Appendix C.1, lines 1172–1180.
Experiment 1. Missing information. We gave the policy the two quantities it cannot see, pending firebrand progress and heat absorbed across the frontier, and retrained. There was no improvement (reconstruction score −4.39 with the added inputs vs −4.32 without), so the accumulated dose (Sec. 3.2, lines 200–204) already carries the history a memory would provide. We will add this test to the appendix.
Experiment 2. Firebrand timing. We shortened the firebrand gate from 900 s (Sec. 4.4, line 372) to 600 s at evaluation. The trained policy's score lead over an untrained one falls from 0.25 to 0.09, so firebrand timing is the one place where a memory could still help. We will add this test to the appendix.
Experiment 3. Static embeddings. We zeroed the GraphSAGE embeddings and retrained. The score drops only 0.10, because the policy's view still changes every step through live heat and dose (Sec. 3.3, lines 225–231), so static embeddings are sufficient. We will add this test to the appendix.
We will also note a recurrent policy as future work.
Q2. The reward was designed and checked before training and then fixed, and the new sweep tests how sensitive the results are to it. The terms are defined in Appendix D.1, lines 1242–1266. Timing gets a ±1-hour window for hourly-map error, final outcomes get a tighter tolerance and twice the weight because inspections are near-complete, and boundary buildings get twice the weight because they carry the most information about spread.
Experiment 1. Synthetic check. On a synthetic 12-house, 8-hour fire, we scored every single-house timing change plus whole-cascade controls. The scores ranked as intended (correct −0.154, one-hour shift −0.208, wrong intermediate progression −0.444, wrong boundary outcomes −5.873, random −7.037). We will add this check to the appendix.
Experiment 2. Weight sweep. We changed one training weight at a time, kept the locked score for evaluation, and retrained to 500k actions. The outcome weight multiplies R_final (2 in the paper), the boundary weight multiplies boundary buildings' outcome score (2), the hourly weight multiplies R_hourly (1), and the curriculum phases the hourly term in from 150k to 300k actions.
| Training setting | Score | Timing | Final damage | Burn / survivor recall | 500k checkpoint |
|---|---|---|---|---|---|
| Outcome weight 1 | −4.317 | −0.933 | −1.692 | 84.7 / 47.0 | −4.445 |
| Outcome weight 2 (paper) | −4.385 | −0.946 | −1.720 | 67.9 / 62.5 | −5.486 |
| Outcome weight 4 | −4.644 | −0.976 | −1.834 | 62.4 / 62.0 | −4.792 |
| Boundary weight 1 (paper 2) | −4.727 | −0.988 | −1.870 | 57.9 / 64.7 | −5.249 |
| Hourly weight 0.5 (paper 1) | −4.468 | −0.958 | −1.755 | 68.3 / 60.3 | −5.113 |
| Hourly curriculum (0 to 150k, full by 300k) | −4.386 | −0.940 | −1.723 | 76.6 / 53.6 | −4.848 |
Timing and final damage move together across settings, so the mixed result in Appendix E.4 (lines 1507–1541) came from collapsed final checkpoints. The real trade-off is between burned and surviving buildings. The boundary weight matters (removing it costs 0.34 in score), and outcome weight 1 is the only setting stable at 500k (score −4.445 at 500k, against −4.79 to −5.49 for the other settings), so we adopt it, with the evaluation score unchanged (Q3). We will add the synthetic check and the sweep to the appendix.
We thank the reviewer for identifying our "novel scientific-machine-learning paradigm for post-hoc wildfire temporal reconstruction." WUIRL is, to our knowledge, the first method to reconstruct building-level fire spread scored against an hourly record, and it reports the range of histories the physics and the record allow, with a confidence for each. We have addressed each concern below with additional experiments. We hope these additions address the reviewer's concerns. We would appreciate reconsideration of the evaluation in light of them, and welcome continued discussion.
The review summary notes limited data and three limitations, which we address in turn.
The limited data reflects the field rather than WUIRL. No fire records which neighbor ignited which building, and only a few earlier fires have detailed timelines [1, 2]. The Eaton Fire is what makes this work possible. To our knowledge, it is currently the only dataset that supports building-level reconstruction, with both an inspection of every structure and hourly progression across a whole community [3]. WUIRL is built for this kind of record, and its reconstructions will improve as better records become available. We will state this more clearly in the limitations.
Timing accuracy is limited by the record. The data give only coarse hourly progression, not when each building ignited (Sec. 3, line 145; Sec. 4.8, lines 453–454), so no model's timing can be checked more finely than the hour, and the paper treats timing as a secondary signal for this reason (Sec. 4.5, lines 385–399). We sampled 30 histories from the trained policy and compared their agreement on each building's hour with the record. Where the runs agree, they typically fall within an hour of the record, so agreement across runs is an informative measure of timing confidence. We will add this analysis to Section 4.5.
The reviewer brings a decline in training to our attention, which has improved our work. We reweighted the delayed final-damage term in training and retrained to 500k actions. Training stays stable (reconstruction score −4.45 at the 500k-action checkpoint, ±0.056 across seeds), and the selected checkpoint performs on par with the paper's (−4.32 against −4.39), so the results and conclusions of this paper remain unchanged, and our optimization's robustness is improved (Q3). We will update Section 4.7 with this default.
To test generalization within the data available, we held out each of five Eaton regions from training in turn. On unseen ground WUIRL's score falls half as far as CEM's (reconstruction score −4.40 on training regions, −4.73 on held-out ones). We will add the five-region results to Section 4.6.
RL fits this problem because reconstruction is a cascade of decisions with no labels for how each building ignited, only records to score against (Sec. 1, lines 48–55). A stochastic policy inside fixed physics also yields the many histories the data support, rather than one. We will clarify this motivation in the introduction.