FireMPC: A Multi-Source Pan-Canadian Wildfire Benchmark Revealing Spatiotemporal Generalization Gaps
Abstract
Under Climate Change, wildfire activity is intensifying worldwide, with Canada experiencing increasingly severe events that now affect every province and territory. However, existing machine-learning (ML) datasets remain constrained by geographic bias, narrow driver sets, opaque sample selection, and limited exploration of model failure modes. We introduce FireMPC dataset, the first pan-Canadian multisource wildfire risk benchmark, covering approximately one billion hectares, or km, across the entire Canada at km daily resolution from to , and integrating drivers across fuel, topography, meteorology, and human activity. FireMPC is also the first large-scale machine-learning benchmark to embed the six knowledge-driven indicators of the Canadian Forest Fire Danger Rating System (CFFDRS), bridging knowledge-based and data-driven modeling. Building on this dataset, we propose FWI-guided hard negative mining (FWI-HNM) strategy. We score each non-fire candidate using a calibrated CFFDRS composite, and then incorporate these hard negatives during model training. FWI-HNM mitigates the trivial-negative failure mode of random sampling, yielding F1/PR-AUC gains of - and ECE reductions of up to across thirteen benchmark ML models. Stress tests under horizon-extension and spatial-generalization protocols expose substantial generalization gaps. Mean F1 falls from at the next-day horizon () to at the 30-day horizon (). All six ecological, land-cover, and regional spatial-shift scenarios yield a - relative F1 drop. These results motivate the development of large-scale, driver-diverse, spatially comprehensive datasets. The dataset, code, and sampling artifacts are available at https://anonymous.4open.science/r/FireMPC.
Related papers
See more related submissions when the market opens.