- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PVFM is a 3.88M-parameter model for zero-shot PV forecasting, pretrained on 59.2 million valid PV time points from 746 sites. It uses a historical encoder and a future NWP-conditioned decoder, with solar-aware temporal embeddings and site conditioning, to produce non-crossing quantile forecasts. Five tasks cover hourly and 15-minute data, with forecast horizons from four hours to seven days. The evaluation includes unseen sites, region holdouts in Hong Kong and Australia, and ramp events. A satellite-image adapter is also fine-tuned with the PVFM backbone frozen.
Critical strengths
I find the comparison with target-site full-shot models in Table 1 particularly useful. PVFM achieves lower MAE and CRPS without updating its parameters on the target sites. The Hong Kong and Australia holdouts provide a further test of transfer to regions excluded from pretraining. The authors also acknowledge that target-site training remains stronger on some Australian 15-minute tasks.
Critical weaknesses
-
The satellite result does not separate the benefit of imagery from target-site adaptation or the change in training objective. Table 11 compares zero-shot PVFM with a model whose satellite-image adapter is fine-tuned on target-site labels using the masked mean squared error of the median forecast (Equation 38). An adapter trained in the same way without imagery is needed as a control. This concern is limited to the satellite extension. The reported results and model configurations also need clarification: Figure 6 and Table 11 give different RMSE values (0.0839 versus 0.0842) and R² values (0.8642 versus 0.8628). Rounding does not explain this difference. Table 5 suggests that PVFM-Sat uses a larger backbone than the main 3.88M model, but Table 11 does not identify the pretrained checkpoint for each PVFM row.
-
I am also concerned about whether the weather inputs are available when the PV forecast is issued. Appendix A.2 aligns archived GFS forecasts by valid timestamp, but does not identify the forecast run selected at each origin. Historical weather inputs come from ERA5 reanalysis. Section 6.4 acknowledges its availability delay, but tests removal of ERA5 only for the Anhui satellite task. The comparisons using shared weather inputs remain informative. Without an explicit GFS selection rule and tests using historical weather available at forecast issuance, however, I cannot judge whether the reported zero-shot gains would hold in operational PV forecasting.
Questions for authors
-
Can you compare the satellite-image adapter with an adapter without imagery, using the same pretrained checkpoint, target-site labels, training objective and training budget? Please also clarify the results and checkpoint configurations noted above.
-
Which GFS forecast runs and recent historical weather inputs are available at each forecast origin after publication delays are considered? With those inputs, do the reported zero-shot gains over pretrained TSFMs and target-site full-shot models remain across regions, forecast horizons and both temporal resolutions?
6 comments
Response to Reviewer 3Vem 2/3
W3 & Q2: Are the weather inputs available at forecast issuance, and do PVFM’s gains persist under these constraints?
Weakness 3. “Appendix A.2 ... does not identify the forecast run selected at each origin. ... tests removal of ERA5 only for the Anhui satellite task. ... I cannot judge whether the reported zero-shot gains would hold in operational PV forecasting.”
Question 2. “Which GFS forecast runs and recent historical weather inputs are available at each forecast origin after publication delays are considered? ... do the reported zero-shot gains over pretrained TSFMs and target-site full-shot models remain across regions, forecast horizons and both temporal resolutions?”
Response. We thank the reviewer for raising concerns about the availability of historical and future meteorological inputs at forecast issuance. To address these concerns, we conducted additional evaluations incorporating GFS initialization times, publication delays, and historical weather availability, examining whether PVFM retains its zero-shot advantages under more realistic forecasting conditions.
1. Meteorological Input Availability at Forecast Issuance
(1) Future GFS inputs.
- Original: For GDEX data before March 23, 2021, we used the daily 00 UTC GFS run with eight forecast lead times (+3, +6, ..., +24 h), linearly interpolated to hourly resolution. Subsequent data were obtained from Open-Meteo as continuous hourly GFS sequences. Both were aligned by valid time without explicitly enforcing forecast availability at each PV forecast origin.
- Additional evaluation: We additionally retrieved complete GFS forecast cycles and selected the latest available cycle satisfying among the downloaded forecasts, assuming a 6-hour publication delay. Each prediction window used a single forecast cycle without stitching.
(2) Historical weather inputs.
- Original: We used ERA5 as a unified historical weather source for cross-site pretraining, as continuous ground-based observations were difficult to obtain across globally distributed PV sites. To address its publication delay, we also explored satellite observations for ultra-short-term forecasting.
- Additional evaluation: Following the reviewer's concern, we further examined historical ERA5 availability by masking the most recent 6, 24, or 120 hours, or removing ERA5 entirely, and evaluated PVFM variants pretrained to handle missing historical weather inputs.
Due to time and download constraints, we selected a fixed subset of available GFS forecast cycles, covering 99 unseen sites and 14,214 windows across five tasks. All subsequent experiments used the same test windows and single-cycle GFS inputs.
2. Zero-Shot Performance Under Single-Cycle GFS Inputs
Finding-1. PVFM maintains its zero-shot advantage under single-cycle GFS inputs, even compared with full-shot models using the original GFS inputs.
We compared PVFM with iTransformer-TC (Full-shot) and CITRAS-FM (TSFM) under single-cycle GFS inputs. Despite using more realistic forecast-origin-constrained meteorological inputs, PVFM achieves lower MAE across all five tasks than both reference models. Notably, its five-task average MAE is 17.5% lower than that of iTransformer-TC evaluated with the original, valid-time-aligned GFS inputs, which provide more favorable meteorological information.
Table 2. Forecasting Performance under Original and Single-Cycle GFS Inputs. Original denotes valid-time-aligned GFS with complete historical ERA5; Single-cycle denotes forecast-origin-constrained GFS with historical ERA5 unchanged.
| Model | Future GFS | 1h 6h | 1h 24h | 1h 168h | 15min 4h | 15min 6h | Avg. MAE ↓ | Avg. CRPS ↓ |
|---|---|---|---|---|---|---|---|---|
| iTransformer-TC (Full-shot) | Original | 0.0575 | 0.0638 | 0.0800 | 0.0519 | 0.0511 | 0.0609 | 0.0535 |
| iTransformer-TC (Full-shot) | Single-cycle | 0.0575 | 0.0652 | 0.0830 | 0.0567 | 0.0533 | 0.0632 | 0.0554 |
| CITRAS-FM (TSFM) | Single-cycle | 0.0603 | 0.0794 | 0.0685 | 0.0858 | 0.0800 | 0.0748 | 0.0566 |
| PVFM | Single-cycle | 0.0495 | 0.0530 | 0.0563 | 0.0463 | 0.0460 | 0.0502 | 0.0363 |
Response to Reviewer 3Vem 3/3
W3 & Q2 (continued)
3. Zero-Shot Performance Under Historical Weather Availability Constraints
Finding-2. PVFM maintains its zero-shot advantage even when historical ERA5 data are partially or entirely unavailable.
We further examined the impact of historical weather availability while keeping single-cycle future GFS inputs, historical PV sequences, and test windows unchanged. Using the pretrained PVFM checkpoint, we masked the most recent 6, 24, or 120 hours of historical ERA5, as well as removing historical ERA5 entirely. We compared PVFM with pretrained TSFMs under the same conditions. The five-task average MAE results are presented below.
Table 3. Zero-Shot Performance under Historical Weather Availability Constraints.
| Historical weather | PVFM | Best TSFM |
|---|---|---|
| Complete ERA5 | 0.05023 | 0.07480 |
| Recent 6h missing | 0.05198 | 0.08664 |
| Recent 24h missing | 0.05825 | 0.07790 |
| Recent 120h missing | 0.06175 | 0.07747 |
| No historical ERA5 | 0.06471 | 0.07782 |
PVFM exhibits increasing errors as historical ERA5 becomes unavailable. Nevertheless, even without any historical ERA5, PVFM achieves 16.8% lower MAE than the best pretrained TSFM.
4. Adaptation to Operational Meteorological Data Availability through Post-Pretraining
To further improve PVFM's adaptability to practical forecasting conditions, we conducted 5,000 steps of post-pretraining starting from the pretrained PVFM checkpoint, using single-cycle GFS inputs from 457 seen sites. Historical ERA5 availability was varied during post-pretraining to accommodate different data availability conditions. Table 4. Impact of Post-Pretraining under Historical Weather Availability Constraints.
| Model | Complete ERA5 (MAE / CRPS) | No Historical ERA5 (MAE / CRPS) |
|---|---|---|
| PVFM | 0.05023 / 0.03629 | 0.06471 / 0.04687 |
| PVFM (Post5k) | 0.04918 / 0.03521 | 0.05170 / 0.03708 |
- Adaptation to missing historical weather. When historical ERA5 is entirely unavailable, post-pretraining reduces MAE and CRPS by 20.11% and 20.89%, respectively, compared with the original PVFM.
- Adaptation to single-cycle GFS. With complete historical ERA5, mask-based post-pretraining reduces the five-task average MAE and CRPS by 2.09% and 2.96%, respectively, with MAE reductions of 2.90%–4.72% across the three hourly forecasting tasks.
Conclusion. Our original pretraining strategy was designed to learn transferable Weather-to-Power relationships through large-scale cross-site training with relatively complete meteorological inputs. The additional experiments demonstrate that PVFM retains its zero-shot advantages under realistic GFS availability constraints and remains effective even when historical ERA5 is unavailable. Furthermore, post-pretraining further improves its performance under these conditions, demonstrating its potential for adaptation to practical PV forecasting scenarios.
Revision. We have clarified the original GFS data organization in Appendix A.2 and added further evaluations and post-pretraining experiments under more realistic operational conditions in Appendix C.5.
Response to Reviewer 3Vem 1/3
W1 & Q1: Does satellite imagery provide additional benefits beyond target-site adaptation?
Response. We thank the reviewer for this suggestion. To distinguish the contribution of satellite imagery from target-site adaptation, we conducted additional experiments comparing fine-tuning with and without satellite imagery. We used GFS forecasts selected according to their actual initialization times, ensuring that only meteorological forecasts available at the prediction origin were used. The results are presented below.
Table 1. Contribution of Satellite Imagery to PV Forecasting Performance. Both adaptation settings use the same pretrained checkpoint, target-site training labels, loss function, training budget, and evaluation windows.
Compared with PV+GFS fine-tuning without satellite imagery, satellite-image adaptation reduces MAE by 13.10% and RMSE by 9.67%, while improving R² by 3.20%.
These results demonstrate that satellite imagery can complement historical meteorological information by providing additional observations of local cloud conditions, thereby further improving short-term PV forecasting performance.
W2: Clarification of satellite results and pretrained checkpoint configurations
Response. We thank the reviewer for identifying these inconsistencies and requesting clarification of the model configurations. We have addressed these issues as follows.
1. Satellite results. We have updated the satellite fine-tuning results table to report the final results for fine-tuned PVFM: MAE = 0.0390, RMSE = 0.0839, and R² = 0.8642. These values are consistent with Fig. 6(c–d) and the 9.1% RMSE reduction reported in the abstract and Section 6.4.
2. Backbone configuration. We clarify that all PVFM variants in the satellite experiments use the same 3.88M-parameter backbone as the main experiments. We have corrected Table 5 to reflect the actual model configuration, with 4.503M total parameters including the satellite adapter.
3. Pretrained checkpoint configurations. We have revised the description and caption of the satellite fine-tuning results table to clarify the three PVFM configurations:
Revision. These changes have been incorporated into the revised manuscript, with the corrected parameter counts in Table 5 and further clarifications provided in Appendix C.4.2.