- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper addresses counterfactual values in renewable generation data. These are values that the TSO estimates from weather or similar inputs but that are not actually measured, because the real values are curtailed. The authors study how to benchmark models despite these values, distinguishing between censored and uncensored data. To this end, they compare several models that estimate the available generation from the observed actual generation . The main part of the paper is the evaluation across the two data regimes, censored and uncensored of different models.
Critical strengths
- The topic is highly relevant for transmission system operators and difficult to tackle.
Critical weaknesses
-
Overall: there are no structuring sentences that guide the reader through the paper. The paper is hard, if not impossible, to read. Here are a few examples: The abstract is too long and not understandable. It gives neither a clear introduction to the data and the method nor to the results and the contribution. The introduction needs major revision in terms of fluency and clarity. Figure 1 is referenced in Section 5. No clear contributions can be inferred from this introduction. Point out what your major claims are and what your methodological contribution is. The contributions need to be clearer. Less is more in this case: one detailed and sharp sentence, not a lurid AI headline. Related Work: there is no clear narrative that can be followed, and no clear derivation of your novelty claim. At this point I resigned trying to understand the paper in further detail.
-
The methodology is spread everywhere. The method is described partly in the appendix. The reader has to search the appendix and the main text for each candidate to find out what it means, which makes the paper very hard to follow. A complete, detailed description of every method, fitting strategy, floor strategy and input strategy should be in the main part of the paper.
I recommend defining every compared model in the main text, ideally in one dedicated subsection that Table 3 refers to directly.
Based on my reading, this subsection should cover the following (this is my understanding of your methodology, which could also be wrong):
Models:
- Structured decomposition: I suggest calling it the structured decomposition estimator, so that it is clear that it is an estimator. Please define it formally. Please state which inputs go in and which outputs come out, with their dimensions.
- Ratio estimator: I could only infer how it is computed from Figure 1 and the surrounding text. Please define it formally. Please state which inputs go in and which outputs come out, with their dimensions.
Three fitting configurations:
- quantile,
- least squares,
- fitting this model directly on .
Please describe each of them explicitly and state how they differ.
Inputs:
-
weather (which variables, e.g., wind speed or solar irradiance, and where do they come from?),
-
grid state (please describe it in detail),
-
,
-
.
I would like to know the exact size of each of them. What is the size of the input to the model?
It is possible, that this paper and its topic is interesting for energy community. However, it suffers methodological a lot in clearance of description and in narrative, therefore the merit here is a clear reject, as these major problems avoid sufficent evaluation of technical and methodological content.
Questions for authors
- Is there a second model besides the GRU system, I understand the ratio method more or less as a benchline?
- Related Work: Forecasting/nowcasting? Benchmarking with counterfactuals? Evaluating counterfactuals? Replacing censored data and inferring them?
- Related Work , Appendix A: Minor remark: Is the claim search an LLM prompt? This is not the same as a real search of the literature of a scientific community (Appendix A, which also contains typos and arXiv artefacts).
- Methodology, Inputs: Which weather variables do you use (e.g., wind speed or solar irradiance), and where do they come from?
- Methodology, Inputs: What is the size of the input to the model?
- Data split: When does the data end, and how many days does the evaluation span? Is a whole year covered, so that the yearly seasonality is captured?