- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper identifies a fractal structure in the low-energy frequency components often overlooked by MSE-based forecasting and then proposes FractalLoss to preserve this structure during training. Experiments on seven datasets and five backbones show improvements in forecasting accuracy over baselines.
Critical strengths
This paper is well motivated and aims to solve an important problem.
FractalLoss can be applied to different forecasting models.
Critical weaknesses
FractalLoss uses a fitted straight line as the goal for all background elements. But deviations from this line may contain useful information. The paper does not discuss how this assumption might affect the predictions.
This paper emphasizes the problem of over-smoothed predictions, but it fails to show how FractalLoss can help recover local changes.
Questions for authors
Table 3 shows some comparisons against direct spectral matching. How about directly matching the log-energy of background components without fitting a fractal line?
Can FractalLoss improve forecasting performance on samples where the background spectrum does not fit a straight line particularly well?
Can you provide some quantitative results showing how well FractalLoss captures local fluctuations or sudden changes?
2 comments
Part 2/2
W1 & Q2: Performance on samples where the background spectrum does not fit a straight line particularly well
Thank you for the insightful feedback. Within each dataset, we ranked test samples by the of the fractal line fit and evaluated the bottom 10% ones, the results are shown in Table R2-1.
- FractalLoss still improves forecasting performance on these samples with relatively weak fractal structure. Compared with MSE Loss, adding FractalLoss reduces forecasting MSE by 0.55% to 3.74% across the five datasets.
- The gains are smaller when the fitting is lower. Among the bottom-10% subsets, FractalLoss reduces MSE by only 0.55%–0.92% on Weather and Electricity, which have the lowest , but by 3.74% on Exchange, which has the highest . This phenomenon is consistent with the conclusion from Table R1-3: deviations from the fitted line are difficult to predict given history, so matching the line may offer less benefit when the deviations account for a larger share (lower fitting ).
Table R2-1. Forecasting MSE () with and without FractalLoss on the 10% test samples with the lowest . The forecasting horizon is 96.
\hline \text{Dataset} & \text{Samples} & R^2\text{ Range} & \text{w/o FractalLoss} & \text{w/ FractalLoss} \cr \hline \text{ETTh2} & 279 & [0.785, 0.792] & 0.325 & \mathbf{0.314} \cr \text{ETTm2} & 1143 & [0.803, 0.841] & 0.276 & \mathbf{0.268} \cr \text{Weather} & 1045 & [0.674, 0.708] & 0.201 & \mathbf{0.200} \cr \text{Electricity} & 517 & [0.609, 0.722] & 0.183 & \mathbf{0.181} \cr \text{Exchange} & 143 & [0.814, 0.863] & 1.202 & \mathbf{1.157} \cr \hline \end{matrix}$$ # W2 & Q3: Quantitative results for local fluctuations Thank you for the comment, we have introduced two additional metrics to describe local fluctuations or sudden change, the results are shown in **Table R2-2.** - **First-order difference MAE**: This metric measures the direction and magnitude of changes between consecutive time steps. Existing work [1-2] use it to capture local fluctuations in time series. For a forecast $\hat{y}$ and target $y$ over a horizon of $H$ steps, we compute: $$\frac{1}{H-1}\sum_{t=1}^{H-1} \left|(\hat{y}_{t+1}-\hat{y}_t)-(y_{t+1}-y_t)\right|.$$ > [1] TDT Loss Takes It All: Integrating Temporal Dependencies among Targets into Non-Autoregressive Time Series Forecasting. Xiong et al., 2024. > [2] LETS Forecast: Learning Embedology for Time Series Forecasting. Majeedi et al., 2025. - **Ramp Score**: It captures the direction and steepness of local rises and falls. Prior studies [3-4] use it to evaluate sudden changes. For a forecast $\hat{y}$ and target $y$ over a horizon of $H$ steps, let $s_t(x)$ denote the slope over $[t,t+1]$ in the piecewise-linear approximation, we compute: $$\frac{1}{H-1}\sum_{t=1}^{H-1} \left|s_t(\hat{y})-s_t(y)\right|.$$ > [3] Shape and Time Distortion Loss for Training Deep Time Series Forecasting Models. Le Guen and Thome, 2019. > [4] All sky imaging-based short-term solar irradiance forecasting with Long Short-Term Memory networks. Hendrikx et al., 2024. - **FractalLoss recovers local fluctuations better than MSE-only training.** As shown in **Table R2-2**, adding FractalLoss lowers first-order difference MAE in all 10 dataset–backbone combinations and Ramp Score in 9 of 10, suggesting that it **alleviates over-smoothing prediction.** **Table R2-2.** Ramp Score and first-order difference MAE (both $\downarrow$) with and without FractalLoss. The results are averaged across horizons ${96, 192, 336, 720}$. $$\begin{matrix} \hline \text{Backbone} & \text{Metric} & \text{Training loss} & \text{ETTh2} & \text{ETTm2} & \text{Weather} & \text{Electricity} & \text{Exchange} \cr \hline \text{Fredformer} & \text{Ramp Score}\downarrow & \text{MSE} & 0.212 & 0.191 & 0.091 & \mathbf{0.147} & 0.136 \cr & & \text{+FractalLoss} & \mathbf{0.208} & \mathbf{0.187} & \mathbf{0.088} & 0.148 & \mathbf{0.125} \cr & \text{First-order difference MAE}\downarrow & \text{MSE} & 0.168 & 0.101 & 0.082 & 0.149 & 0.158 \cr & & \text{+FractalLoss} & \mathbf{0.164} & \mathbf{0.097} & \mathbf{0.074} & \mathbf{0.144} & \mathbf{0.143} \cr \hline \text{DLinear} & \text{Ramp Score}\downarrow & \text{MSE} & 0.259 & 0.189 & 0.087 & 0.144 & 0.123 \cr & & \text{+FractalLoss} & \mathbf{0.256} & \mathbf{0.183} & \mathbf{0.085} & \mathbf{0.140} & \mathbf{0.119} \cr & \text{First-order difference MAE}\downarrow & \text{MSE} & 0.162 & 0.095 & 0.078 & 0.143 & 0.144 \cr & & \text{+FractalLoss} & \mathbf{0.159} & \mathbf{0.090} & \mathbf{0.073} & \mathbf{0.140} & \mathbf{0.131} \cr \hline \end{matrix}$$
Part 1/2
We apologize for the delay in submitting our rebuttal due to health issues. Thank Reviewer vjxe for the constructive feedback and helpful suggestions. Below, we address each concern and question in turn and welcome any further questions.
W1 & Q1: Effect of deviations from the fitted fractal line on predictions.
FractalLoss outperforms direct log-energy matching (denoted as FractalLoss∗). We compare the two objectives in Tables R1-1 and R1-2, FractalLoss consistently achieves lower MSE and MAE and substantially lower FSE and FFE, indicating that preserving the fractal structure of background components provides additional benefits beyond log transformation. We have updated Table 3 and Section 5.3 (line 432-434) of the manuscript accordingly.
Deviations from the fitted line are difficult to predict from historical observations. To better understand the performance gap between FractalLoss and FractalLoss∗, we investigate whether log-energy deviations can be predicted given historical observations. Specifically, we compare the history-conditioned Predictor (Fredformer) with two simple baselines that DO NOT use historical observations: (1) Zero, which always predicts zero, and (2) Mean, which predicts the training-set mean deviation at each frequency. As shown in Table R1-3, the predictor performs worst across 5 datasets, suggesting the deviations are difficult to predict given history. Zero consistently performs best, further supporting the rationale for matching the fractal line.
Table R1-1. MSE, MAE, FSE, and FFE (all ↓) comparison between FractalLoss∗ and FractalLoss using DLinear backbone. The results are averaged across horizons 96,192,336,720.
\hline \text{Metric} & \text{MSE} && \text{MAE} && \text{FSE} && \text{FFE} & \cr \text{Dataset} & \text{FractalLoss}^{\ast} & \text{FractalLoss} & \text{FractalLoss}^{\ast} & \text{FractalLoss} & \text{FractalLoss}^{\ast} & \text{FractalLoss} & \text{FractalLoss}^{\ast} & \text{FractalLoss} \cr \hline \text{ETTh2} & 0.428 & \mathbf{0.424} & 0.438 & \mathbf{0.428} & 0.268 & \mathbf{0.059} & 0.236 & \mathbf{0.060} \cr \text{ETTm2} & 0.336 & \mathbf{0.335} & 0.378 & \mathbf{0.371} & 0.245 & \mathbf{0.175} & 0.145 & \mathbf{0.020} \cr \text{Weather} & 0.265 & \mathbf{0.263} & 0.275 & \mathbf{0.266} & 0.248 & \mathbf{0.088} & 0.187 & \mathbf{0.069} \cr \text{Electricity} & 0.210 & \mathbf{0.191} & 0.290 & \mathbf{0.266} & 0.203 & \mathbf{0.048} & 0.133 & \mathbf{0.056} \cr \text{Exchange} & 0.337 & \mathbf{0.335} & 0.403 & \mathbf{0.402} & 0.238 & \mathbf{0.115} & 0.342 & \mathbf{0.316} \cr \hline \end{matrix}$$ **Table R1-2.** MSE, MAE, FSE, and FFE (all $\downarrow$) comparison between $\text{FractalLoss}^{*}$ and FractalLoss using **Fredformer** backbone. The results are averaged across horizons ${96, 192, 336, 720}$. $$\begin{matrix} \hline \text{Metric} & \text{MSE} && \text{MAE} && \text{FSE} && \text{FFE} & \cr \text{Dataset} & \text{FractalLoss}^{\ast} & \text{FractalLoss} & \text{FractalLoss}^{\ast} & \text{FractalLoss} & \text{FractalLoss}^{\ast} & \text{FractalLoss} & \text{FractalLoss}^{\ast} & \text{FractalLoss} \cr \hline \text{ETTh2} & 0.364 & \mathbf{0.362} & 0.399 & \mathbf{0.390} & 0.096 & \mathbf{0.060} & 0.125 & \mathbf{0.049} \cr \text{ETTm2} & 0.283 & \mathbf{0.276} & 0.321 & \mathbf{0.319} & 0.301 & \mathbf{0.160} & 0.213 & \mathbf{0.127} \cr \text{Weather} & 0.247 & \mathbf{0.245} & 0.275 & \mathbf{0.273} & 0.138 & \mathbf{0.051} & 0.145 & \mathbf{0.096} \cr \text{Electricity} & 0.177 & \mathbf{0.176} & 0.279 & \mathbf{0.274} & 0.125 & \mathbf{0.100} & 0.095 & \mathbf{0.079} \cr \text{Exchange} & 0.349 & \mathbf{0.343} & 0.396 & \mathbf{0.395} & 0.129 & \mathbf{0.087} & 0.114 & \mathbf{0.028} \cr \hline \end{matrix}$$ **Table R1-3.** log-energy deviation MAE $\downarrow$ comparison between the history-conditioned predictor and two history-independent baselines on 96 forecasting horizon. $$\begin{matrix} \hline \text{Method} & \text{ETTh2} & \text{ETTm2} & \text{Weather} & \text{Electricity} & \text{Exchange} \\\\ \hline \text{Zero} & \mathbf{1.544} & \mathbf{1.476} & \mathbf{1.529} & \mathbf{1.585} & \mathbf{1.092} \\\\ \text{Mean} & 1.596 & 1.529 & 1.546 & 1.613 & 1.152 \\\\ \text{Predictor} & 1.660 & 1.645 & 1.707 & 1.716 & 1.318 \\\\ \hline \end{matrix}$$