- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes TAILCAST, a post-hoc layer model that is capable of predicting tail quantiles beyond the pre-trained quantile levels. TAILCAST can actively recalibrate its predictions when the true values of previous predictions are observed. Experiments with 12 baselines and four foundation models show that TailCast achieves the lowest tail-weighted pinball loss on both benchmark groups.
Critical strengths
- Extensive experiments are performed, comparing against 12 baseline across different scenarios
- Ablation study is provided to justify the model design
Critical weaknesses
-
It is very difficult to follow the presentation. The descriptions are unclear. Terms appear before they are defined, and some never are, among other issues.
-
I tried to follow and understand the paper, but it is likely I misunderstood the content due to the unclear presentation
-
In table 3, it seems that the gain is mostly on using Chronos-2 as the base model. The gains for other base models are modest. Could the authors comment on the reason?
-
Results reported in table 1 averaged over different experimental scenarios: no shift, level shift, and scale shift. To understand the model's performance better, it would be better to separate the scenarios to see where the gains mostly come from.
-
The experiments used on context length 128, which seems to be on the shorter end. However, the base models support a context length beyond that. Experimenting with longer context lengths could strengthen the paper. Right now, it is unclear whether the performance gain is because the base model did not observe enough context to make an accurate prediction, leaving more errors for TAILCAST to correct.
Questions for authors
See weakensses