- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how to select news for time-series forecasting based on predictive usefulness rather than semantic relevance alone. An offline reinforcement learning selector chooses whether to keep, drop, or summarize each article, using forecasting-loss improvement as feedback. A reflection mechanism stores verified action corrections from historical examples and retrieves them to inform later selection. The approach is evaluated on electricity demand, AUD/USD, and Bitcoin, with comparisons among offline RL algorithms, fixed-forecaster context interventions, and a larger electricity experiment. The theoretical appendix reviews conservative policy-evaluation guarantees under idealized CQL assumptions.
Critical strengths
The distinction between relevant news and useful news is worth studying. Learning from downstream forecasting feedback gives the selection problem a concrete objective, and allowing the selector to discard news is sensible when external context adds noise.
Table 3 is an important experiment. Holding the forecaster fixed while changing the supplied context addresses a real confound in the end-to-end comparison. It provides evidence that selection itself can affect forecast quality. I also appreciate that the appendix reports cases where reflection does not help, rather than presenting only favorable examples.
Critical weaknesses
The experiments do not yet establish the benefit of offline RL over a simpler forecasting-utility selector. Comparing DQN, BCQ, and CQL mostly distinguishes RL algorithms; it does not show why supervised utility scoring or a budget-matched greedy selector is insufficient. Appendix B explicitly analyzes idealized CQL policy evaluation, so its guarantees do not resolve this empirical question. The closely related work "From Long News to Accurate Forecast: Importance-Aware Fusion and PRM-Guided Reflection for Time Series Forecasting" [1] also deserves discussion: it learns news compression and selection from forecasting feedback, which makes the incremental role of CQL and correction memory especially important to establish.
The evidence for reflection and the source of the end-to-end gains remain mixed. Table 8 reports zero selected news for the electricity CQL configuration, although Table 2 shows an improvement over No News; this cannot be attributed to supplying more useful news without accounting for differences in forecaster training. In the fixed-forecaster Bitcoin comparison in Table 3, CQL obtains RMSE 5.123, versus 5.233 and 5.230 for the reflection variants, in the table's units. Neither reflection variant improves the larger electricity result in Table 10. These outcomes need not invalidate the approach, but they limit the evidence for reflection as a reliable additional contribution. The financial test sets contain only 50 forecast origins each (Table 4), with no uncertainty estimates to assess the smaller differences.
[1] Liu, M., Kang, Q., Wang, Y., Kai, S., Liang, K., Zhen, H. L., ... & Song, L. (2026). From Long News to Accurate Forecast: Importance-Aware Fusion and PRM-Guided Reflection for Time Series Forecasting. arXiv preprint arXiv:2606.03097.
Questions for authors
-
Could you clarify exactly how the CQL and No News forecasters differ in training, particularly for the zero-news electricity result? Which improvements can be attributed to context selection, and which depend on adapting the forecaster?
-
What evidence distinguishes the proposed selector from a simpler utility-trained ranking or greedy selection method under the same news and forecasting budgets? Please also clarify the methodological difference from the related forecast-utility and PRM-based work noted above.
-
Can you quantify uncertainty in the paired financial results, accounting for temporal dependence, and explain when reflection helps beyond the base selector? The fixed-forecaster and larger-electricity results seem especially useful for answering the latter question.