- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies autoregressive prediction of information cascades: given users who have already participated and a social graph, predict the next participants. Standard next-participant training uses ground-truth historical prefixes, which will cause a distribution mismatch since inference is conditioned on imperfect model predictions.
FutureWay addresses this mismatch by generating student rollouts and constructing corrective training examples. The earliest historical participant missing from a generated history becomes the corrective label. Later recorded participants provide privileged inputs to teachers with different look-ahead horizons. Their predictions are adaptively combined and distilled into the student through prediction and representation losses. Experiments on Twitter, Weibo, and Quora show improvements in future-participant coverage and order-sensitive trajectory recovery.
Critical strengths
-
The paper studies a fundamental problem of error accumulation in social opinion diffusion.
-
The experiments are validated on real social network data and show improvements by mitigating the distribution mismatch between training and test time.
Critical weaknesses
-
The following claim seems not true: “Second, treating multiple future participants as positive targets encourages coverage of future participants rather than discrimination of the exact next participant.” If the model can perfectly learn , it should be able to predict the exact next participant. Cascade data contain temporal order that can be preserved through ordered multi-step supervision.
-
The term “guidance” is a bit misleading. The paper also does not properly define what guidance means in social network opinion diffusion. If I understand correctly, it is nothing other than teacher-provided training supervision. However, the term can be confused with the guidance used in diffusion models.
-
The last paragraph of the introduction is difficult to follow because so much abstract jargon is introduced, including “recorded futures,” the sudden appearance of a teacher–student model paradigm, “representation-aware on-policy self-distillation,” and so on.
-
The proposed idea is clever and starts from a good motivation to solve the mismatch between training and testing conditions, but the writing makes it hard for the audience to follow. I think a simple figure or a toy example demonstrating the method would make it clear enough.
-
The motivation for why we need a teacher model is unclear. Why can't we directly minimize $ \mathcal{L} = -\log p_\theta(C \mid \hat C, G)$ to learn the correct answer? The paper provides an ablation study on this, but the gains from using a teacher seem marginal.
Questions for authors
-
Can the authors provide some intuition for why the NLL does not decrease when guidance from a longer horizon is provided, given that one would expect more information to be introduced? Is it dataset-related?
-
In the experiments, “each dataset uses a fixed TEST cohort containing sufficient future participants for its largest horizon.” Does this mean we need to know the complete historical cascades to apply this algorithm? In reality, forecasting has no fixed horizon. Is the algorithm still applicable?