- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies micro-video popularity prediction from the perspective of information scale. Instead of directly fusing heterogeneous signals into a single predictor, the authors argue that different information sources contribute to predictability at different statistical scopes. Based on this view, they propose Scale-Structured Predictability Modeling (SSPM), which organizes prediction into three progressively refined stages: Context Prior Modeling, Multimodal Evidence Refinement, and Historical Analogy Refinement. Each stage is trained to explain the residual variation left unresolved by the previous stage, rather than independently fitting the full popularity target.
The framework is further formalized using a nested filtration over prediction-time information. Under squared loss, the corresponding scale-wise prediction increments are interpreted as orthogonal components of predictability, which provides the statistical motivation for the residual-learning formulation.
Empirically, SSPM is evaluated on SMPD, MicroLens, and Informs, where it consistently outperforms the strongest reported baseline across nMSE, MAE, and Spearman correlation. The paper also includes matched ablations and scale-wise attribution analyses to show that the gains arise from different information sources across datasets, with multimodal evidence dominating on SMPD and MicroLens, while contextual information contributes most strongly on Informs. Overall, the paper proposes a conceptually distinct way to formulate popularity prediction: rather than treating heterogeneous features as a single fused representation, it decomposes predictability according to the scale at which additional information becomes useful.
Critical strengths
-
The core idea is intuitive and conceptually well motivated.
I find the proposed information-scale perspective very natural and reasonable, and I do not have major conceptual concerns about the formulation. Modeling popularity prediction as a progressive refinement process—from contextual priors, to multimodal evidence, and finally to historical analogies—provides a clear interpretation of how heterogeneous information contributes to predictability. -
The overall design is elegant and internally coherent.
Rather than treating the three stages as independent predictors, the authors explicitly train each stage to model the unresolved residual left by the previous one. The use of cross-fitted residuals and residual-based historical retrieval is particularly thoughtful, as it helps prevent later stages from simply relearning information already captured at coarser scales. -
The experimental design provides meaningful support for the proposed principles.
The matched ablations compare one-shot prediction, full-target learning, removal of OOF construction, direct label retrieval, and alternative neighbor-selection strategies under controlled settings. These experiments make the empirical evidence substantially more convincing than a conventional component-removal ablation. -
The paper provides useful insight beyond simply improving SOTA performance.
The scale-wise attribution analysis reveals that different datasets rely on substantially different predictive sources—for example, multimodal evidence dominates on SMPD and MicroLens, whereas contextual information dominates on Informs. I find this analysis useful because it gives practitioners a clearer understanding of where predictive gains actually originate.
Overall, I find the proposed design thoughtful, coherent, and potentially useful beyond the specific popularity-prediction setting, particularly as a general way to organize heterogeneous information sources according to the additional variation they can explain.
I suggest that the authors consider citing and discussing the following two related works:
-
Lee et al., “Anchoring Trends: Mitigating Social Media Popularity Prediction Drift via Feature Clustering and Expansion,” ACM Multimedia 2025. This work studies feature clustering on SMPD to mitigate popularity prediction drift, which is relevant to the present paper’s discussion of structured information and different sources of predictability.
-
Hsu et al., “Revisiting Vision-Language Features Adaptation and Inconsistency for Social Media Popularity Prediction,” ACM Multimedia 2024. This work systematically analyzes how different vision-language features affect popularity prediction on SMPD, which is also closely related to the paper’s motivation that different information sources contribute differently to predictability.
Both papers provide relevant perspectives on how heterogeneous features and their structure influence popularity prediction, particularly on SMPD. I therefore believe that discussing them would help better position the proposed information-scale perspective with respect to closely related prior work.
Critical weaknesses
-
The main concern is the lack of sufficient clarity regarding data preprocessing and feature construction.
Social-media multimodal datasets are substantially more complicated than standard image or video benchmarks. Taking SMPD as an example, the raw information may involve user identity, post identity, geographic information, posting time, user statistics, images/videos, textual descriptions, post categories, interactions from other users, view statistics, follower/following counts, hashtags, and various categorical variables. Historical posts from the same user may also influence the popularity of a newly published post. A substantial body of prior work on SMPD has specifically investigated how these heterogeneous signals should be processed and integrated (e.g. HyFea). Although Appendix A.2 lists several major feature groups used by SSPM, such as the 175-dimensional base representation, text embeddings, metadata, and prior-history summaries, the paper does not provide enough detail about how these features are individually cleaned, encoded, normalized, and combined to make the experimental pipeline sufficiently transparent. This is my primary concern with the current submission. -
Reproducibility is particularly important for this task.
In the popularity-prediction literature, there have been cases where strong reported results were difficult to reproduce because code was unavailable, incomplete, or did not fully correspond to the reported experimental pipeline. This makes implementation transparency particularly important for the present work. The manuscript states that an anonymized code package will be released for review, but I would like the authors to clarify whether the complete preprocessing, feature construction, training, retrieval, and evaluation pipeline will be included, and whether they intend to publicly release the full code after publication. Given the complexity of the datasets, releasing only the core model implementation would not be sufficient for reliable reproduction. -
The construction of the multi-scale relationship is conceptually clear but operationally under-specified.
The paper clearly defines the hierarchy of Context Prior, Multimodal Evidence, and Historical Analogy at the methodological level, and explains that later stages learn cross-fitted unresolved targets. However, from an implementation perspective, it is still difficult to understand exactly how the heterogeneous features interact at each stage and how the cross-fitting pipeline is instantiated for each dataset. Figure 2 provides a useful conceptual overview, but it is not sufficient for reproduction by itself. 39798_Popularity_Predictabilit I strongly recommend providing a dataset-by-dataset description of the complete feature-processing pipeline, including the selected visual/text encoders, preprocessing and normalization procedures, categorical-feature handling, text cleaning, and how each feature is assigned to a particular information scale. This is especially important for SMPD, where multilingual text, emojis, hashtags, and noisy metadata can materially affect performance. -
The clustering component shown in the framework requires substantially more explanation.
The clustering or topic-grouping operation illustrated in Figure 2 is not described with enough detail for the reader to understand its exact construction, design rationale, or contribution. The authors should specify the clustering features, algorithm, number or selection of clusters, fitting protocol, whether clustering is constructed using training data only, and how the resulting groups enter the Context or subsequent prediction stages. I would also like to see an ablation or sensitivity analysis demonstrating how this clustering design affects the final prediction performance and scale-wise attribution. Without this information, it is difficult to determine whether the reported gains arise from the proposed scale-structured principle itself or from particular feature-engineering and grouping choices.
Questions for authors
Please provide a comprehensive response addressing all of the weaknesses and reproducibility concerns raised above.
8 comments
Thank you for the response, and sorry for the late reply. Overall, I am not yet satisfied with it. I would like the authors to clarify two points:
-
Encoder choice. Which visual/video encoder is used, e.g., CLIP (which variant) or a video encoder such as X-CLIP? Which text encoder is used? Are the same encoders used across all three datasets? If not, what is the rationale? The strength of the representation directly affects the Multimodal stage’s share, so this bears on the attribution claims, not only on reproducibility.
-
Feature scope. Why were broader features not considered, such as richer user statistics, audio, or VLM-generated descriptions? Do SSPM’s gains and attribution pattern still hold with stronger features?
Author Response to Reviewer st2j's Follow-up Questions
Thank you for your thoughtful and detailed follow-up. We sincerely appreciate your careful examination of our methodology and experimental design.
Q1. Encoder Choice and Fairness
We clarify that SSPM uses the same pretrained visual encoder, OpenAI CLIP ViT-L/14, across all three datasets. We do not use X-CLIP or different primary visual backbones across datasets.
(1) Consistent encoders. Our visual encoder follows the CLIP ViT-L/14 setting used in STAP (C4). For text, SMPD uses UAE-Large-V1, consistent with the UAE-Large encoder family reported by STAP. The frozen MicroLens and Informs pipelines do not introduce a separate pretrained text encoder.
(2) Fair comparisons. All matched SSPM controls within each dataset use the same encoder representations. The visual backbone is fixed. Only dataset-specific processing differs:
- SMPD: 100 frames, mean pooling, PCA32.
- MicroLens: 32 frames, mean pooling, PCA128.
- Informs: 100 frames, mean pooling, PCA64.
All PCA transformations are fitted on training data only. These differences reflect dataset-specific feature processing, not different pretrained visual encoders.
(3) Attribution validity. Since the encoders are fixed within each dataset, the improvements in our matched controls cannot be attributed to switching visual backbones.
SSPM measures held-out risk reductions under fixed representations. The attribution shares are configuration-dependent, rather than assumed to be invariant to representation strength.
We will explicitly document these encoder configurations and feature-processing details in the revised manuscript.
Q2. Feature Scope and Robustness
SSPM already includes pre-publication user-history statistics, temporal features, and topic-level priors on SMPD.
We further evaluated stronger video representations on MicroLens. We extended Historical retrieval from CLIP to CLIP + VideoMAE. Both settings use the same 1,974 validation samples, frozen Global predictions, OOF residual targets, and retrieval budget.
| Historical Features | MAE ↓ | nMSE ↓ | SRC ↑ |
|---|---|---|---|
| CLIP | 1.0144 | 0.6465 | 0.5870 |
| CLIP + VideoMAE | 1.0128 | 0.6435 | 0.5897 |
The richer representation improves all three metrics. With residual clipping, our final configuration reaches an nMSE of 0.6431. Historical refinement reduces MSE by 0.0400 over the frozen Global prefix (95% bootstrap CI [0.0213, 0.0592]).
Richer features may further improve prediction, but SSPM's distinct contribution lies in scale-wise residual learning and held-out risk attribution, rather than any specific feature combination.
Our attribution measures held-out risk reductions under each feature configuration. It therefore captures changes in predictive contributions rather than assuming fixed attribution percentages.
We will clarify the feature scope and add this controlled comparison to the appendix.
Author Response to st2J
Thank you for the constructive feedback and references. Both recommended works are excellent and highly relevant to our study. We will discuss Lee et al. (2025) and Hsu et al. (2024) and clarify how SSPM differs from feature clustering and vision-language feature adaptation.
Re: SSPM uses fixed feature representations across stages and matched controls; differences come from residual targets and information access, not stage-specific preprocessing.
Train-fitted transformations are applied unchanged to validation and test data. We will provide dataset-specific feature definitions and processing details in the appendix.
Re: We will release the complete cross-fitted pipeline:
This supports reproduction beyond the core model implementation.
Re: The stages are connected by OOF residual targets, not unrestricted feature fusion:
Earlier predictors remain frozen during later refinement. SMPD and Informs use chronological OOF construction; MicroLens uses its declared fold protocol. This separates stage-specific inputs and measures each refinement through held-out prefix-risk reduction.
Re: Clustering builds dynamic topic-level priors for Context; it is not an independent predictor.
This shows that topic-derived features improve the Context prefix without increasing model capacity. We will clarify the grouping mechanism in Figure 2 and the appendix.