- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
A self-supervised learning framework that accumulates causal memory through continuous local observation and predicts features at any position and scale. Experiments show that a longer observation history can reduce prediction errors, and the label-free exploration strategy based on prediction errors can also effectively optimize information acquisition. However, the strategy with the minimum prediction error does not always have the best classification performance, which indicates that the prediction and recognition tasks require different search strategies.
Critical strengths
1.The overall idea of the paper is relatively easy to understand. The model views the image block by block and predicts the scene it will see based on what it has seen and the next move. Figure 1 compares it side by side with existing methods, clearly illustrating the differences between it and the existing methods.
2.The overall content of the paper is rich, and the appendix also provides a large number of supplementary experiments and details. These supplements provide more comprehensive support for the conclusion of the paper.
Critical weaknesses
1.This experiment does not reflect the value of the core concept. The pre-training of random walk on 256x256 images leads to a large number of repeated visits to previously seen areas (with coverage increasing from 21% in 64 steps to 98% in 1024 steps). “Predicting the next patch” is not about guessing unknown areas, but simply recalling. It is not sufficient to prove the spatial reasoning ability claimed by the paper.
2.The performance is extremely low. The linear probing accuracy of CCPL on ImageNet is only about 20%, and that of a two-layer MLP is less than 40%, lagging far behind mainstream self-supervised methods such as MAE. Although there are differences in the evaluation protocols, such huge differences make us doubt the actual value of the learned features.
3.The purpose of random walk scanning is unclear. This paper does not discuss its advantages over fixed sequences (raster, spiral, etc.) or scanning methods with fewer repeated visits. Have the model and the explorer learned a reasonable and interpretable sequence of observations?
Questions for authors
Can it be distinguished whether the model's prediction is inferring unknown areas or recalling previously seen content, and can its recognition performance be compared with methods such as MAE under the same protocol? Furthermore, what are the purposes and advantages of random walk scanning, and has the model learned a reasonable viewing sequence?