- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FoRE, a local feature re-encoding method for frozen vision backbones. Through label-free distillation, it trains a lightweight modulator to predict the features that the backbone would produce by re-encoding a local region, given the global feature map, a point query specifying location and scale, and the corresponding crop of the global view. This reduces the cost of repeatedly running the backbone. Extensive experiments across datasets, backbones, and downstream readouts show that FoRE outperforms the evaluated feature upsampling methods under in-context matching and surpasses the teacher on some readouts. The paper further explains the student–teacher performance reversal through variance reduction and the internal averaging performed by the readouts.
Critical strengths
1、The paper addresses an important problem, and the method is well motivated. FoRE provides frozen vision backbones with an interface for querying local high-resolution features by location and scale, offering clear practical value.
2、The experimental evaluation is broad. The authors evaluate the method across multiple domains, datasets, readouts, and backbones, and compare it with several feature upsampling baselines, strengthening the credibility of the conclusions.
Critical weaknesses
1、The evaluation primarily follows a crop-grid protocol and scores only positions within the query support. It remains unclear whether FoRE would retain its advantages on standard pixel-level tasks and within complete downstream pipelines.
2、What specific assumptions are required for the “averaging law” to hold? Could the authors distinguish rigorously provable conclusions from explanations based on empirical observations?
3、The paper attributes the performance gains to the re-encoding distillation target. However, the experiments also change the architecture and training procedure, without a controlled comparison that holds the architecture fixed and varies only the supervision target. How can the sources of the performance gains be distinguished?
Questions for authors
See Weaknesses