- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Budgeted Neighborhood Preservation (BNP), which learns sparse multimodal representations under limited posting budgets. It combines sparse autoencoding, neighborhood distillation, posting-cost control, and a budget-aware reachability loss. Experiments on various benchmarks and multiple backbones show consistent improvements in neighborhood coverage.
Critical strengths
1. Meaningful motivation. The main innovation is the reachability loss, which explicitly encourages sparse representations to preserve dense-teacher neighbors under limited posting budgets, rather than simply preserving similarity scores or minimizing retrieval cost.
2. Solid experiments. The evaluation includes multiple benchmarks, backbones, retrieval budgets, and ablations, with additional analysis of traversal policies and million-item retrieval.
Critical weaknesses
1. Poor presentation. The paper could be better organized and presented. In particular, Figure 1 does not clearly highlight the main innovation in the sparse training stage. Several tables are poorly formatted and difficult to read. The reference list is also rather limited, with important citations for the backbones and datasets missing. I encourage the authors to improve the overall presentation.
2. Incremental novelty and limited ranking improvements. The method builds heavily on existing sparse autoencoding and retrieval-aware training approaches such as PUMA, with the reachability loss being the main new component. While BNP improves neighborhood coverage, the gains over the strongest baseline are relatively small, and final nDCG even decreases on three of the five benchmarks. This limits the significance of the improvements in practical retrieval quality.
Questions for authors
1. Baseline implementation. Could the authors provide more details on how the baselines, especially PUMA-A and PUMA-A+FLOPS. The training configurations are unclear, including the training datasets, batch size, and other hyperparameters.
2. Loss ablation. Could the authors provide a more systematic ablation study of each loss term in the overall training objective,? This would help clarify the contribution of each loss, especially the proposed L_reach.
3. Broader benchmarks. The evaluation mainly focuses on traditional image retrieval benchmarks. Could the authors evaluate BNP on a broader and more recent multimodal retrieval benchmark, such as MMEB v2, to further demonstrate its generalization?