- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes Fisher-Spectral Adaptation (FiSA), a supervised query adaptation method for dense retrieval. FiSA consists of three components: (1) query-dependent coordinate reweighting, (2) a local Fisher-Spectral correction based on the initially retrieved documents, and (3) a confidence gate that controls the query update. The adapted query is then used for a second full-corpus retrieval, while the document embeddings and index remain unchanged.
Experiments are conducted on four BEIR datasets using five frozen embedding models. The results show significant improvements over several baselines.
Critical strengths
- Promising in-domain experimental results. FiSA achieves strong improvements on several datasets, especially in-domain ones. The method is evaluated with five different embedding models, showing that it can be applied to different frozen retrievers.
Critical weaknesses
-
Query-local PCA basis seems to be not siginificantly better than global PCA bases. A central motivation of this paper is that a query-specific local coordinate system can better capture relevance than a global coordinate system. However, the ablation results in Table 4 show that replacing the query-local PCA basis with a global PCA basis only reduces average nDCG@10 from 45.93 to 45.79.
-
Much of the improvement comes from supervised coordinate reweighting, rather than the Fisher-Spectral correction. According to Table 4, the Dimension Only variant already achieves 44.79 macro nDCG@10, compared with 45.93 for the full FiSA model. This suggests that a large portion of the improvement comes from supervised query embedding adaptation.
-
The Fisher-Spectral component uses learned positive and negative attention distributions trained with relevance labels. A natural baseline would be to use these same attention distributions to compute positive and negative document centroids, and directly update the query using a Rocchio-style correction. This would help isolate the contribution of the Fisher-Spectral computation from that of learned relevance feedback.
-
The improvements are concentrated on in-domain datasets, and cross-domain generalization remains limited. FiSA is trained on NFCorpus, SciFact, and FiQA, and evaluated on the test sets of these three datasets and one unseen dataset, ArguAna. Compared with ECLIPSE-PRF, FiSA improves average nDCG@10 by 12.04 points on SciFact, but only 1.58 and 1.41 points on NFCorpus and FiQA, respectively. This suggests that the overall improvement of 3.63 points is largely driven by SciFact. On the only unseen dataset, ArguAna, FiSA underperforms ECLIPSE-PRF on four out of five encoders. This raises concerns about the generalization ability of the learned query adaptation mechanism.
-
Missing end-to-end efficiency comparison. FiSA requires an additional full-corpus retrieval, a per-query eigendecomposition, and several neural network modules. The additional inference cost is not fully evaluated and compared.
Questions for authors
- Can the authors compare FiSA with a supervised Rocchio-style method using the same learned positive and negative attention distributions? This would help clarify the contribution of the Fisher-Spectral correction.
With the submitted model’s learned attention held fixed, Fisher minus centroid is −0.083 points under the original first pass and +0.253 under the filtered first pass. The revised closed-form method gains 0.344 points over its matched centroid. We also report transfer results and end-to-end latency.
Response to Reviewer M5eo
Thank you for proposing the same-attention centroid comparison. We ran that intervention on the submitted neural model and added the corresponding matched-input control for the revised closed-form formulation. The revision removes neural adapter training and uses two fixed linear maps fitted offline on source relevance labels.
1. Same learned attention, centroid update
We use the original BGE-base checkpoint with seed 2025. For each first-pass protocol, the Fisher and centroid arms share the checkpoint, candidates, and learned positive and negative attention. The centroid direction uses the difference between the two attention-weighted document means.
Scores are nDCG@10 points. The direction effect changes sign across the two first-pass protocols in this single-checkpoint replay.
For the revised method, the matched centroid shares both source-fitted maps, the initial candidates, positive and negative feedback weights, and step 0.35. Across all 30 encoder–collection pairs, closed-form FiSA scores 56.433 versus 56.089, a difference of +0.344 [0.213, 0.477]. With an independently step-tuned centroid, the difference is +0.190 [0.090, 0.295] (Figure 3, Table A4).
2. Attribution to local geometry and calibration
In the submitted model, the local/global basis comparison is +0.149 [−0.029, 0.327], and Dimension Only already scores 44.788 versus 45.935 for the full model. In the revision, removing the initial map costs 1.639 points and removing lexical feedback costs 1.439 in separate ablations. The matched comparison above measures the smaller increment due to the Fisher direction with those inputs held fixed. The revised method computes it by a regularized candidate-space solve and removes the learned spectral controller and eigendecomposition (Section 3, Table A4).
3. Transfer beyond SciFact
We added SciDocs and Quora as evaluation-only collections alongside ArguAna. Closed-form FiSA exceeds ECLIPSE-PRF in 14/15 encoder–collection comparisons across those three domains, with means of 56.644 and 55.313. Excluding SciFact from the average gives 50.821 versus 49.062. On ArguAna, FiSA exceeds ECLIPSE-PRF for four encoders and Raw Dense for one. This difference makes the encoder-level table particularly relevant (Table 1, Table A3).
4. End-to-end cost and presentation
We measured tokenization through final Top 1000 on the same BGE-base CPU setup with two threads, batch size one, and 100 queries per collection repeated three times. The timer includes both FiSA searches. FiSA P50/P95 is 13.85/18.61 ms on SciFact and 33.47/39.99 ms on Quora, versus 13.46/18.44 ms and 32.35/35.93 ms for ECLIPSE-PRF. All four methods are reported on six collections in Table A10 and Figure 4. These measurements apply to the revised method. We also rewrote Section 3 in execution order and moved the derivation and numerical details to Appendix A.