- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Independent Channel Mixture (ICM), a method for refining frozen query embeddings using noisy ternary comparisons, without retraining the encoder or accessing the retrieval gallery.
Critical strengths
- The paper provides explicit derivations for the mathematical formulation and theoretical evidence.
- The evaluation is extensive, covering multiple datasets and pretrained embedding models across multiple modals
Critical weaknesses
The ablation studies are insufficient: the contributions of query-local response mixtures and geometry-scaled delivery are not evaluated independently. Variants that use each response model alone and a variant that replaces geometry-scaled delivery with a fixed update scale can provide more direct evidence of each component’s contribution.
Questions for authors
See weaknesses
3 comments
Thanks for your response, I will keep my score.
Thank you for the discussion and for suggesting the single-channel and fixed-scale comparisons. They helped us show more clearly what the response mixture and query-dependent update scale each contribute.
Thank you for the careful review and for identifying the missing component comparisons. We have added the single-channel and fixed-scale controls you requested in Appendix E.2, "Repeated component ablations" (Table 10).
The study covers 36 historical dataset-representation combinations across eight families, and a separate confirmation panel comprising two representations on each of three disjoint cohorts in four families. Both panels use budgets B∈{8,32,128} and informative noises η∈{0,0.2,0.4}. The pure-noise results are reported separately further.
For the response mixture, we added logistic-only and indifference-only policies. The selected link is used throughout inference, acquisition, and evidence calculation, so these controls evaluate the resulting complete single-channel policies. We also added uniform weights, fixing the two acquisition and delivery weights at one half while retaining proper mixture evidence for the gate.
For geometry-scaled delivery, we replace the query-dependent coefficient with each of three constants, α∈{0.10,0.25,1.00}. These variants share the full method's paid transcript, inferred tangent vector, and final gate decision. Their differences therefore isolate delivery scaling without changes to acquisition, inference, or gate release.
ICM's mean relative hierarchical nDCG@10 gains are 2.613% on the historical panel and 2.639% on confirmation, with across-seed SDs of 0.060 and 0.012 percentage points, respectively. The table below gives paired full-ICM-minus-control differences in percentage points of relative gain, with sample SDs across seeds: