- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies reference-based logit correction, where predictions are adjusted using the logits produced by a content-free input such as a blank image or neutral text. It shows that reference subtraction geometrically recenters the model’s logits but does not, by itself, identify the correction that minimizes risk on a target distribution. The paper establishes two non-identifiability results, gives a sufficient condition for successful reference correction, and evaluates the analysis in long-tailed vision models and language-model classification. The experiments suggest that references can provide a useful prior-like correction direction, while the appropriate scale and objective require additional target-related information.
Critical strengths
-
Clear separation of geometry from statistical identification The strongest contribution is the paper’s precise distinction between what reference subtraction mechanically does and what would be required for it to be target optimal. The affine-readout identity makes the geometric action transparent, while the target-risk result identifies the missing distributional argument. This directly addresses a common but insufficient justification for reference-based correction.
-
Careful empirical decomposition with meaningful controls The vision audit goes beyond showing that some blank or synthetic references work. It separates the shared prior-like direction from reference-specific magnitude and orthogonal content, and supports this account with held-out evaluation, permutation controls, seed replication, and independently trained checkpoints. The language-model prior intervention is also well matched to the theoretical claim: the target optimum changes while the fixed reference does not. These experiments materially strengthen the paper beyond the elementary observation that different references can produce different outputs.
Critical weaknesses
- The theoretical results are correct but relatively direct consequences of underspecification and target-distribution dependence. The paper should more clearly explain which claims made by prior reference-correction methods are challenged.
- The vision experiments mainly analyze frozen logits. Since reference correction may alter pseudo-labeling and subsequent training dynamics, an end-to-end LTSSL evaluation would strengthen the paper’s practical conclusions.
- The empirical scope is limited to a small number of vision checkpoints and binary, single-token language-model classification, leaving broader generalization uncertain.
Questions for authors
- After fixing the prior direction, how much additional benefit comes specifically from the reference rather than from a reference-free scale?
- Do the conclusions from the frozen-logit analysis still hold when the correction is applied during end-to-end LTSSL training?
- Can the authors clarify which claims in prior reference-correction methods are directly challenged by the non-identifiability results?