- Rating
- 3
- Confidence
- 1
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper asks when conic geometry is justified for classification. It separates positive-scaling invariance, affine Bayes realizability, and zero Bayes error, showing what each assumption contributes to the geometry of decision regions and class supports. Under an additional shared-concentration vMF model with equal class priors, the authors derive a Bhattacharyya error-bound objective and a density-based rejection score. The proposed implementation uses a positively homogeneous network and class mean directions as the readout. A factorial experiment on CIFAR-100 with 15% labels reports 71.2% accuracy, compared with 67.0% for homogeneous cosine cross-entropy. Further experiments examine error prediction, gain invariance, calibration, and class-holdout OOD detection.
Critical strengths
- The distinction between invariant decision regions and class supports is the strongest part of the paper. Scale invariance alone does not give convexity, and support containment needs an additional separability assumption. The counterexample and the bias-removal argument make these distinctions concrete. I also found the connection between positive angular margin and pointed class hulls useful. The individual mathematical tools are fairly classical, but putting the assumptions together gives a clearer account of when a conic model is appropriate.
- The architecture-by-objective comparison is well chosen. The 4.2-point gain over homogeneous cosine CE is more informative than the larger gain over the standard network, because it shows that the proposed training objective contributes even after the architectural change. The standard-architecture comparison points in the same direction. These results provide a practical reason to consider the objective, beyond the geometric characterization.
Critical weaknesses
- The experiments do not yet isolate what is gained specifically from minimizing the Bhattacharyya bound. The factorial study separates architecture from objective, but the comparison with cosine CE may also change how class directions and concentration are estimated. The proposed readout uses class resultants without separately learned classifier weights. A matched vMF likelihood objective using the same resultants and concentration estimator would be particularly informative here. Section 3 correctly distinguishes bound minimization from likelihood training, but that distinction is not tested. As it stands, I am convinced that the full training recipe helps in the reported setting, but less certain which part of the probabilistic formulation is responsible.
- The calibration result is harder to interpret than the accuracy result because the probability convention is left unresolved. Equation (4) assigns mass to a background class. Using those probabilities directly and renormalizing over foreground classes define different NLL and Brier scores; the latter removes the dependence on the background weight entirely. Appendix B explains this distinction but does not identify which convention produced Table 5. This matters when interpreting the reported benefit of the background component. The split of the 15% label budget between representation learning and held-out concentration fitting also needs to be stated explicitly.
Questions for authors
- Can the authors compare the bound objective with vMF negative log likelihood on the same homogeneous backbone, using the same class-resultant update and concentration estimator? Please also clarify how concentration is updated during training and whether gradients pass through its estimate. This would help distinguish the error-bound contribution from the rest of the directional training recipe.
- For Table 5, are NLL and Brier computed from the full background-augmented probabilities or from renormalized foreground probabilities? How is confidence defined for ECE, and how many of the labels within the 15% budget are reserved for fitting concentration and selecting the background weight?