- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents the Directional Linear Separability Measure (D-LSM) to quantify competing-sample intrusion under the condition of preserving all target samples. The authors first prove that D-LSM is invariant under injective affine transformations, confirming that separability improvements come from non-linear activations. Building on this, they derive pre-activation certificates for ReLU, GELU, and SiLU, guaranteeing the preservation/increase of separation. They build a concrete "affine-tube" layer guaranteed to achieve these targeted conditions. Finally, they validate their theorems on synthetic datasets and deploy a differentiable surrogate estimator to check separability across the layers of a Vision Transformer.
Critical strengths
- The paper manages to understand how each network operation acts on separability. They prove injective affine transformations leave D-LSM invariant. They analyze the impact of coordinatewise activations on D-LSM, deriving clear certificates.
- The paper translates a theoretical concept (pre-activation certificates) into an implementable layer. It shows how specific weights, biases, and activations can be arranged to improve separability.
Critical weaknesses
- While it is great to have moved from abstract theory to a concrete layer, I question whether this layer has practical utility for real-world modeling. First, the architecture's width requirement explodes with the number of intruders, making it computationally intractable for large-scale datasets. Also, the paper presents no empirical evidence that maximizing D-LSM or forcing these early saturation certificates improves classification accuracy or robustness.
- The empirical evaluation suffers from a gap between theory and practice. First, by jumping from toy synthetic datasets directly to a Vision Transformer on Tiny ImageNet, the authors bypass canonical benchmarks (e.g., MNIST, CIFAR-10) and standard architectures (MLPs, CNNs) necessary to validate the metric. Second, the large-scale experiment relies entirely on a D-LSM surrogate estimator with no theoretical approximation bounds. Without these bounds, it remains unclear whether the ViT findings reflect true D-LSM separability or optimization artifacts of the surrogate.
Questions for authors
- Does a higher D-LSM score or earlier saturation actually correlate with improved test accuracy? If not, what concrete utility does auditing this metric offer practitioners over standard linear probing?
- Why were standard benchmarks (e.g., CIFAR-10) and architectures (ResNets, MLPs) omitted? Comparative audit curves are needed to ensure the observed D-LSM dynamics can be generalized.
- Can we quantify the approximation error between your differentiable surrogate and the exact metric
Dear reviewers,
This is a friendly reminder to read the authors’ rebuttals and post your responses by Nov 18. Please briefly indicate which concerns have been addressed and which remain unresolved. Even if your overall assessment remains unchanged, please provide a brief response to the authors. Please also update your reviews and scores as appropriate. Thank you for your time and effort!
AC.