- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes Gaussian Process Activations (GAPA), a post-hoc method that uses a Gaussian process in the activation outputs in frozen pretrained neural networks. To achieve scalability, they use a local k-NN for conditioning. Furthermore, they demonstrate their ability on a variety of tasks including classification, regression, segmentation, language modeling, and out-of-distribution detection.
Critical strengths
Like other post-hoc methods, the strength of the proposed method is to perform uncertainty quantification using frozen backbones. This is useful as it is undesirable to fine tune LLMs and other large models. Furthermore, the method that the authors propose is an interesting way to do it and it seems to be have good empirical performance.
Critical weaknesses
-
This paper seems to be an extension of "Post-Hoc Uncertainty Quantification in Pre-Trained Neural Networks via Activation-Level Gaussian Processes" by Bergna et al. AABI 2025, but the manuscript doesn't acknoledge, cite, or differentiate this paper from that one. That paper already introduces the core GAPA and many of the ideas presented in this manuscript as new. While this manuscript does introduce extensions and more evaluation, the other paper is already published and needs to be acknoledged as the original and treated as a competitor. Given the overlap between the two and the lack of acknoledgement of explanation of differences, this manuscript's novelty claims and contribution is lessened.
-
The datasets, especially image classification datasets, are basic almost toy-like datasets. It's possible that the proposed method is very useful, but it's also possible that it only works with these "easy" datasets. Another problem with using these kind of datasets is that the possible gains is also very small. This can be seen in all the results where the results for all comparison methods, including the proposed method, are about the same and probably within the margin of error. Even in the Appendix, the gains over other classiic distance functions is minimal.
Questions for authors
- How are the hyperparameters in the ablation studies determined (ex: GAPA layers)? Are they selected using a validation set or using the test set?
2 comments
My issues were resolved. I don't have a problem with a weak acceptance.
Thank you for finding GAPA a useful and interesting way to quantify uncertainty in frozen backbones, including LLMs, with good empirical performance.
We now cite the AABI 2025 workshop paper [1] in the related work (Section 4) and compare against it below, on the regression benchmarks of Table 1, the only tasks [1] evaluates. GAPA outperforms [1] on 8 of 9 metrics, including NLL on all three datasets; [1] has a lower CRPS on Taxi.
Numbers for [1] are from its paper (its stronger variant), whose MAP backbones have nearly the same NLL as ours.
The main difference between the two models is what each GP conditions on. [1] fits an independent one-dimensional GP to each neuron of the first layer, so each GP sees only that neuron's own pre-activation. In GAPA, each GP takes the layer's full pre-activation vector as input, so its uncertainty reflects how far an input's whole representation lies from the training data (Section 2.2).
GAPA is also built for large networks. Sparse inducing points and local nearest-neighbour conditioning keep it tractable (Section 2.3), single-pass variance propagation allows it to be applied at any layer (Section 2.4), and it needs no training. This is what lets GAPA run on ResNets, U-Net segmentation and LLaMA-3.2-3B, well beyond the scale of the experiments in [1].
References
[1] Bergna et al. "Post-Hoc Uncertainty Quantification in Pre-Trained Neural Networks via Activation-Level Gaussian Processes." AABI 2025 (workshop track).
Yes, MNIST and Fashion-MNIST are small. We use them because many baselines, such as full Laplace, become intractable at larger scale, so these are among the few benchmarks where all of them can be compared directly with GAPA. However, GAPA itself scales well beyond them, up to a 3-billion-parameter LLM, and this scalability is one of our main contributions.
On LLaMA-3.2-3B, GAPA detects out-of-distribution text with AUROC 0.879, against about 0.5 for last-layer Laplace (Section 3.3, Figure 3). On U-Net segmentation, it propagates uncertainty to 49,152 outputs per image, where full Laplace is infeasible (Appendix G). On CIFAR-10, it lies on the Pareto frontier of OOD detection against inference cost for all four pretrained ResNets (Figure 2). In the LLM and segmentation settings, most of our baselines cannot be run, and uncertainty methods are rarely evaluated at this scale.
Even on these small benchmarks, GAPA has the best BALD AUROC of all methods on both MNIST and Fashion-MNIST (Table 2). Standard deviations over five seeds of the post-hoc procedure are below 10−4, so these differences lie well outside the margin of error.
Regarding your point:
GAPA outperforms every distance-based method in every setting we tested. This holds for kNN, RBF and Mahalanobis distances on MNIST, Fashion-MNIST and CIFAR-10 (Table 3). The strongest of them, nearest-neighbour distance, comes close but never overtakes GAPA. This is expected, since GAPA provides a full predictive distribution, whereas these distance-based methods only provide a single score.
In short, the small benchmarks allow a direct comparison with every baseline, and GAPA already leads there on BALD AUROC, while the larger experiments show that it scales to settings where most baselines cannot be run.
Neither. We set GAPA's hyperparameters without any validation or test data. They come from empirical statistics of the training pre-activations alone, without labels. We use standard data-driven choices for GPs: the kernel length scale is set by the median heuristic, the signal variances are the empirical variances of the activations, and the inducing points are k-means centroids (Section 2.5, Appendix I). The test set is used only for evaluation.
We also ran ablations on the layer, K and M (Appendix O). The main results use fixed defaults for these, and the ablations vary them only to show how sensitive the results are, not to choose them.
We hope this addresses your concerns, and we are happy to clarify any point further.