- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes an UQ-scheme that focuses on the lifting/encoding module rather than the full network. After training a network, at inference time, feature channels coming out of the first layer are randomly dropped or rescaled, injecting noise in the pipeline, which when repeated many times, produces mean and std. The latter can be used for determining an error band in uncertainty quantization. On two benchmark/model combinations this approach indicates better coverage and narrower bands than alternative existing methods.
Critical strengths
I believe it is a clever find to split the analysis/noise injection over different modules, realizing that the type of uncertainty that follows from the encoding/lifting phase can be worth focusing on more instead of a more generic randomness injection on the full network.
The paper is well written and the method clearly explained.
Critical weaknesses
I am slightly uncomfortable with the general direction of the storyline, and related to this, the tone and statements made in the paper. While I believe the core idea of differentiating between different lifting/encoding and propagation/recovering modules of a network when analyzing sensitivity is a valuable insight, I believe the authors aim too much for framing this as a generic new/better UQ-method. In my view the paper could benefit a lot from changing the focus to a more modest research/ablation type that looks into a wider variety of datasets/models/input settings (i.e. varying input resolution, uncertain inputs etc).
The reason for this discomfort is that I am still convinced that in principle the other parts of the network (propagation,recovering) are still perfectly capable of carrying epistemic uncertainty in general. Fundamentally, nothing changed: these parts are a learned imperfect model on finite data, and as such one may be interested in and wanting to analyze its uncertainty. I think what the experiments show is not "this method is a better UQ method", but that on these specific model/datasets we have certain properties like: (1) the main bottleneck in accurate modeling just happens to be the input and its encoding and (2) the epistemic uncertainty of the middle and output layers happens to be correlated to their input-sensitivity.
I don't believe either (1) or (2) needs to hold in general, but it would be interesting to see research focusing on how prevalent this behavior is (in particular (2)). While I don't want to claim exactly to know what is going on and my analysis may be crude/wrong, I would still generally be more interested in an analysis focusing on such questions, instead of trying to plainly show the author's UQ method is better than other methods.
More model/dataset combinations are of course still very welcome, simply because I do believe that it is hard to untangle in general for the results if they say something about the UQ method or about the model/dataset at hand, and if one wants to truly claim a generic better UQ method, id say a lot of very different model/dataset combinations are needed to make that stick.
Questions for authors
I wonder if the authors considered learning the uncertainty/error bands with an auxiliary model, I believe there is a line of works covering this as well that is worth looking into, even if only for comparison purposes.