- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The manuscript introduces two new decision-aware acquisitions rules in active learning of -valued nominal outcome by augmenting Savage score pertaining to strictly convex function with additional term, which is either normalised Bayes value (DUSAL-Hard) or its soft version (DUSAL-Soft). Bayes value corresponds to normalised value of maximal expected utility. Theorem 1 shows that the resulting divergence can be decomposed into sum of the regret pertaining to the original loss and the selected action’s scaled decision regret. Such decomposition can be essentially obtained only by the above augmentation construction (Theorem 2). The introduced utility adjusted scores are than used to construct acquisition strategy based on maximisation of the gain resulting from querying candidate vector of predictors .
Critical strengths
Nice incorporation of Bayes-value augmentation term pertaining to utilities into construction of new proper scores which can be used in active learning.
Critical weaknesses
The exposition is laconic at places and its essence will be hard to grasp for readers not well acquinted with the field of active learning.
Questions for authors
- How the performance of the studied acquisition strategy depends on deployment distribution and weights ?
- The scaling of embeddings in Algorithm 3 using is not clear.
2 comments
Dear Reviewer V8Ta,
Thank you for confirming that our responses addressed your questions. We appreciate your constructive feedback and your recognition of DUSAL-Hard's originality and research potential. Thank you for your thoughtful engagement with our work.
I am satisfied with Authors' answers to my questions. As I wrote in my appraisal, the idea behind DUSAL-Hard is original and worth pursuing. I keep my score.