- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
This paper investigates LDL loss functions from the perspectives of mean-properness and local geometry. Mean-properness concerns the statistical target associated with the conditional expected risk of the loss function, while the local geometry focuses on how the loss function locally weights prediction errors in different directions. The authors note that while KL and SE losses exhibit strict mean-properness, they fail to provide direct and uniform control over label ratios, particular in the cases where label mass approaches zero; conversely, the squared Aitchison loss directly measures label ratio error but typically lacks mean-properness. To address this, the paper proposes a Bregman loss with Aitchison-inspired potential function, named BAP. It establishes the strict mean-properness, while also theoretically simulates the local geometry of Aitchison error. Experimental evaluations across eight datasets demonstrate the effectiveness of the proposal.
Critical strengths
-
This paper’s research problem is significant and clearly defined. The paper analyzes LDL loss functions from the dual perspectives of statistical target and local loss geometry, clearly distinguishing between ‘‘what is being predicted” and “how local prediction errors are weighted”, thereby offering a valuable perspective for LDL loss design. Building on this analytical framework, the authors link two types of information that are practically significant yet previously unconsidered in tandem: the conditional arithmetic mean target (which is essential in the practical scenarios of finite annotations) and inter-label ratio information (which is essential in certain important applications such as Breast-cancer tumour-microenvironment deconvolution).
-
The proposed BAP is concise yet effective, and its key properties are supported by a solid theoretical foundation. By employing a smooth quartic extension to handle the singularity of the negative logarithmic potential at zero, BAP accommodates label distributions with zero components in label ratio information mining, which is of practical significance. Simultaneously, BAP preserves the curvature of negative-log potential function above the threshold to approximate the Aitchison error structure. The paper establishes the local relationship between BAP and Aitchison error, as well as its strict mean-properness.
-
The experiments align closely with the paper's focus on limited annotation and label-ratio prediction. By comparing LDL models across eight datasets under two annotation budgets, the authors demonstrate consistent improvements in BAP regarding the ratio error metric MALR, as well as the standard LDL metrics. Furthermore, applying BAP to several SOTA LDL algorithms reinforces its practical value as a plug-in component.
Critical weaknesses
-
Practical recommendations for threshold selection could be clearer. While the paper provides a comprehensive sensitivity analysis, it lacks a summary of these results into concise, actionable guidelines. Providing a recommended initial threshold or a selection procedure would enhance the method's usability.
-
There are a few issues regarding notation and typesetting. For instance, Table 1 uses (n_b) while the main text uses (n_a); additionally, the expanded summation in Equation (9) requires parentheses. It is recommended to review these details for consistency to further enhance the paper's readability.
Questions for authors
Based on the existing threshold sensitivity analysis, do the authors recommend using (\tau=0.05) as an initial setting for practical applications, followed by adjustment using a validation set?
Dear Reviewers,
Thanks for your time and effort in reviewing this paper. The authors have responded to the comments by providing a rebuttal. Please read the rebuttal and indicate whether your concerns have been resolved. Thanks.
Regards from the AC.