- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies the Abductive Learning (ABL) framework that combines data-driven supervised machine learning with symbolic logical reasoning. Due to the skewed concept distributions (some correct but rare concepts may never be explored), the ABL process may get stuck in a vicious cycle, namely a bias feedback loop in ABL. This paper proposes distribution-prior-rectified progressive abductive learning (DPRP-ABL), which addresses this problem by: progression over the KB structure that can help slow down the bias feedback loop getting worse, and distribution-prior-award rectification that raises the weight of rare concepts to encourage the exploration of rare concepts. This paper presents a theoretical analysis to show that the effect of the candidate-size contraction, the effect of score rectification, and that the ground truth can always be covered. Experiments and ablation studies on digit addition and judicial sentencing demonstrate that DPRP-ABL is efficient and can outperform baselines.
Critical strengths
Contributions and significance
The studied Abductive Learning (ABL) framework is promising and important for combining data-driven supervised machine learning with symbolic logical reasoning. One of the main challenges of ABL is that due to the potentially noisy feedback from the symbolic reasoning, the ABL process may get stuck in a vicious cycle. This paper addresses this problem for imbalanced concept sets by progressively expanding the concept set and encouraging the exploration of rare concepts, which is of great significance for ABL.
About experiments
Extensive experiments are conducted on different datasets and different baselines. From the experiment results, it is shown that DPRP-ABL is efficient and outperforms baselines. The performance margins are significant for judicial sentencing.
Critical weaknesses
- The difference of this paper from the related work should be presented more explicitly. The related work section should discuss the relationship and the differences between this paper and the related work rather than just listing the related work. In addition, the curriculum idea in ABL is proposed in Hu et al., 2025b, the authors should explicitly discuss the relationship and the differences.
- The presentation of the grid search parameters should be clearly presented. There are many parameters in the experiments; the authors should clearly present the search space to enhance the reproducibility and the fairness of the experiments.
- The scope of the theoretical results should be clearly presented. For example, the result about "Effect of score rectification" shows that rectification can change the ranking of the concepts, but this does not mean that rectification can improve the performance. The result of "Feasibility and Ground-truth Coverage Under Phase Transitions" shows that the ground truth can always be covered, but this does not mean the ground truth can always be found. I understand that the further analysis can be challenging, but these should be clearly discussed in the limitations section.
Other suggestions
- The authors are recommended to add an example of the concept distribution skewness to let the readers know why this can be harmful and why it is important.
- The authors are suggested to add more illustrations after the theoretical results to show the intuition and inspiration for the practice, rather than just showing the theorems.
Questions for authors
The distribution-prior-aware rectification is proposed to encourage the exploration of rare concepts. However, in some cases, this can lead to some incorrect concepts being explored.
- How to evaluate whether the rectification is effective?
- Can we implement a trade-off between exploration and exploitation?
5 comments
W2, W3, and S1
W2. Concerns about hyperparameter tuning.
Thanks for your suggestions. We agree on the necessity of providing details for the reproduction. We have added the details of hyperparameter tuning. Please refer to Fig. 15 in Appendix I.1.
In the digit addition task, we conduct the cross-grid search over . Each grid cell reports the mean validation sum-level accuracy over the final five tuning epochs. The selected values for d=1,2,3 are recorded in Fig. 15. In the judicial sentencing task, there is the same search range. is selected according to the lowest mean absolute error (MSE).
For reproducibility and fairness, all methods share the same data splits, paired seeds, and training budgets. Experiments are conducted with the optimal hyperparameter that is tuned to ensure a fair comparison.
Besides, if you have more interest in reproducibility, please refer to the details in Appendix H.
W3. Concerns about the scope of score rectification and ground-truth coverage.
Thanks for your questions. We agree with both distinctions you raised.
Firstly, the score rectification result establishes only a condition under which the distribution prior term can change the ordering of two candidates. It does not establish that the rectified ranking agrees with the ground truth or that it necessarily improves downstream predictive performance. Rectification is beneficial when the original ordering is biased toward majority concepts and the estimated distribution prior provides a sufficiently accurate correction. When the distribution prior estimate or early perceptual predictions are noisy, it may over-correct the ranking and favor an incorrect minority candidate.
Secondly, feasibility or coverage is necessary but not sufficient for correct recovery. Even if the ground-truth assignment remains in the structural candidate set, another candidate may receive a higher combined perception-and-prior score and be selected. Thus, the coverage result does not imply that the ground truth will always be recovered.
We have moved the two corresponding remarks from the appendix to immediately after the score rectification and ground-truth coverage theorem, respectively. We now explicitly avoid interpreting a possible rank reversal as guaranteed performance improvement or structural coverage as guaranteed recovery.
Although these results do not constitute theoretical guarantees, the newly added analyses in Appendix I.1 provide direct empirical support for the intended mechanism. As shown in Table 13, Fig. 12, Fig. 13, and Fig. 14, minority pseudo-label recall increases together with minority precision and overall pseudo-label accuracy, while the minority proportion among selected candidates progressively approaches its ground-truth proportion. These results indicate that, in the evaluated settings, the proposed method improves the recovery of minority concepts without indiscriminately overpredicting them. The ablation, sensitivity, and majority-and-minority performance analyses provide further empirical evidence of its effectiveness.
Nevertheless, the present theory does not provide an end-to-end guarantee of correct pseudo-label selection, convergence, or generalization. Developing more reliable learning theoretic guarantees for the complete abductive learning process remains an important direction for our future work.
S1. Suggestions about adding an example of concept skewness.
Thanks for your suggestions. We agree that it would benefit from a more concrete example illustrating both the origin and the practical consequence of concept distribution skewness.
Fig. 1 provides an illustration of our research with a key perception-abduction feedback loop. In Fig. 4, the dashed curve shows the empirical marginals of the judicial attributes. As you can see, the distribution is highly skewed, where the positive rate of attitude is approximately 86.3%, whereas those of young, surrender, and forgive are only approximately 5.1%, 8.7%, and 11%, respectively. This skewness is harmful in abductive learning because an initially biased perception model tends to assign lower scores to candidates containing rare attributes. Consistency-based abduction may consequently select majority-dominated candidates as pseudo-labels, which provide even less subsequent supervision for the rare attributes and reinforce the initial bias. Importantly, low frequency does not imply low relevance. In judicial sentencing, relatively rare mitigating or aggravating circumstances may still materially affect the prediction, so outstanding aggregate performance can mask poor recognition of these attributes.
We will expand the discussion in the revision to make the motivation and practical importance of concept skewness more explicit.
Q1. Concerns about some incorrect concepts being explored and discussion about future work.
Thank you for raising this important issue. We agree that distribution prior rectification does not guarantee that every supported minority-containing candidate is correct. If the estimated distribution prior is inaccurate or the rectification strength is excessively large, an incorrect candidate containing rare concepts may receive an overly large score. We will clarify this limitation in the revision. Now, we would like to discuss with you our thoughts on the robustness of our DPRP-ABL regarding this issue, as well as suggestions for improving our future work.
We first emphasize that ''exploration'' in DPRP-ABL does not mean unconstrained generation or selection of rare concepts. Rectification only changes the relative scores of candidates that already satisfy the currently active knowledge constraints. Thus, a minority-containing candidate must remain logically feasible and sufficiently compatible with the perceptual predictions before it can be selected. The progressive knowledge base schedule provides an additional safeguard by restricting early abduction to a smaller and structurally simpler candidate space. We have added the evaluation to explain the effectiveness of rectification at the pseudo-label levels. As you can see in Table 13, Fig. 12, Fig. 13, and Fig. 14 in Appendix I.1, we report overall pseudo-label accuracy (ACC), minority pseudo-label recall (RECM) and precision (PREM) during training, the majority and minority composition of the candidate and selected sets, and the final performance of the majority concept and minority concept. Minority recall measures the benefit of recovering rare concepts, whereas minority precision directly measures the cost of incorrectly supporting them. The newly added training dynamics demonstrate that the increase in minority pseudo-label recall is accompanied by increasing minority precision and overall pseudo-label accuracy, rather than by indiscriminate overprediction of minority concepts. Moreover, as training progresses, the minority proportion among selected candidates approaches its ground-truth proportion, as you can see in Table 13 in Appendix I.1.
In this work, an exploration and exploitation trade-off can already be implemented through and . Setting or removes distribution-prior-based exploration and makes candidate selection rely primarily on perceptual likelihood, whereas larger values provide stronger compensation for rare concepts. We select these parameters using validation performance and have reported their sensitivity explicitly in Fig. 15 in Appendix I.1. Nevertheless, we agree that a more adaptive trade-off would be valuable. A promising extension is to use a phase-dependent or confidence-dependent coefficient , increasing rectification only when the minority pseudo-label precision or abduction stability is sufficiently reliable and decreasing it when minority precision deteriorates. Another possibility is confidence-gated rectification, in which the rare concept bonus is applied only to candidates whose perceptual likelihood lies within a predefined margin of the best candidate. Clipping the maximum distribution-prior-rectification weight and maintaining estimates of the concept distribution prior could provide further safeguards.
We thank you again for your constructive suggestions and will discuss these adaptive strategies as an important direction for future work.
W1. Concerns about C-ABL and our DPRP-ABL.
Thanks for your suggestions. We agree on the importance of clarifying the relationship between our DPRP-ABL and C-ABL (Hu et al., 2025b). We acknowledge that the idea of the structure progressive component is inspired by the knowledge base curriculum introduced in C-ABL. However, we cannot ignore the differences between them in problem formulation, phase construction, transition criteria, and candidate scoring.
First of all, C-ABL introduces a knowledge base curriculum to reduce abduction space complexity and improve training stability. DPRP-ABL adopts this principle but studies a different failure mode, i.e., the majority-dominated biased feedback loop under concept skewness.
As for phase construction, for example, in the implementation of the digit addition task, our progression is organized by arithmetic structural complexity, i.e., by the number of carry propagations, which conforms to the laws of human learning that have been claimed at P1 in Section 3.2. You can refer to Appendix H.1 to know more about the metadata construction and progression design. By contrast, C-ABL organizes curriculum by activating the digit-concept domain. They offline construct metadata by manually partitioning concepts into gradually expandable subsets until the final stage covers all concepts. Consequently, one of the differences is that every phase in DPRP-ABL can retain all digits, while the admissible reasoning structures and candidate space are progressively expanded. In the implementation of the judicial sentencing task, our structural-complexity-based progression relies on the legal case complexity, based on which the metadata is constructed offline. The implementation proceeds by progressively expanding according to the implicated attributes within the cases until all cases are included in the sixth stage. This is consistent with C-ABL. Please refer to Appendix H.2 to obtain more details.
As for transition criteria among phases, for example, the C-ABL transition criterion uses held-out concept-level accuracy in the digit addition task and F1 in the judicial sentencing. This subset of concepts does not participate in the backpropagation of gradients during training as a supervisory signal. It is used solely for evaluation. By contrast, in the implementation on two tasks, DPRP-ABL advances according to agreement between current perception predictions and revised pseudo-labels in abduction, as you can see in Eq.(6). Therefore, DPRP-ABL does not require ground-truth concept labels during online training.
Last but not least, in terms of candidate scoring, DPRP-ABL adds a component of distribution-prior-aware rectification, which estimates the concept marginals and calculates weight to rectify candidate utilities to counter majority-dominated pseudo-label selection. Although C-ABL contracts the abduction space but does not explicitly model or handle challenges caused by skewed concept distribution.
To support these distinctions empirically, in addition to what already existed in Table 4 and Table 5 in the initial manuscript we submitted, we have also added experiments for an explicit comparison in Table 14 in Appendix I.1 for the digit addition task. Results suggest that our progression design may be particularly beneficial as perceptual difficulty and abduction ambiguity increase, while DPRP-ABL additionally rectify majority dominance in candidate competition, alleviating skewness-induced bias in the perception-abduction loop.
Besides, we will reorganize the narrative structure of the related work in the revision to clearly distinguish our approach from existing studies.
(Hu et al., 2025b) Wen-Chao Hu, Qi-Jie Li, Lin-Han Jia, Cun-Jing Ge, Yu-Feng Li, Yuan Jiang, and Zhi-Hua Zhou. Curriculum abductive learning, 2025b.