- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This study proposes OCBM, which uses graded logic for the final prediction layer with one tree per class. These trees are pruned to be small, and they use soft AND/OR operators with learned weights and strictness. Main claims of the authors are: accuracy is competitive, five concepts have been learned on MNIST without concept labels, the concepts are better transferred to USPS than those from linear or MLP heads, and all of this make the model’s reasoning more human-aligned.
Critical strengths
-
The idea is interesting and well motivated in the paper. Graded logic can express relationships that boolean heads could not.
-
99% accuracy on MNIST that has been achieved with only five concepts and without concept labels shows that this idea could potentially improve CBMs.
Critical weaknesses
-
The only comparison to assess whether graded logic is better and gives more transferable concepts is against a linear and an MLP head. Multiple factors are not controlled (that could explain the results, e.g., sparsity, one tree per class, training with extra losses, etc.). They could run other experiments with simpler logic operators, such as min/max, or other tests with the matched sparsity, like a sparse MLP, or more controlled tests with simplifying parts of the method to show that the gains are because of the graded logic and the full method. Overall, the idea is good, but the tests are not sufficient to support the claim.
-
Considering that the abstract, and even the title, mention human-aligned reasoning, a reader would expect to see some sort of user study or experiment that would further support this. Instead, the authors only use an LLM to revise the concept names until the score passes a threshold, and the explanations are not checked against the model predictions.
Questions for authors
-
Could you add other experiments that would control for different factors and isolate the effect of graded logic, for example, simpler logic operators, sparse MLP heads, or removing individual components of the method? Would the advantages of your method persist over these controls as well?
-
Are there any results or tests that would further support the human-aligned reasoning? Also, can LLM-written explanations reproduce the model predictions?