- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ViLo-TM, a framework that jointly learns deep CNN representations and interpretable Boolean rules of Tsetlin Machines. The SE2L interface maps channel responses into ternary predicates, while ContinuousTM employs differentiable relaxations to allow classification gradients to update the CNN, predicate thresholds, and sparse clause supports. Quantization-aware training (QAT) subsequently enables the export of an integer CNN and a Boolean TM. The authors further demonstrate computational traceability from clauses to channel maps, fidelity of Boolean conversion, and online adaptation through Type I/II feedback with a fixed visual front end.
Critical strengths
Comprehensive interface design from CNNs to Boolean TMs. The framework integrates ternary predicates, sparse clause supports, QAT, integer export, and Type I/II adaptation into a coherent pipeline. The exact agreement between the exported Boolean model and reference clause outputs and class scores on CUB provides valuable evidence of implementation correctness.
Concrete consideration of resource-constrained deployment. The paper evaluates conversion accuracy, classifier adaptation with a frozen visual front end, and FPGA/HLS resource estimates. These analyses explicitly illustrate the trade-off between multiplication-free adaptation and increased state storage and LUT requirements.
Critical weaknesses
Test-set leakage in initializer selection undermines the main experimental results. The paper explicitly acknowledges that the initializers for MNIST, Fashion-MNIST, CIFAR-10, and CIFAR-100 were selected based on official test-set accuracy. This introduces test-set leakage and compromises the validity of the reported comparisons. In particular, the headline CIFAR-10 result of 90.15% cannot be regarded as an independent held-out evaluation. The authors should select initializers using only training and validation data, fix all hyperparameters accordingly, and reevaluate the models on an untouched test set.
Insufficient evidence for visual semantic interpretability and hardware-speed claims. Semantic concepts are assigned post hoc using a frozen InternVL3.5-8B model, rather than being explicitly grounded during training. The test-set part purity on CUB drops to only 0.23 when using training-assigned concepts, and all non-wildcard conditions are VLM-confirmed in merely 0.17% of eligible clause-firing events. These results raise substantial concerns about whether the learned Boolean rules provide reliable semantic explanations of visual decisions.
Questions for authors
Please refer to Weaknesses.