- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces LGN-ViT, a Vision Transformer implemented using trainable logic gate networks. Motivated by efficient inference on resource-constrained edge devices, it combines XNOR-based similarity, top-k selection, majority voting, and XOR residual connections with discrete forward training and differentiable backward surrogates. Experiments report accuracies of 57.75% on CIFAR-10 and 98.11% on MNIST.
Critical strengths
- The paper presents a coherent logic-native Transformer architecture. It integrates learnable feature transformations, content-dependent token interactions, and binary residual updates into a unified Boolean inference framework.
- The training components are supported by targeted ablation experiments.
Critical weaknesses
- The experimental results are not convincing enough. In Table 1, ConvLogic S achieves 60.38% accuracy on CIFAR-10 with 1.337M parameters and a 160.3K estimated logic budget, whereas LGN-ViT D768 only achieves 52.56% with 1.478M parameters and a 700.4K budget.
- The evaluation is limited in scale and task diversity. The proposed LGN-ViT is evaluated only on CIFAR-10 and MNIST.
Questions for authors
- Could the author(s) evaluate LGN-ViT on more challenging benchmark?
- Could the author(s) report end-to-end inference latency and memory usage on a target hardware platform?
3 comments
Thank you for the response. My score remains unchanged.
Thanks For Recommending Acceptance
Thank you very much for your positive assessment and recommendation for acceptance! We really appreciate your time.
Response to Reviewer smaU: Accuracy, Evaluation Scope, and Hardware Performance
We thank you for your careful review and for recognizing the coherence of LGN-ViT's unified Boolean inference framework and the evidence from our targeted ablations. Your feedback has helped us strengthen the experiments and clarify the relationship between model performance and resource requirements.
1. Classification accuracy and model efficiency
To address the accuracy gap you identified, we refined how binary features are used within the LGN-ViT framework. LGN-ViT-SR achieves 64.42% CIFAR-10 test accuracy with 1.330M parameters, exceeding ConvLogic S's 60.38% with 1.337M. Compared with the original D768 model you highlighted, this is an improvement of 11.86 percentage points, with approximately 10% fewer parameters. These results further support the effectiveness of the core LGN-ViT architecture. The methods and full results are provided in our general comment and Appendix B.4, Table 13 (p. 26) of the revised PDF.
ConvLogic remains more accurate at comparable logic budgets. This comparison should be understood in the context of how the architectures organize computation: convolutional models directly exploit locality in images, while LGN-ViT's logic budget also includes matching, selection, and aggregation circuitry for input-dependent interactions. These operations establish token connections based on the current input, and their resource costs and accuracy benefits need to be evaluated for the task at hand.
Comparisons of floating-point models provide related context. ViT (ICLR 2021) explains that CNNs' built-in locality and translation equivariance aid generalization with limited data, while ViT relies more on learning spatial relationships from data. In CIFAR-10 transfer experiments with ImageNet pretraining, Touvron et al. (ICML 2021), Tables 5-6 report 97.9% with 307M parameters for ViT-L/16, versus 98.9% with 66M for EfficientNet-B7. Adopting a Transformer therefore does not automatically guarantee better parameter efficiency. Our new results show that refinements suited to Boolean features can substantially improve the accuracy-parameter tradeoff within LGN-ViT.
2. Evaluation scope and more challenging benchmarks
We agree that evaluation on more challenging vision and sequence benchmarks would further test the value of input-dependent attention. We chose MNIST and CIFAR-10 to use common evaluation benchmarks with ConvLogic. The paper also examines width scaling, depth scaling, and component ablations to assess the trainability of a logic-native Transformer and the roles of its key designs.
Our work establishes the computational basis for building and training Transformers with differentiable logic gate networks, providing an independent architectural backbone for future adaptations to different tasks. The new LGN-ViT-SR results further demonstrate practical gains from improving feature utilization within this framework. Building on this foundation, extending the model to more complex vision and sequence tasks is an important direction for our future research.
3. End-to-end inference latency and memory usage
For CIFAR-10 D192 (5 blocks, 65 tokens, three 64-bit heads, top-k=15), we implemented a clocked RTL selection-and-aggregation engine with full datapath and control for register state, active-mask updates, gather/vote accumulation, and block/query scheduling. We verified its outputs against the software reference in VCS and synthesized it using a 28 nm standard-cell library (see Appendix B.3 and Table 12, p. 22 of the revised PDF).
With score and value inputs ready, VCS simulations report 45 cycles per query/head for a single engine. Three head-local engines operate in parallel, processing all three heads in the same 45 cycles with a total synthesized cell area 2.98 times that of a single engine. Each engine uses 64 comparison nodes and is reused across queries and blocks to reduce hardware replication. With continuous score and value streaming and a 46-cycle query initiation interval, the three-engine unit completes selection and aggregation across all five blocks (65 queries per block, 325 per head) in 14,949 cycles. At the 3 ns target clock period, this corresponds to 44.847 μs.
Bit-packed binary Q/K/V payloads occupy 4,680 bytes per block. Two 65-entry, 7-bit score-row buffers per head require 2,730 bits across all three heads. This supports row-wise score streaming without storing the full attention-score matrix. These results establish functional equivalence, deterministic timing across blocks, and compact on-chip buffering for our core attention architecture.
Thank you again for your careful assessment and constructive suggestions.