- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Kaiwu-PyTorch-Plugin (KPP), a framework that connects PyTorch-based energy models with Ising solvers, including coherent Ising machines (CIMs) and simulated annealing. The framework aims to provide a reusable interface for incorporating Boltzmann machines into existing deep learning architectures while keeping neural network training and optimization within PyTorch. The authors demonstrate the framework through three applications: QDiffusion, which uses energy-based guidance for generation; QVAE, which incorporates a Boltzmann-machine prior for latent representation learning; and Boltz-Flow, which uses conditional Boltzmann states to initialize flow-matching policies. Experiments cover mathematical reasoning, text and molecular generation, single-cell data integration, and robotic manipulation. The results suggest that the proposed framework can support different energy-based components across several application domains, with improvements over selected baselines.
Critical strengths
The paper addresses a practical challenge in combining energy-based models with existing deep learning frameworks. Its separation between PyTorch-based model training and external Ising optimization provides a potentially useful abstraction for developing hybrid learning systems. The architecture and workflow diagrams in Figures 1 and 2 help illustrate how this interface can be reused across different model compositions. The overall organization is also reasonably clear, making the main implementation idea accessible to readers from different backgrounds.
Critical weaknesses
Although the motivation for integrating PyTorch with Ising solvers is understandable, the paper could better distinguish its core technical contributions from the individual application models. In particular, it is not always clear which improvements arise from the proposed KPP interface itself and which are primarily attributable to the task-specific designs of QDiffusion, QVAE, and Boltz-Flow. The introduction would benefit from a concise statement of the main contributions, emphasizing what is technically new relative to existing solver-assisted Boltzmann-machine frameworks. A clearer explanation of the distinctive capabilities of KPP would also help readers understand its broader significance. Since the title emphasizes photonic quantum computing, the paper should more clearly distinguish the benefits of the software interface from any benefits specifically attributable to the photonic backend.
Questions for authors
- Could the authors clarify the main technical novelty of KPP compared with existing PyTorch-based Boltzmann-machine implementations and solver integration approaches? A concise list of contributions or a more explicit discussion of the interface design would be helpful.
- Could the authors provide additional controlled comparisons using matched inference budgets, particularly for the text-generation experiments in Table 2 and the different replanning intervals in Table 7? Such comparisons would help isolate the benefits of the proposed energy-based components.
- Could the authors provide more information about computational efficiency and reproducibility, including end-to-end inference latency, solver-call overhead, CIM versus simulated-annealing performance, and variability across experimental runs? These details would help readers assess the practical benefits of adopting KPP.