- Rating
- 1(−1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces GEB-PCN, which combines forward predictive-coding mismatch penalties and an output potential into a joint energy over images and hidden activities. Training contrasts positive and negative finite-state energies while stopping gradients through hidden-state inference. A coupled sampler updates hidden activities deterministically and images with noisy energy-gradient steps. The paper explicitly distinguishes this implemented finite-step system from the equilibrium profile energy and exact Gibbs sampling. Experiments on MNIST, Fashion-MNIST, and CIFAR-10 report image-quality metrics against predictive-coding, EBM, and latent-variable baselines. Further analyses examine class conditioning, PC-force interventions, replay versus noise starts, exact hidden-state profiling, and joint-versus-separate sampling cost.
Critical strengths
-
The method gives a concrete, implementable route from a forward-PC state objective to image synthesis. Equations (7)-(10) and Algorithms 1-3 specify the joint energy, contrastive update, and carried-state sampler. The authors correctly distinguish a state objective from a normalized input model and do not assume that finite hidden inference reaches equilibrium. The conditional MNIST experiment also demonstrates meaningful generation from noise, rather than relying entirely on replay (Appendix E, Table 13).
-
The sampling analysis is unusually candid and informative. The grayscale results aggregate five training seeds and include KID and PRDC rather than FID alone. Sections 5.1-5.3 and Appendix F separate sampling-time force interventions from claims about the benefit of training with PC. The long-chain, exact-profile, and paired timing controls show both benefits and limitations: joint updates are 3.16-3.92 times faster than the tested separate-eight-state-update sampler, but they do not establish a general equal-time advantage. These distinctions improve the credibility and scientific usefulness of the study.
Critical weaknesses
-
The CIFAR-10 headline does not establish synthesis independent of the training-image population. The selected continuation refreshes particles using perturbed training images (Appendix C.4), and Appendix D.6 states that at least 9,207 of 10,000 selected-buffer entries have received such a refresh. The resulting main-table FID of 62.93 therefore measures refinement of a data-refreshed starting population. In the separate fixed-reference control, stored-particle test FID is already 82.53 before sampling and improves to 71.88, whereas a fresh 5,000-image noise-start evaluation at the selected 500-step horizon has test FID 176.50. These are different protocols, so their numbers must not be subtracted as if they were a paired comparison. Nonetheless, the initialization dependence is large and explicitly documented. The EBM comparison also changes training duration and replay policy, and has only one training seed (Appendices C.6 and D.6). Thus the RGB experiment does not yet isolate the model's generative benefit from the replay/data-refresh recipe. A shared-start, shared-replay comparison with independent seeds and train/test references, or a clear main-table separation of data-conditioned refinement from noise-start synthesis, is needed before this result can carry substantial weight for acceptance. This is a limitation of the demonstrated claim, not an accusation of concealed data use.
-
The distinctive contribution of internal PC is not established relative to an otherwise matched energy model. The large Fashion-MNIST gap to the EBM in Table 1 compares a hybrid convolutional-MLP MSE-head GEB-PCN with a scalar-head MLP EBM (Section 4.1; Appendices C.1 and C.5), so architecture and head design can contribute to the gain. Existing ablations do not resolve this: removing the head after training is not a retrained necessity test, the Appendix F four-cell comparison uses different selected recipes, and the genuinely paired conditional PC-on/off cohort in Appendix E.1 favors PC-off in label accuracy and macro FID (0.9348 versus 0.8986; 3.782 versus 6.371). That last cohort has five seed pairs and a test-informed recipe; it does not prove that PC is universally harmful or settle the unconditional comparison, but it makes a controlled positive demonstration particularly important. Please compare internal PC-on/off with the same backbone, output potential, replay protocol, selection budget, and training seeds in the primary unconditional setting, and include the sampling-cost trade-off. Otherwise, the evidence supports an interesting structured EBM construction and sampling study more clearly than a practical advantage attributable to internal predictive coding.
Questions for authors
- Clarification affecting the RGB claim: Can you report GEB-PCN and the no-PC EBM under the same frozen starting population, replay/refresh policy, training-selection protocol, and sampling budget, including K = 0 and held-out-reference results? Which conclusion about independent RGB synthesis remains if data-refreshed starts are excluded?
- Clarification affecting component attribution: Are matched unconditional PC-on/off runs available with the same hybrid/MSE backbone and prospectively fixed selection protocol? In light of the paired conditional ablation, what measurable benefit do the internal states provide beyond the energy head and replay mechanism?
- Clarification affecting the advertised conditional comparison: Section 4.3 calls conditional performance highly comparable to the VAE, but Table 13 reports macro cFID 3.121 versus 1.277 and global FID 0.743 versus 0.386, with lower label accuracy for GEB-PCN. Will you revise the main-text comparison to foreground this fidelity gap and specify the narrower benefit of the PC construction?