- Rating
- 1
- Confidence
- 1
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates whether propagation plays an important role in diffractive neural networks for image generation. The authors constructed a cDFM and conducted ablation studies by removing or modifying the physical propagation process. The experiment shows that propagation is not just an optional feature. Rather, it provides essential computational capabilities under certain constraints, such as if an aperture is passive or there is limited training time. In conclusion, this study argues that propagation is a fundamental mechanism that enables certain computational capabilities.
Critical strengths
- The paper provides insights that propagation plays a meaningful computational role in diffractive generative models, and how this depends on model capacity and physical constraints.
- The paper identifies the functional necessity of different components through ablation studies, which help to improve understanding of their contributions to the model's performance.
Critical weaknesses
- W1. (Motivation) The motivation for removing propagation is somewhat unclear. Since propagation is an inherent physical process in optical systems, it is not clear what additional insight can be gained by removing ASM. As it is trivially expected that replacing ASM with an identity operation would reduce the model's representational capacity, the observed performance degradation alone may not be sufficient to demonstrate the importance of diffraction.
- W2. (Analysis) While ASM may provide a useful inductive bias that improves learning efficiency, the recovery of the Identity model with increased network capacity and training budget is not sufficiently explained. In particular, it is unclear how the Identity model recover performance without propagation or light amplification.
- W3. (Writing Issue)
- The abstract and introduction mainly list experimental results rather than explaining their implications and key insights. As a result, it is difficult to understand the significance of the findings.
- The related work section does not provide sufficient context to understand the position of this paper relative to existing studies.
- Several mathematical notations(R_s,σ, ℜ... Eq 2,3), and technical terms (passive, fresh, fixed ...) are used before definitions, making the paper difficult to follow.
Questions for authors
- What is the meaning of fixed and fresh source?
- If increasing network capacity and training budget allows the model to recover performance without propagation, doesn't this rather suggest that propagation is not necessary? If so, is the main benefit of ASM limited to learning efficiency? Could other spatial mixing operators provide similar or even better efficiency?
Thank you for the review. You worked through a paper that was hard to read and still asked specific questions, and we are grateful for that.
On the first question, a source is the random 4x4 noise that is given as input to the model. The fixed and fresh sources are two lists of 320 sources each. Both are random noise. We used the scores on the fixed list to pick the settings of the model and report the generation scores on the fresh list, so the reported scores had no part in those choices. The difference between the two lists is minor, so they did not need names, let alone a place in the abstract.
On the second question, the model without propagation does learn to produce the requested class once it is scaled up: with 2.7 times the parameters and 8.6 times the training of the paper's small model, it reaches 90.0% class accuracy across three seeds, while the model with ASM reaches 96.5%. The benefit of ASM is not only efficiency. The model without propagation generates less varied samples of each digit. It generates a close match, as judged by a classifier, for 41% of the 5,000 validation digits, while the model with ASM does so for 66%. One other untrained operator comes close. A random convolution reaches 77.0% in the small model, where ASM reaches 83.1%. In the scaled model the two reach about the same class accuracy, but the convolution generates a close match for 60% of the validation digits and ASM for 66%.
We are withdrawing the submission so that we can rewrite it.