- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces a method to find a set of diverse low-energy solutions for a given energy function. This work approaches this problem by searching for a state-space distribution such that pushing this distribution through the energy function follows a specified 1D target distribution. The state-space distribution is defined by anchoring on a particular state space sample as the highest-energy point on a curve, and parameterizing the curve so that its energy distribution follows the target, achieving its lowest energy point at the opposite end of the curve. A closed-form objective for learning the curve is introduced and analyzed, with the notable requirement that energy along the curve must be strictly decreasing for the energy push-forward of the curve distribution to match the target distribution. Anchoring the curve on a state drawn from a state-space prior rather than a single point is also introduced. Experiments are conducted on 5D and 6D multimodal synthetic problems to showcase the method, along with an experiment that creates adversarial examples using the method.
Critical strengths
- The core method itself is sound within the exact scope of how the learning method is formulated: it presents a valid method for producing states whose energy follows a target 1D distribution. The theoretical analysis of the method is thorough in terms of the conditions needed to converge to the target distribution and in terms of its existence and uniqueness properties.
Critical weaknesses
- My concerns are not primarily about the soundness of the method itself, but rather the alignment between the method presented and the high-level goal of finding diverse low-energy states of a target energy function. Based on my understanding, it seems that essentially the only way that the method can explore different low-energy regions is from the prior , which to my understanding is determined separately from the training procedure. Since is gradient-like, it cannot cross any energy barriers and can only settle in the same basin of attraction as the anchor point. The method cannot explore separate regions separated by substantial energy barriers by design, except through . This is further demonstrated by the empirical results which show that using a single anchor only covers one basin. Although matching a target energy distribution is somewhat interesting, it does not seem to relate to the ability to explore the energy state-space. In terms of the results of Table 1, none of the methods presented appear more useful than the simple multi-start gradient descent baseline in terms of exploring the space. In my view, there is a fundamental gap between the aim of the method and what it actually does. Exploring a spectrum of energy states is not unique to this method: simple gradient descent will pass through a variety of energy states on its way to a local minimum.
- The adversarial example experiment is not convincing. Both Sourcerer and the proposed method succeed given the target constraints, and the basic PGD baseline is not compared against (which does not require training a new model). To demonstrate that this method is better at creating adversarial examples, it would be convincing to see the proposed method succeed while PGD and Sourcerer fail for a certain budget.
Questions for authors
- What aspects of this method enable exploration of the energy function? In what scenarios is the method preferable to multi-start gradient descent, and why? To what extent does the method rely on to explore regions separated by energy barriers? How does fitting a target promote exploration of the state space?
- Can the proposed method succeed at generating an adversarial example in a scenario where PGD and Sourcerer fail?