- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Self Regeneration Controlled Diffusion Evolution, an inference-time search method for diffusion based symbolic regression that extracts trajectory-level perturbation directions by comparing original diffusion trajectories with self regenerated trajectories conditioned on candidate expressions. These perturbations are injected into the following denoising steps, while a population based evolutionary search procedure uses black box fitness evaluations and recipient specific donor selection to iteratively improve generated expressions without retraining the diffusion model. The method is evaluated on 73 symbolic regression benchmarks and 18 tasks comparing trajectory level guidance against endpoint optimization and randomized perturbation strategies.
Critical strengths
- Against the baselines compared against, the proposed method achieves convincing empirical results outperforming several established approaches.
- This paper includes useful ablation experiments comparing full trajectory level guidance against endpoint only optimization and randomized perturbations. This is helpful and important.
- This method works with black box fitness evaluation and does not require differentiating through a symbolic expression evaluator. This is appealing for practical use cases and potentially applicable to other discrete optimization problems.
Critical weaknesses
- Although the paper includes several symbolic regression and endpoint-search baselines, it lacks comparisons against alternative diffusion-based evolutionary search methods and simpler trajectory-level perturbation strategies. This is a critical limitation.
- SR-CDE requires repeated self-regeneration and multiple controlled denoising rollouts, resulting in considerably higher computational costs than the endpoint-search baselines. Without comparisons under matched computational budgets, it is difficult to determine whether the reported performance improvements arise from the proposed search mechanism or the additional computation.
- The proposed method combines several established ideas, including diffusion-based inference-time guidance, black-box optimization, and evolutionary search. This paper is very incremental with respect to the prior work.
Questions for authors
- Could the authors include comparisons against simpler trajectory-level perturbation strategies, such as differences between independently generated trajectories without self-regeneration, or diffusion-based evolutionary mutation approaches? These comparisons would help establish whether self-regeneration provides meaningful advantages over alternative methods for constructing search directions.
- There would additionally be immense benefit for the authors to provide additional ablations isolating the contributions of recipient conditioned donor selection, Pareto based matching, and population based evolution, for example how the proposed approach perform with random donor selection or simpler trajectory similarity based matching.
- Provided the higher computational cost of SR-CDE compared with the endpoint-search baselines, how would the reported performance improvements change under matched computational budgets?