Q1. What evidence demonstrates that the performance improvements specifically require LLM-based reasoning?
Could the authors compare REP-HO against additional lightweight adaptive allocation strategies, such as cost-normalized uncertainty selection, uncertainty-and-feasibility heuristics, or a simple learned allocation policy using exactly the same input features and budget constraints?
Q2. How much improvement is directly attributable to the adaptive nearest-neighbor context?
Could the authors provide controlled ablations of REP-HO with and without nearest-neighbor context for both LLM backbones, using identical random seeds, benchmark configurations, and evaluation budgets? It would also be informative to evaluate a non-LLM baseline that explicitly uses the same historical information.
Q3. Are the performance differences statistically significant?
Given that several improvements over MFE-NSGA-III are relatively small, could the authors provide paired statistical significance tests or confidence intervals for the differences in HV and IGD+? In particular, which benchmark configurations demonstrate statistically and practically meaningful improvements?
Q4. How does the method handle global budget consistency across multiple LLM calls?
Since each generation is divided into batches of ten candidates, how does REP-HO coordinate budget allocation across different batches? Is the remaining budget updated after each batch, and can the order in which batches are processed influence the final evaluation decisions? Have the authors examined sensitivity to candidate ordering?
Q5. Could the authors clarify the experimental configurations and the evaluation protocol?
Why do the budget values and benchmark problems in Regime 4 differ between Section 3.3, Appendix C.4, and Tables 4 and 11? Additionally, when computing the final HV and IGD+ scores, are all objective and constraint values verified using high-fidelity evaluations, or can surrogate-estimated values remain in the final approximation set? If verification is performed, how is its cost accounted for?
Q6. How does REP-HO scale to larger and more realistic heterogeneous optimization problems?
Could the authors report end-to-end runtime comparisons with the strongest baseline and discuss the impact of increasing the number of objectives, constraints, candidates, and historical evaluations? Experiments involving genuinely expensive evaluations would be valuable for establishing whether the quality improvements justify LLM inference overhead.