acceptodds
Under review as a conference paper at ICLR 2027

When Do Low-Dimensional Probes Help Multiobjective Optimization?

Abstract

Large-scale multiobjective optimization must explore hundreds or thousands of decision variables under limited evaluation budgets, making broad coverage of the decision space impractical. Low-dimensional probes address this challenge by concentrating evaluations on structured candidate families. Yet terminal performance alone cannot reveal why probing helps. Gains may come from representation, additional queries, or candidate retention, and conflating these effects can misattribute improvements and obscure both the underlying bottleneck and how probing should be improved. We study these effects through a controlled shared-scalar probe embedded in a fixed multiobjective search backbone. Our analysis identifies when a single scalar block is sufficient, separates finite-grid error from a representation-induced floor, and shows that identical nondominated decision sets need not imply identical population states. Under a fixed budget, additional probe queries can improve the evaluated candidate pool but reduce evaluations available for downstream search. We further separate losses from withholding evaluated candidates and finite-population selection, while matched-budget and matched-query comparisons distinguish query value from retention value. Across 64 benchmark configurations, additional-query value varies substantially with problem structure. Targeted controls further support retaining paid alternatives more consistently than the tested adaptive placement strategy.

Primary area:
optimization
Keywords:
Large-scale multiobjective optimization, Low-dimensional probing, Evaluation budget allocation

Reviews

Among:
Shape:
1234this paper, Bottom 10%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.67 over 3 reviews, above 10% of the others.
Reviewer_6skPOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper investigates when low-dimensional probing benefits large-scale multi-objective optimization by separating three interacting factors: representation geometry, query allocation, and candidate retention. It develops analytical results for a shared-scalar probe, including a representation-induced error floor, sufficient conditions for single-block dominance, and a decomposition of retention losses. Controlled experiments across 64 benchmark configurations suggest that the value of additional probe queries is problem-dependent, while retaining already-evaluated candidates can provide more consistent improvements than the tested adaptive query-placement strategy. The study is carefully executed and offers useful diagnostic insights. However, its theoretical results are relatively elementary and restricted to a specialized probe construction. Moreover, the empirical findings are largely tied to a single optimization backbone and short evaluation budgets, limiting their broader significance.

Critical strengths
  • S1. Well-motivated decomposition of low-dimensional probing mechanisms. The paper clearly distinguishes representation limitations, the opportunity cost of additional queries, and losses caused by withholding or selecting evaluated candidates. This decomposition provides a useful perspective for understanding why low-dimensional probing succeeds or fails, beyond conventional comparisons of terminal optimization performance (Sections 2–3).
  • S2. Rigorous controlled experimental design. The matched-query comparisons between Scan and All-scan preserve the evaluated probe candidates, evaluation costs, and pre-injection states, enabling a meaningful investigation of candidate-offering effects. The inclusion of dominance-safe block selection, fixed-grid controls, and shared-normalization interventions further strengthens the experimental methodology (Sections 4.2–4.3).
  • S3. Extensive empirical evaluation and statistical analysis. The main study considers 64 benchmark configurations with 20 paired runs per configuration. The authors report both retrospective archive and final-population metrics, employ multiple-comparison corrections, and provide additional sensitivity analyses. These efforts improve the credibility and interpretability of the empirical findings (Section 4 and Appendices D–F).
Critical weaknesses
  • W1. Limited theoretical novelty and generality. The weighted-variance decomposition in Equation (2) follows directly from the standard bias-variance identity, while Proposition 1 relies on a common-minimizer condition that makes block dominance relatively immediate. Similarly, Proposition 2 largely follows from elementary Pareto dominance properties. Although these results are mathematically valid under their stated assumptions, they provide limited new theoretical insight beyond the particular shared-scalar construction. A stronger contribution would establish more general conditions or nontrivial performance guarantees for broader classes of low-dimensional probes.
  • W2. Restricted empirical generalizability. The main experiments rely on a single optimization backbone, with a fixed dimensionality of , population size , and evaluation budget of 1000 function evaluations. Although 64 configurations are included, many are related benchmark variants or deterministic transformations rather than independent problem families. Consequently, it remains unclear whether the conclusions extend to different population-based optimizers, other dimensionalities, more diverse Pareto-front geometries, or real-world black-box optimization tasks.
  • W3. The retention advantage is sensitive to the evaluation budget. The results in Appendix D.6 show that the empirical advantages of All-scan over Scan become substantially less consistent at larger budgets. In the five-case budget-sensitivity study, the Archive ND win/unresolved/loss counts change from 3/2/0 at 1000 evaluations to 0/5/0 at both 5000 and 10000 evaluations. This raises questions about whether candidate retention represents a persistent optimization advantage or primarily benefits the early stages of search under severely limited budgets. A broader budget-dependent analysis would substantially strengthen the conclusions.
  • W4. The mechanisms underlying long-term retention benefits remain insufficiently identified. Although the matched-query design isolates the intervention on candidate offering, changing the offered pool also affects environmental selection, population composition, and downstream search trajectories. The shared-normalization and population-state controls address several confounding factors, but the detailed causal investigations are concentrated primarily on DTLZ2. The supplementary state interventions also leave most individual-factor contrasts statistically unresolved. Thus, the evidence supports a composite retention-policy effect more strongly than a general causal explanation of the mechanism responsible for terminal improvement.
  • W5. Limited evidence of practical superiority over established optimization methods. The external comparisons in Appendix F.4 cover only five selected benchmark configurations and three established optimizers. Moreover, some external methods have not completed their core optimization stages at the smallest evaluation budget, making direct comparisons difficult to interpret. While the authors appropriately acknowledge these limitations, stronger evidence is needed to establish the practical significance of the proposed diagnostic conclusions relative to existing large-scale multi-objective optimization approaches.
  • W6. Presentation could be more concise and focused. The paper introduces numerous policies, metrics, intervention variants, and statistical comparison families, many of which require extensive appendix material to interpret. This makes the central scientific message somewhat difficult to distinguish from implementation-specific observations. A clearer synthesis of the main conclusions, their assumptions, and their practical implications would improve accessibility.
Questions for authors

Q1. Generalizability across optimization backbones. The empirical evaluation primarily relies on a single optimization backbone. To what extent do the observed advantages of retaining already-evaluated candidates depend on the specific environmental selection and population-update mechanisms? Would similar retention benefits be expected under alternative multi-objective evolutionary algorithms, such as NSGA-II or MOEA/D?

Q2. Budget sensitivity of retention benefits. The larger-budget experiments in Appendix D.6 show that the statistically significant advantages of All-scan over Scan become substantially less consistent at 5,000 and 10,000 function evaluations. How do the authors interpret this attenuation? Does it suggest that candidate retention is primarily beneficial during the early stages of optimization, rather than providing a persistent advantage throughout the search?

Q3. Novelty and practical implications of the theoretical analysis. The weighted-variance decomposition and dominance-based propositions appear to follow relatively directly from established mathematical properties. Beyond explaining the behavior of the specific shared-scalar probe, can the authors clarify what new theoretical insights these results provide? In particular, could the analysis lead to an actionable criterion for determining when additional queries or multiple-block retention should be preferred?

Q4. Causal interpretation of population-state effects. The DTLZ2 experiments demonstrate that identical nondominated sets and zero immediate retention gaps can coexist with different terminal outcomes. However, the contributions of population composition, dominated-solution quality, and ordering remain difficult to disentangle, despite the supplementary interventions. Can the authors provide further evidence identifying which aspects of population state are primarily responsible for the observed terminal improvements?

Q5. Sensitivity to probe representation and coordinate selection. The theoretical guarantees rely on assumptions about the scanned coordinates and common objective minimizers, whereas the actual optimizer uses a data-driven coordinate-screening procedure. How sensitive are the empirical conclusions to inaccuracies in the preserved-coordinate set and the choice of anchors? Can the authors more explicitly connect the screening-failure analyses to the conditions under which the proposed theoretical results remain informative in practice?

Q6. Fairness and scope of external-method comparisons. Appendix F.4 includes comparisons against established large-scale multi-objective optimization methods, but some external algorithms do not complete their core optimization stages within the smallest evaluation budget, and certain runs exceed the nominal budget. How should these comparisons be interpreted when assessing practical competitiveness? Could the authors clarify which conclusions remain supported when considering only budgets at which the compared algorithms have completed their principal optimization mechanisms?

1 comment

Thank you for your review about the problems of this paper. We ran new experiments on NSGA-II and at larger scales (D=5000, M=5), and summarized our ablation and stage-completion data. The results show that (1) the benefit of retaining all evaluated candidates generalizes to NSGA-II and to D=5000, M=5; (2) candidate retention acts mainly as an early-stage boost under tight budgets; (3) the theoretical propositions provide simple checks for stopping extra queries and keeping non-dominated blocks; (4) the DTLZ2 performance gain comes from the combined population state rather than a single isolated factor; (5) screening errors degrade performance when extra distance variables are fixed or true position variables are missed; and (6) at 10000 FE where all external methods complete their core stages, WOF and LSMOF win on GLSMOP1 while our methods remain competitive on the other four problems.

W2 & Q1 Due to the character limit, please refer to the response to Reviewer 1.

W3 & Q2 Probing and candidate retention happen only once right after initialization (120 or 160 FE). At 1000 FE, only 7 to 8 evolutionary generations follow, so the initial retained candidates strongly affect the output. At 5000 and 10000 FE, standard evolutionary search runs for 47 to 98 generations and gradually dominates the trajectory, reducing the impact of that single early injection.

W1 & Q3 This paper aims to separate when probing is limited by subspace geometry versus candidate selection, which directly gives a practical criterion for both query allocation and multi-block retention. Because finer 1D sampling only reduces grid error until it hits the representation floor (Equation 2–3) and gives zero discovery gain once a common optimal step size is evaluated (Proposition 1), an algorithm can check whether coarse steps improve the score over the midpoint q=0.5. If the score gain is zero (359/360 GLSMOP runs in Appendix F.2), extra queries should be skipped to save the remaining FE budget for evolution.

W4 & Q4 All-scan has 43.45 dominated probe members per run with a mean distance g of 4.62, while Safe's dominated members all come from initialization with a mean g of 82.80 (Table 2 and Table 10). The table gives the Safe/All-scan mean IGD ratios at 1000 FE:

Comparison on DTLZ2Archive ND Ratio [95% CI] (pHp_H)Native ND Ratio [95% CI] (pHp_H)
Safe/All-scan, pool-based normalization1.106 [1.061, 1.155] (0.0040)1.132 [1.074, 1.190] (0.0040)
Safe/All-scan, shared normalization1.120 [1.078, 1.164] (0.0004)1.156 [1.108, 1.202] (0.0002)
Safe reference state/All-scan population1.180 [1.143, 1.213] (<0.0001)1.161 [1.118, 1.204] (0.0002)

In Appendix E.5, replacing the whole dominated pool with the All-scan population improved both metrics significantly. Changing single factors one by one (reducing the distance g of dominated solutions, shifting coordinates, or changing row order) was not statistically significant. The improvement comes from the combined effect of dominated-solution quality, coordinate structure, and velocity state.

Q5 Theoretical results depend on the coordinates actually chosen by the screen. When the screen keeps extra distance coordinates (Appendix F.3), fixing 98 variables at anchor values increases the constant term CamC_{am} in Equation 2 and gave much worse IGD than using only the 2 position coordinates. Conversely, when the screen misses true position coordinates (Appendix D.4), overwriting missed positions with the shared scalar qq creates conflicting optima across anchors, so the single-block condition in Proposition 1 no longer holds.

W5 & Q6 Archive ND uses the exact first B evaluations from each method, while Native ND uses the final population at termination. Because WOF and LSMOF need more than 1000 FE to finish their first weight-optimization stage, the 1000-FE results only describe their evaluated prefixes before that stage finishes. The table shows how many runs finished their first core stage by each budget, and the Archive ND results at 10000 FE across the five cases and two internal references.

External methodBy 5000 FEBy 10000 FEActual FE at 10000-FE10000-FE Archive ND
WOF92/100100/10010002–110518/0/2
LSMOF100/100100/100100008/0/2
LMOCSO100/100100/10010000–100814/6/0

When looking only at 10000 FE (where all external methods finished their core stages in all 100 runs), the 30 comparisons give 20 internal wins, 6 unresolved tests, and 4 external wins. All 4 external wins came from WOF and LSMOF on GLSMOP1, while our internal methods stayed competitive on the other four cases.

W6 We will rewrite the main text using standard MOO terms, explain Archive ND and Native ND in plain words when they first appear, and keep secondary ablation variants and detailed test families in the appendix.

Reviewer_zKa4OpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

This paper deals with large-scale multi-objective problems with hundreds/thousands of decision variables, under limited evaluation budget settings. It aims to use low-dimensional probes to concentrate evaluations on structured solution groups.

Critical strengths

It works on an interesting and relevant problem and tries to consider low-dimension probing for high-dimensional search space under limited budget settings.

Critical weaknesses

A critical issue of this work is that it was written in a strange way that it is hard for the reader to understand. As someone working in the multi-objective optimization field for quite a while, I find it really hard to understand what the paper is trying to propose or claim. Many sentences, phrases, words sound perculiar to me, for example, in Abstract 'Targeted controls further support retaining paid alternatives more consistently than the tested adaptive placement strategy', and in Introduction 'Dominance-safe block selection, equal-cost query-placement controls, and shared-normalization controls'. I really don't like such terms, phrases (making easy things complex), and I suspect they are likely to be generated by AI.

I do like the topic, but not the presentation of the motivation. From Introduction, I really can't see why this is an important research problem, what challenges are over there, and how this motivates your work.

Questions for authors

I don't have questions for the authors to answer, but I believe the paper needs an overhaul. My suggestion to the authors is to rewrite the paper using the terminologies in the field (not throw it into AI), explain the importance of the research problem, and the gap that motivates your research, present the work that is clear and easy for the reader to understand.

2 comments

Thank you for your feedback. Please rest assured that this work was written by the human authors.

The phrasing in the paper is difficult to read largely because I mistakenly thought that piling up formal noun phrases would make our writing more rigorous as non-native English speakers. As mentioned in the AI Use Statement, I used AI to polish the language and condense long sentences, which made simple concepts sound complex.

Furthermore, I used words from statistics and experimental design when naming concepts. This deviated from the standard vocabulary in MOO and made this paper unnecessarily obscure.

Regarding the last sentence of the abstract "Targeted controls further support retaining paid alternatives more consistently than the tested adaptive placement strategy", because this paper contains many experiments, I put the internal experimental labels directly into the abstract to save space. This sentence means: Our ablation experiments show that during the 1D search, we can pass all evaluated solutions into environmental selection instead of keeping only one. This improves performance more consistently than using an adaptive step-size strategy.

I will improve the paper writing in the revised version.

Thank you for your reply. I am sorry but my point the paper needs an overhaul before being considered for publication is unchanged. I keep my original rating.

Reviewer_trbNOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
2
Soundness
1
Read review
Paper summary

This paper investigates the effectiveness of low-dimensional probes in multiobjective optimization. The research question is important, the experimental design is reasonably rigorous, and the authors provide theoretical analyses to support their findings.

Critical strengths
  • The research question is important. The paper investigates the key factors that influence the effectiveness of low-dimensional probes in multiobjective optimization.
  • The experiments are well-designed and relatively comprehensive.
Critical weaknesses
  • Some theoretical results rely on specific assumptions. It remains unclear whether these findings can be generalized to a broader range of multiobjective optimization problems.
  • The experiments are conducted within a single multiobjective evolutionary search framework. Although this design allows for controlled comparisons, the findings may depend on the specific search and selection mechanisms. Further validation using different multiobjective evolutionary algorithms is lacking.
  • The experiments are mainly conducted on synthetic benchmark problems, without validation on real-world applications.
Questions for authors
  • Could the main findings be affected by the choice of multiobjective evolutionary search backbone? Would similar conclusions hold when using different multiobjective evolutionary algorithms?
  • Do the main findings still hold for problems with more than three objectives or higher-dimensional decision spaces, such as those with 5,000 or more decision variables?
1 comment

Thank you for your comments on the generality of our findings across different evolutionary backbones and larger problem scales. To test whether our conclusions hold beyond the original setup, we ran new controlled experiments by embedding our exact probing policies into NSGA-II and scaling the benchmark tests to D=5000 and M=5, and testing four real-world problems from the RE engineering suite. Retaining all evaluated probe candidates consistently improves optimization quality under NSGA-II and at higher dimensions/objectives. The retention effect varies across real-world problem geometries and outputs.

W1 & Q1

We test the exact same probing policies into NSGA-II and compared it against the original backbone on LSMOP1 and GLSMOP6 (M=3, D=1000). The table below reports the ratio of mean IGD (Scan / All-scan), where ratios>1 favor All-scan:

ConfigurationBackboneArchive ND IGD Ratio (pHp_H)Native ND IGD Ratio (pHp_H)
LSMOP1 (M=3, D=1000)Original1.222 (<0.0001)1.374 (<0.0001)
LSMOP1 (M=3, D=1000)NSGA-II1.015 (1.0000)1.791 (0.0030)
GLSMOP6 (M=3, D=1000)Original2.327 (0.1934)2.387 (0.1934)
GLSMOP6 (M=3, D=1000)NSGA-II2.711 (0.0100)2.746 (0.0106)

Retaining all evaluated candidates continues to improve optimization performance under NSGA-II. Passing all evaluated blocks provides a broader set of solutions for crowding-distance selection, making the retention advantage statistically significant on GLSMOP6 for both metrics and producing a larger Native ND gain on LSMOP1 (1.791 and 1.374).

W2 & Q2

We test LSMOP1 (D=5000,M=3) and DTLZ2 (M=5, D=1000) on the original backbone.

ConfigurationComparisonArchive ND IGD Ratio (pHp_H)Native ND IGD Ratio (pHp_H)
LSMOP1 (M=3, D=5000)Scan / All-scan1.115 (0.0549)1.190 (0.0002)
DTLZ2 (M=5, D=1000)Scan / All-scan1.072 (1.0000)1.317 (<0.0001)
LSMOP1 (M=3, D=5000)Midpoint / Scan1.179 (0.0237)1.095 (0.2643)
DTLZ2 (M=5, D=1000)Midpoint / Scan1.053 (1.0000)0.836 (<0.0001)

Candidate retention (Scan / All-scan): At both D=5000 and M=5, All-scan continues to significantly improve final population quality. Extra probe queries (Midpoint / Scan): The method improves archive quality on LSMOP1 (D=5000) where optimal scalars vary across anchors. On 5-objective DTLZ2, q=0.5q=0.5 is already the common optimum (Δdisc=0\Delta_{\text{disc}}=0) and the anchor count increases from 16 to 20, extra scanning reduces the budget available for downstream evolution and degrades final-population quality relative to Midpoint.

W3

We compared Scan and All-scan on three continuous problems from the RE engineering design suite at 1000 FE.

RE engineering benchmarkMArchive ND IGD Ratio (wins)Native ND IGD Ratio (wins)
RE31, two-bar truss31.016 (4/5)0.991 (3/5)
RE32, welded beam31.918 (3/5)0.889 (3/5)
RE34, vehicle crashworthiness31.774 (4/5)2.004 (5/5)

All-scan reduced mean IGD on both outputs for RE34 and on Archive ND for RE31 and RE32. These results show that the retention effect varies across real-world problem geometries and outputs.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.