- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes RIME, which integrates surrogate-assisted MetaBBO with a task-conditioned world-model. Global and local reliability gates determine whether predicted optimizer transitions are used for Double-Q updates, while uncertainty controls the rollout horizon. RIME shows competitive average ranks on BBOB and UAV tasks, but its methodological necessity and computational benefits remain to be demonstrated.
Critical strengths
- This paper studies an interesting problem of improving the transferability of learned black-box optimizers.
- The task encoder, controller, and world model form a pipeline.
Critical weaknesses
-
The motivation for introducing a world model is partially established. Stage-II interactions already use a learned objective surrogate, so the world model replaces relatively cheap surrogate-based transitions rather than expensive objective evaluations.
-
RIME introduces additional cost, including surrogate pretraining, a three-member world-model ensemble, world-model updates, uncertainty estimation, and gate tuning. The paper shows only deployment evaluation budgets and does not compare training time, GPU cost, memory, or total optimization-system cost against other MetaBBO methods.
-
The design principles behind the objective surrogate, 15-action space, nine state features, binary reward, and 50-query support set are insufficiently justified. Most choices are inherited or manually specified, without showing that the resulting state is Markov-sufficient or that these choices are reasonable.
-
The world-model design is similarly heuristic: it predicts changes in nine aggregate statistics using Huber and binary cross-entropy losses, followed by fixed clipping, loss thresholds, disagreement thresholds, and a hand-designed horizon rule. Since predicted statistics need not correspond to any realizable population, the imagined optimizer states may be internally inconsistent.
-
The low-dimensional results are insufficient to establish a meaningful optimization advance. Although 20D and 30D are evaluated, RIME loses its aggregate lead on the complete BBOB suite at these dimensions, and strong optimizers such as CMA-ES, SHADE, and L-SHADE are absent.
-
The comparison should include both learning-based and task-free alternatives, particularly Pretrained Optimization Model for Zero-Shot Black Box Optimization and Task-free Adaptive Meta Black-box Optimization. Their inclusion is important for evaluating whether RIME’s offline training distribution, support-set evaluations, and additional modeling complexity are justified.
Questions for authors
- What expensive operation does the world model actually save after Stage II already replaces the original objective with a surrogate?
- Can the authors show total training time, GPU hours, model parameters, memory, and performance under matched computation?
- What principles determined the action space, state features, binary reward, support-set size, uncertainty thresholds, and rollout rule?
- How do the authors verify that an imagined nine-dimensional state corresponds to a realizable DE population?
- Does RIME remain competitive against CMA-ES, SHADE/L-SHADE, POM, and task-free MetaBBO on substantially higher-dimensional problems?