acceptodds
Under review as a conference paper at ICLR 2027

Searching Harder Hurts at a Fixed Budget: The Unreported Candidate-Set Size in Adaptive Collocation

Abstract

Adaptive collocation for physics-informed neural networks picks training points by scoring candidates and keeping the best. Across this literature spans four orders of magnitude and is almost never reported. It is not only a cost knob: keeping the best of is truncation selection at threshold , and the optimism of a maximum grows with the number of items scored, so sets how hard the criterion is optimised. We sweep at a fixed budget of points over shared seeds, against a uniform control re-drawn on the rules' own schedule. Two rules with unrelated scores, a residual magnitude and a training-dynamics score, are both level with that control at and both fail every seed by , on a sharp one-dimensional fit and on a Poisson problem, where that control holds at in : what collapses is the selection form, not the criterion. Published rules that soften that same maximum fail later and less, under , and of thirty analysis choices on the first of those. Let the set grow instead, as the shipped implementation does, and the same rule takes no harm from ; held at a fixed budget of its own final size it fails all seeds of a larger pool again. The harm is searching hard at a fixed budget, not searching hard. Which rules are exposed starts with one question: does selecting a point remove its own score? Necessary, not sufficient: our own arms subtract and collapse anyway; the objective has to be a function of the selected set. The effect survives four times the budget and seventeen times the pool, where the rule whose objective is defined on the selected set stops being immune; a registered attempt at 2,000 points missed its own accuracy gate. Report , and re-draw the control.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.