Residual-Aware Output Representations for Scientific Surrogates
Abstract
Scientific surrogates are commonly trained to predict a complete physical response, whereas designs care about performance metrics derived from that response. This creates a distinct failure mode when a design-relevant metric is controlled by a small physical residual recovered through cancellation. We propose the residual-aware output representation method, where the surrogate exposes the small residual as an explicit output coordinate, reconstructs the complete response through an invertible transformation, and retains the original response-space training objective. In radio-frequency passives, exposing dissipation through impedance-like coordinates reduces relative error by on differential inductors and on six-port transformers with minimal change in scattering-response error; it also reduces circuit-level prediction violations. We further validate the proposed method on nanophotonic metasurfaces, reducing relative absorptance error. These results establish residual-aware output representation as a practical approach to cancellation-sensitive scientific problems.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.