acceptodds
Published as a conference paper at NeurIPS 2026

Ordinal Geometry Complements Reconstruction: Diagnosing Planning with Compressed Value Functions

Shiheng Zhang

Abstract

Goal-conditioned planning requires compressing value functions into low-dimensional representations, yet which property of the compression best predicts planning quality remains unclear. We show that reconstruction accuracy and ordinal fidelity—how faithfully the ranking of successor states by value is preserved—are two projections of the same approximation error: in smooth geometry they couple tightly and is a sufficient summary; when topology creates dense small-gap regions they decouple, and the ordinal projection carries complementary planning-relevant information beyond . Through experiments on gridworld, continuous navigation (640 runs, 8 environments), and Maze2D (240 runs, 3 D4RL layouts), we establish three results. First, neighbor-restricted ordinal fidelity () adds of incremental explanatory power beyond after environment fixed effects. Second, monotone recalibration degrades by up to while preserving and planning success. Third, in matched-pair comparisons controlling for , higher predicts better planning 76% of the time. We provide theoretical grounding via a gap-weighted Bellman-excess decomposition that links reconstruction error, local ordinal inversions, and planning regret.

Related papers

See more related submissions when the market opens.