acceptodds
Under review as a conference paper at ICLR 2027

Solving Robust POMDPs with Omega-regular Objectives via Partially Observable Stochastic Games

Abstract

Robust POMDPs (RPOMDPs) generalize classical POMDPs to the setting where exact transition probabilities are not known - rather, they are only known to belong to some uncertainty set of values. In this work, we study the problem of solving RPOMDPs with general -regular objectives, which subsume a broad class of objectives such as reachability, safety, and linear temporal logic (LTL) objectives. We show that, for -rectangular RPOMDPs with polytopic uncertainty sets, the problem of solving RPOMDPs under -regular objectives can be reduced to solving partially observable stochastic games (POSGs) under -regular objectives. Moreover, we show for the first time that reductions can be constructed in both directions, establishing the semantic equivalence between -rectangular RPOMDPs with polytopic uncertainty sets and POSGs. This allows us to derive a range of new computational complexity results, including both upper and lower complexity bounds, on solving RPOMDPs with different -regular objectives. As a corollary, we also derive new computational complexity results for RMDPs.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.