acceptodds
Published as a conference paper at NeurIPS 2026

Robust PAC Learning of Concurrent Stochastic Games

Angel Y He, David Parker

Abstract

We introduce the first Probably Approximately Correct (PAC) learning framework for general-sum concurrent stochastic games (CSGs) with transition uncertainty, while addressing the challenge of Nash equilibrium (NE) existence. Our algorithm maintains data-driven confidence sets over transition kernels and solves a robust CSG to compute a social-welfare optimal -NE, using a novel robust MDP-based exploration mechanism to drive joint state-action coverage without unilateral control. Crucially, we introduce a Nash margin characterisation that enables principled reasoning about equilibrium existence: the framework either returns an -approximate NE whose social-welfare value is -close to optimal, or provides a sound certificate that no exact NE exists. Under a minimum reachability condition over all state-action pairs, the algorithm terminates after a polynomial number of interactions, with sample complexity . Empirical results on benchmark CSGs demonstrate near-optimal performance, correct handling of equilibrium (non-)existence, and sample complexity consistent with theory; implementation available at: https://anonymous.4open.science/r/pg1.

Related papers

See more related submissions when the market opens.