Mine Odyssey: Benchmarking Spatial Agentic Intelligence in the Wild

Advances in foundation models are driving efforts to introduce agents to assist people in the physical world. Such agents require agentic spatial intelligence: exploring unfamiliar environments, updating spatial understanding through interaction, and adapting actions based on feedback to sustain progress toward a sequence of goals. Evaluating these capabilities requires environments that reflect the diversity and structural complexity of real-world places, yet existing benchmarks typically cover only a limited range of spatial layouts, scales, and traversal requirements. To address this gap, we introduce Mine Odyssey, a benchmark for evaluating agentic spatial intelligence using Minecraft reconstructions of real-world locations. It comprises 180 tasks covering 30 such locations across 20 countries and regions on five continents, including 20 outdoor and 10 indoor settings. These settings are selected to provide broad coverage across spatial scales, layouts, terrains, and connectivity patterns, ranging from the urban streets of Midtown Manhattan to the rural Entrup, and from the steep terrain of Santa Luc´ıa Hill to Buckingham Palace. Within each reconstruction, we select meaningful locations as waypoints (e.g., historic landmarks, buildings, and rooms) and manually verify their accessibility. Each task provides a natural-language instruction specifying which waypoints to visit and in what order. Completing these tasks requires agents to find accessible routes and entrances, open doors, and move between levels using stairs and ladders, while monitoring their progress and recovering from navigation errors. Across eight evaluated state-of-the-art models, GPT-6 Astra achieves the highest success rate of 85.6%. However, the second-best model, Claude Opus 5, completes only 50.6% of tasks, while the strongest evaluated open-weight model, DeepSeek-V4.1-Flash, reaches 23.9%, highlighting substantial room for improvement in the agentic spatial intelligence of current models. Comprehensive analyses and ablation studies on Mine Odyssey reveal current models’ limitations and provide insights for advancing agentic spatial intelligence.