From Atari to EVE Online: Building on 15 Years of AI Research in Games

From Atari to Go to StarCraft, games have driven some of the biggest breakthroughs in AI. Now, we’re partnering with game developers to prototype new gameplay experiences that push the frontiers of both gaming and AI.

Since DeepMind’s foundation in 2010, the constrained yet rich worlds of games have played a critical role in understanding intelligence. They have driven some of our biggest AI breakthroughs, from mastering Atari to helping solve protein structure prediction - and they are still at the heart of what we do.

Gaming is in GDM’s DNA. Demis Hassabis, one of Google DeepMind's founders, is himself a former game developer, as are many of us in the GDM team. Together, we have decades of hands-on experience in game development and a deep respect for the craft of making games.

Our journey began when a small team trained a deep neural network to play Atari 2600 games directly from raw pixels. The Deep Q-Network (DQN) learned to play 49 different games — from Pong to Breakout to Space Invaders — without any game-specific engineering. The 2015 Nature paper on DQN helped catalyze the modern era of deep reinforcement learning.

Furthermore, EVE Frontier — with its programmable "Smart Assemblies” and its open, extensible architecture — offers an open-ended environment where the very rules of the world can change, demanding agents that adapt to entirely new game mechanics.

We are aiming for the same ultimate goal we always have: AI as a catalyst, not a replacement. Our long-term ambition is to unlock breakthrough gameplay experiences, make games more accessible and more personalized, and — as we've seen from AlphaGo to AlphaFold — apply what we learn in games to problems in the real-world and to advance scientific discovery.

We’ve always been clear that doing AI research with games requires deep partnership with game developers - like our major new research partnership with Fenris Creations and the EVE Universe that we unveiled earlier this year, and the work we’ve done together with acclaimed studios like Hello Games , Coffee Stain Studios , Foulball Hangover and others.

From there, we attempted to master more complex games, with each milestone producing more capable and general systems. AlphaGo defeated world champion Go player Lee Sae Dol in 2016 — a feat many experts thought was still a decade away. AlphaGo Zero surpassed every previous version by learning entirely from self-play, with no human data at all. AlphaZero generalized this approach to master chess, shogi, and Go with one algorithm, while MuZero learned to play without even knowing the rules. In 2019, AlphaStar reached Grandmaster level in StarCraft II , navigating real-time complexity and imperfect information.

For each game, AI enriched the playing experience. AlphaGo's famous Move 37 was a play so unexpected that professional commentators initially thought it was a mistake, overturning centuries of received wisdom in Go and inspiring experts to explore new strategies. AlphaZero similarly inspired entirely new lines of play in chess. Crucially, the spirit of exploration that succeeded in games had profound impacts for other AI systems: AlphaFold applied these foundations to help solve the 50-year grand challenge of protein structure prediction, a breakthrough which was recognized with the 2024 Nobel Prize in Chemistry.