Simulate real-world places with Project Genie and Street View

Title: Simulate real-world places with Project Genie and Street View

URL Source: https://deepmind.google/blog/simulate-real-world-places-with-project-genie-and-street-view/

We’re expanding access to Google AI Ultra subscribers globally and introducing a new capability powered by Street View.

Now, we’re taking a leap forward by connecting Genie’s generative power with the real-world imagery of Google Street View, allowing our models to anchor themselves in reality. This expansion of Genie’s capabilities can provide a virtual environment for AI agents or robots to navigate and interact with the complexities of the real world.

Today, we’re launching this new Street View grounding capability within Project Genie, our experimental prototype. With this upgrade, you'll be able to leverage real-world imagery to explore your favorite spots, or reimagine them with a creative twist. We’re also expanding access to Project Genie to more people around the globe.

When creating imaginative worlds in Project Genie, you can now also base them on real places. Just tap the Maps pin to choose a place in the U.S. and optionally select a style for your world, like “Desert Sands” or “Stone Age.” Then, describe your character — like your favorite animal, comic book hero or even a claymation monster — and Genie will use this information to create an imaginative world with its starting location tied to Street View’s real-world imagery. This capability is powered by Maps Imagery Grounding, the same technology developers use to create stunning AI visuals with Street View.

Genie is our general-purpose world model capable of generating diverse, interactive environments. Since launching, Genie has become a foundational tool for research, enabling agents to learn and reason in complex virtual settings and even helping Waymo simulate hyper-realistic road environments.

Select the “Ocean World” style to scuba dive with schools of fish around places grounded in the real world.

Want to see the Golden Gate Bridge under the sea? Select the “Ocean World” style to scuba dive with schools of fish around the bridge. Or, if you want to explore what the iconic Fort Worth Stockyards in Texas might have looked like in the 1920s, select the “B&W film” style to see a world with saloons, vintage cars and trading posts.