Google’s AI Genie 2 brings images to life by transforming them into playable 3D worlds 

Stay Informed

Get Industry News In Your Inbox…

Sign Up Today

Search giant Google has unveiled its AI tool Genie 2, which can generate a wide range of action-controllable, playable 3D environments from single image prompts. 

According to the Deepmind report, Genie 2 can create various perspectives, such as first-person, isometric, or third-person views, and produce complex 3D scenes with interactive elements like doors and explosive barrels.

Genie 2 can also prototype physics effects like smoke, gravity, lighting, and reflections, which can be played by both humans and AI agents using a keyboard and mouse. 

Google said the AI tool will  enable artists and designers to accelerate the prototyping process which “can bootstrap the creative process for environment design, further accelerating research.”

The role of games in advancing AI research

“Games play a key role in the world of artificial intelligence (AI) research,” the report explained. “Their engaging nature, unique blend of challenges, and measurable progress make them ideal environments to safely test and advance AI capabilities.” 

“Thanks to Genie 2’s out-of-distribution generalisation capabilities, concept art and drawings can be turned into fully interactive environments. This enables artists and designers to prototype quickly, which can bootstrap the creative process for environment design, further accelerating research.

“While this research is still in its early stage with substantial room for improvement on both agent and environment generation capabilities, we believe Genie 2 is the path to solving a structural problem of training embodied agents safely while achieving the breadth and generality required to progress towards AGI.”