SimulationBrief
With Genie 4, DeepMind simulates an Apollo humanoid playing a board game in real time
Google DeepMind presented its Genie 4 model on 27 October. It generates controllable simulated worlds in real time, with image and sound.
In the demonstration published by DeepMind, the Apollo humanoid from the company Apptronik plays a board game. The robot and the game are simulated in real time, step by step, by Genie 4 and another Google model, Gemini 4 Argon.
Argon breaks the task requested by the user into steps. It then passes these steps to Genie 4 as short written instructions, and Genie 4 moves the scene on to complete the task. According to the Japanese site Robotstart, this type of tool could be used to build training environments for robots.
Genie 4 does not generate only the image. It also produces the music, the ambient sounds and the characters' dialogue, at the same time as the simulated world.
The model still has limits. In a short session, the setting stays consistent. When the simulation runs for longer, or is changed often, details of the image shift and some objects do not stay in place.
For now, only testers chosen by Google can use Genie 4, in the form of a trial version restricted to research.
Source
- ロボスタ Robotstart · robotstart.info