The authors had a real Unitree G1 perform dance, fight and walking motions generated by their method. They also had it perform a 35-second sequence that moves from fighting to dancing.
According to the researchers, controlling a robot with velocity commands works well for four-legged robots. For a humanoid that has to move its whole body in complex ways, this kind of command becomes too limited.
Their method produces compact descriptions of motion. A high-level controller generates them from a behaviour label or a written command.
At matched capacity, their tool reconstructs the G1's movements better than two state-of-the-art methods, FSQ and VQ-VAE, the authors say.
Source
- arXiv (cs.RO, robotics) · arxiv.org