The kit consists of a head strap with four cameras, two wrist bands, three motion sensors worn at the waist and on the legs, and a pair of tactile gloves. It records what the wearer sees, the position of their hands, the pressure of their fingers on objects and the movement of their whole body.
The company gives the example of making a bed: the wearer must grasp the corner of the duvet, raise both arms to unfold it, then walk along the bed and smooth out the creases. According to the company, a camera worn at eye level struggles to capture torso and leg movements outside its field of view, and cannot measure how hard a person pulls on the fabric.
In-house software then splits the recordings into individual gestures, annotates them and maps the human movements onto the robot's body, the company explains.
PHANES AI was founded by Yang Shuo, a professor at the Harbin Institute of Technology (Shenzhen campus). The start-up wants to build models that let humanoid robots move and handle objects with agility.
Source
- 雷峰网 Leiphone · leiphone.com