From dance to kung fu, an agile robot learns and adapts, a feat of Sim2Real

The meteoric rise of the humanoid robot G1, designed by the Chinese company Unitree, continues to captivate the world of robotics. From graceful agility in dance to impressive mastery of kung fu, the G1 demonstrates an unprecedented learning and adaptation capability, propelling Sim2Real technology into new horizons.

A remarkable progression: from the dancefloor to the dojo

The first videos of the G1 showed it executing complex dance movements with surprising fluidity. This demonstration of agility and balance quickly gave way to a new feat: mastery of martial arts. Recent videos of the G1 showcase it chaining punches and roundhouse kicks with remarkable precision and stability. This radical transformation illustrates the effectiveness of the improvements made to the robot’s algorithm, allowing it to assimilate and execute increasingly complex movements.

Sim2Real: the secret of accelerated learning

The key to this spectacular evolution lies in Sim2Real technology. The G1 is trained in a sophisticated virtual environment, the Nvidia Isaac simulator, where it learns to replicate observed human actions through motion capture and video data. These behaviors are then refined through reinforcement learning in the virtual world. Finally, the Sim2Real process enables the transfer of these skills acquired in simulation to the physical robot, allowing it to execute the same movements in the real world. This innovative approach significantly accelerates the learning process, enabling the G1 to acquire new skills at a sustained pace.

OpenAI: here is GPT-4.5, the new AI with enhanced intelligence and intuition, details and uses.

A robot designed for complex tasks

Unitree does not simply equip the G1 with acrobatic capabilities. The company aims to make this robot a versatile companion, capable of operating in various environments such as factories, hospitals, or even homes. With its 23 degrees of freedom and improved stability, the G1 is designed to perform complex, repetitive, or dangerous tasks. However, the company emphasizes the necessity of using the robot responsibly, avoiding any modifications that could turn it into a fighting machine.

To accelerate the development of humanoid robotics, Unitree has chosen to share its advances with the community. The company has published an open-source dataset on full-body movement, allowing researchers and enthusiasts to explore new possibilities. This dataset, based on LAFAN1 motion capture technology, enhances the flexibility and coordination of robots, enabling them to imitate human movements with greater precision. This initiative reflects Unitree’s commitment to fostering collaboration and accelerating innovation in the field of humanoid robotics.