#China #Shanghai #Hesai Group #Physical AI #Kosmo

Building the Future of Physical AI with Kosmo

Hesai Group, a leader in Physical AI, has introduced a groundbreaking 3D world data engine called Kosmo. This innovative technology aims to address one of the significant challenges in Physical AI: accessing high-quality real-world data at scale. The Kosmo platform incorporates the world’s first AI spatial camera, Kosmo One, paired with an advanced cloud platform. This combination enables the transformation of physical environments into realistic 3D digital spaces, aiding in robot training, world model development, and immersive content creation.

The Need for Real-World Data in Physical AI

In a world where AI continues to shape various fields, the demand for accurate, affordable, and readily available real-world data is paramount. Shaoqing Xiang, Co-Founder and CTO of Hesai, explained, “Meeting all three requirements has been a persistent problem. Kosmo is designed to overcome that challenge, simplifying the process for AI developers and creators.” The platform effectively turns environments into reusable 3D assets, making them easier to train AI systems on them.

Features of Kosmo One

The Kosmo One camera is a standout component, boasting an 8K ultra-high-definition resolution. This cutting-edge technology merges high-resolution lidar with a specialized imaging sensor, capturing intricate details such as geometry, color, and texture with exceptional precision. With advanced features, including instant scanning and intelligent guidance, a typical indoor space of 100 square meters can be scanned in about 15 minutes. Furthermore, data processing is impressively swift, producing high-quality 3D models five times faster than competing products.

Transforming Training for Embodied AI

The Kosmo World platform offers a comprehensive approach to 3D content creation, converting raw data into simulation-ready environments for embodied AI training. This is illustrated through a deployment at a Dairy Queen ice cream store, where the Kosmo platform enabled significant reductions in setup time from 300 hours to just 15 minutes. The Sharpa robot operating in this space achieved a remarkable 99% task success rate, illustrating the platform’s effectiveness in real-world applications.

Developing World Models with Precision

In addition to training environments, Kosmo serves as an essential tool for developing world models. Its precise 3D scenes provide developers with necessary references for creating realistic virtual environments. This platform can generate over 10,000 training trajectories from a single capture, increasing the efficiency of data acquisition dramatically.

A Multitude of Applications Across Industries

Beyond its applications in embodied AI training, Kosmo is making waves in various sectors, including film and media, cultural tourism, and spatial commerce. It allows filmmakers to capture locations once and reuse them across different phases of production. For instance, projects that would traditionally take two months to construct can now be scanned and edited in just a week, resulting in significant cost savings.

In cultural tourism, Kosmo has been employed to create digital representations of historical sites, ensuring their preservation for future generations. Collaborating with organizations like TRIC, Hesai aims to provide immersive experiences that can be accessed globally.

Navigating the Future of Commerce

Through a partnership with Amap, Kosmo is enhancing location services by offering interactive 3D environments for everyday consumers. Users can preview locations before visiting, while businesses can gain insights into store layouts and product placements, thereby optimizing their strategies in a digital space that reaches nearly one billion active users monthly.

Embracing an Open Ecosystem

Hesai is committed to building Kosmo into an open spatial intelligence ecosystem, allowing seamless access to capture data and 3D assets while partnering with leading platforms like NVIDIA and Unreal Engine. This ecosystem supports various business models, integrating software and hardware solutions tailored to clients across industries.

Looking Ahead

Hesai continues to expand its prowess in the Physical AI landscape, leveraging more than a decade of expertise in lidar technology and precision manufacturing. As the company develops its next phase of growth, the introduction of Kosmo demonstrates its ability to adapt and innovate in an ever-evolving market. Dr. Yifan