TL;DR:
- Stereolabs introduces Terra AI, a revolutionary vision-based AI technology.
- Terra AI enables robots to operate with exceptional precision and safety.
- It leverages monocular and stereo vision for 4D volumetric perception.
- The technology performs depth estimation, localization, semantic analysis, and obstacle detection.
- Terra AI is optimized for low-power embedded computers, making it cost-effective.
- It eliminates the need for expensive LiDAR or radar sensors.
- The Stereolabs vision platform combines hardware and software for enhanced perception.
- It caters to various industries, from agriculture to logistics and construction.
- Terra AI provides scalable solutions for autonomous machines, fostering efficiency.
- Availability: Research preview now, accessible to Stereolabs Enterprise customers in Q2 2024.
Main AI News:
In a groundbreaking move, Stereolabs, a trailblazer in vision-based sensing technology, has introduced Terra AI, the latest addition to their visionary platform portfolio. Terra AI signifies a monumental leap in the world of artificial intelligence, offering robots and systems an unprecedented level of safety and precision. Tailored for optimized implementation in autonomous robots, Terra AI harnesses monocular and stereo vision to deliver 4D volumetric perception with unparalleled accuracy. It excels in performing depth estimation, localization, semantic analysis, obstacle detection, and fusion from multiple cameras, all in real-time, revolutionizing the way autonomous robotics perceive their surroundings.
Achieving vision-based full autonomy in robots is no small feat, demanding multiple complex tasks to be executed simultaneously and efficiently on embedded hardware. These include depth estimation for spatial awareness, visual-inertial odometry for indoor and outdoor localization, semantic comprehension for obstacle identification, terrain mapping, and robust detection of people for enhanced safety. Terra AI is a pioneering large Neural Network Architecture engineered with fast, memory-efficient, low-level code, enabling concurrent execution of these critical tasks on low-power embedded computers. This breakthrough empowers the processing of high-frequency, high-volume data from ZED cameras on the embedded NVIDIA® Jetson™ platform.
The synergy of the high-performance NVIDIA® Jetson™ module and Terra AI creates the Stereolabs vision platform, combining industry-proven hardware such as ZED cameras (including stereo and new mono cameras) with cutting-edge software solutions. This comprehensive approach equips Stereolabs with the tools necessary to enhance perception around machines, enabling safe navigation and manipulation.
In today’s fast-paced industries, from agriculture to logistics to construction and beyond, the pressure to boost productivity and efficiency while coping with limited resources is relentless. Simultaneously, labor shortages and hazardous working conditions pose significant challenges. Autonomous robots represent a viable solution, but their effectiveness hinges on their ability to assess their environment, interpret data and carry out tasks autonomously. Advanced sensing technology is the key, and Terra AI rises to the occasion.
Terra AI offers a scalable solution for deploying autonomous machines, including tractors, mowers, utility vehicles, AMRs, robotic arms, and more. It leverages low-cost cameras in conjunction with the NVIDIA® Jetson™ Orin GPU to provide a panoramic 360-degree surround view around the robot. The elimination of LiDAR or radar marks a significant shift toward cost-effective scalability.
Cecile Schmollgruber, Chief Executive Officer of Stereolabs, stated, “As we deepen our collaboration with manufacturers and system integrators, our latest Terra AI technology seeks to address the growing demand for an open, adaptable, and scalable vision platform that delivers 360-degree perception, fostering genuine autonomy. Terra AI enables companies across various industries to invest in autonomous robotics at scale, enabling them to run their operations with increased efficiency and precision at a lower cost.”
Availability
Terra AI is currently in research preview and is set to become available to Stereolabs Enterprise customers in Q2 2024. Subsequently, it will be accessible to all users through the ZED SDK, one of the industry’s most advanced, open, and scalable AI Vision platforms. This SDK has already won the trust of over 100,000 developers worldwide, facilitating the creation of safe, intelligent, autonomous applications that run 24/7.
As one of the industry’s most scalable and open systems for autonomous robotics, the ZED SDK offers flexible deployment options, ranging from entry-tier front camera applications to advanced surround-view camera applications that cater to a wide spectrum of machine types. Its uniquely designed modular architecture enhances manufacturers’ flexibility in integrating depth sensing, indoor and outdoor localization, obstacle detection, and people detection, thus supporting superior customization and integration.
Conclusion:
Stereolabs’ Terra AI marks a significant advancement in vision-based AI technology for robotics. Its cost-effectiveness and scalability have the potential to disrupt various industries, enabling companies to deploy autonomous robots for increased efficiency and precision, all while reducing costs. This innovation opens new possibilities for the market, making autonomous robotics more accessible and practical for a wide range of applications.
