Nvidia Releases Jetson AGX Orin Module for AI
- By DSAITrends editors
- August 10, 2022
Production modules of the Jetson AGX Orin 32GB are now available, says Nvidia, which made the announcement in a blog entry last week.
Designed to enable AI acceleration in embedded systems, edge AI deployments, and robots, the Jetson AGX Orin 32GB combines a GPU based on the Ampere architecture with an 8-core Arm-based CPU. Together with 32GB of memory and 64GB of flash storage, the board is only slightly larger than a Raspberry Pi.
The Jetson platform
First unveiled earlier this year, the Jetson AGX Orin 32GB unit is capable of 200 trillion operations per second (TOPS) 1792-core GPU with 45 Tensor Cores in this production unit.
Three more Jetson Orin modules are expected this year: A 64GB version of the Jetson AGX Orin, and a pair of less powerful Jetson Orin NX modules.
According to Nvidia, the Jetson AGX Orin will allow organizations to create advanced robotics and edge AI applications for manufacturing, logistics, retail, service, agriculture, smart city, healthcare, and life sciences.
Make no mistake about it – the Jetson AGX Orin is a powerful system that incorporates an array of connectivity options such as 10Gb Ethernet, 8K display, and PCIe 4.0 lanes.
“Traditionally, developers and engineers have been limited in their ability to handle multiple concurrent data streams for complex application environments. They’ve faced strict latency requirements, energy-efficiency constraints, and issues with high-bandwidth wireless connectivity,” wrote Thejas Boggaram Shivashankar, the Jetson partner ecosystem manager at Nvidia.
“They’ve also been forced to include multiple chips in their designs to harness the compute resources needed to process diverse, ever-growing amounts of data. Nvidia Jetson AGX Orin overcomes [these] challenges,” he explained.
As reported by The Register, the Jetson Orin modules can be used with various platforms supported by Nvidia, including Isaac for robotics, DeepStream for computer vision, Riva for natural language understanding, and the Tao Toolkit to accelerate model development using ready-trained models.
According to Bill Wong of Electronic Design who had the chance to check out the Jetson AGX Orin developer kit, one of the key advantages of the platform is how the software will work across the entire Nvidia ecosystem from lower-end Jetson modules to high-end enterprise systems.
The Jetson AGX Orin is powerful enough to identify multiple people moving in multiple video streams, says Wong, and can handle multiple audio streams in real-time. You can read his review here.
Image credit: Nvidia