Teradata Integrates Nvidia AI Into Vantage Platform
- By Paul Mah
- October 23, 2024
Teradata has announced a collaboration with Nvidia to enhance its Vantage multi-cloud data platform with Nvidia AI.
Specifically, Teradata is integrating Nvidia NeMo and NIM microservices into its Vantage platform to accelerate AI workloads and support the development of foundation and customized large language models, agentic workflows, and RAG applications. In addition, customers can deploy their own custom models through Nvidia AI Enterprise.
Teradata with Nvidia
Teradata’s platform will start by offering Nvidia accelerated computing infrastructure. The first implementation of this effort was announced as part of Teradata’s new support for both small language models (SLMs) and open LLMs in VantageCloud Lake. The new bring-your-own LLM capability can take advantage of Nvidia AI accelerated computing platform clusters for tasks like LLM inferencing and model fine-tuning.
In addition, Nvidia NeMo Retriever, which enables organizations to seamlessly connect custom models to diverse business data and deliver highly accurate responses, will be offered on Teradata VantageCloud for search and RAG applications to leverage existing customer data.
Teradata will provide access to Nvidia NIM microservices for Teradata VantageCloud customers initially, which will eventually be expanded to hybrid customers globally.
“Teradata customers are not casual users of their data and analytics, so we’re thrilled to be engaged with Nvidia to leverage our strong and trusted foundation for innovative AI use cases,” said Hillary Ashton, the chief product officer at Teradata.
“By integrating Nvidia’s accelerated computing architecture into our Vantage platform, Teradata customers will be able to accelerate their use of AI at scale, in the environment of their choice, delivering unprecedented business value,” she said.
“Data is the foundation of generative AI applications, enabling the development of today’s highly customized applications,” said Pat Lee, vice president of Strategic Enterprise Partnerships at Nvidia.
“By integrating Nvidia AI Enterprise, Teradata is providing developers a high-performance, full-stack platform that offers the security, stability, and support enterprises require.”
Teradata VantageCloud Lake Nvidia AI accelerated compute will be generally available first on the AWS cloud in November, with inference capabilities being added by the end of this year and fine-tuning availability in the first half of 2025.
Image credit: iStock/yaruta
Paul Mah
Paul Mah is the editor of DSAITrends, where he report on the latest developments in data science and AI. A former system administrator, programmer, and IT lecturer, he enjoys writing both code and prose.