Zoho Corporation has announced plans to integrate NVIDIA’s AI technology into its suite of business software applications. The Chennai-based tech company will utilise NVIDIA’s AI accelerated computing platform, including the NeMo framework, to build and deploy large language models (LLMs) tailored for enterprise use. These models are expected to be available to Zoho’s 700,000+ global customers across its ManageEngine and Zoho.com platforms.
The company has invested over $10 million in NVIDIA’s AI technology and GPUs over the past year, with plans to spend another $10 million in the coming year. The partnership was revealed during the NVIDIA AI Summit in Mumbai.
Ramprakash Ramamoorthy, Zoho’s Director of AI, said, “Many LLMs on the market today are designed for consumer use, offering limited value for businesses. At Zoho, our mission is to develop LLMs tailored specifically for a wide range of business use cases. Owning our entire tech stack, with products spanning various business functions, allows us to integrate the essential element that makes AI truly effective: context.”
Zoho’s approach emphasises privacy, with models designed to comply with data regulations from the outset. Unlike some consumer-focused LLMs, Zoho’s models will not be trained on customer data. Additionally, the company is developing a variety of model sizes, including small and medium models, to serve businesses with varying data needs.
As part of this collaboration, Zoho will use NVIDIA’s Hopper GPUs and TensorRT-LLM to improve performance, achieving a reported 60% increase in throughput and a 35 percent reduction in latency compared to previous setups. Zoho is also testing NVIDIA’s infrastructure for other tasks, such as speech-to-text processing, as it continues to expand its AI-driven offerings.
Discussion about this post