Zoho to leverage NVIDIA tech to build LLMs

India-headquartered business software company Zoho has arranged to leverage the NVIDIA AI Accelerated computing platform to build and deploy large language models for its SaaS applications.

Under the agreement, Zoho will utilise tools including NVIDIA NeMo, the end-to-end platform for developing custom generative AI solutions, to develop LLMs tailored for enterprise use cases.

Zoho Director of AI Ramprakash Ramamoorthy said the company has over the last year invested more than US$10 million ($15.2 million) in NVIDIA AI technology and GPUs, and plans to invest a similar amount in 2025. He said the company’s mission is to develop LLMs tailored to a wide range of business use cases.

“Owning our entire tech stack, with products spanning various business functions, allows us to integrate the essential element that makes AI truly effective: context,” he said.

Once built and deployed, the LLMs will be available on Zoho’s ManageEngine and Zoho.com platforms globally.

Zoho’s AI efforts also include the development of narrow, small and medium language models to provide customers with options that better support a variety of use cases, Ramamoorthy said. This can ensure that businesses which do not have a large amount of data can still benefit from AI.

As part of its collaboration with Nokia, Zoho is also testing using NVIDIA’s TensorRT-LLM to optimise its LLMs for deployment.

Image credit: iStock.com/GOCMEN