Zoho launched its in-house large language model, Zia LLM, along with a bunch of new AI tools and agentic capabilities to help businesses automate workflows, improve decision-making, and maintain data privacy.
The new Zia LLM is a proprietary model that’s been trained specifically on Zoho product use cases, including structured data extraction, summarization, retrieval-augmented generation (RAG), and code generation. It is built using NVIDIA’s AI-accelerated computing platform. Zia LLM comes in three parameter sizes, including 1.3B, 2.6B, and 7B, where each one is optimized for different workloads to balance performance and resource usage.
Along with the Zia LLM, the company has also introduced two in-house automatic speech recognition (ASR) models for English and Hindi. It claims up to 75% better performance compared to comparable models in standard tests. The company also confirmed that there is more language support in the pipeline.
In contrast to other LLM providers, Zoho is positioning Zia LLM as a more privacy-conscious option. By keeping customer data on Zoho’s servers across the US, India, and Europe, users can take advantage of advanced AI capabilities without sending sensitive data to third-party clouds. The model is currently being tested internally and will be available to customers later this year.
Pre-Built AI Agents for Real Work
Zoho is also rolling out a suite of pre-trained AI agents integrated into its business software. These include updates to Ask Zia, the company’s conversational BI assistant, now tuned to serve data engineers, analysts, and data scientists with features like conversational report building and machine learning support.
Other agents include a Customer Service Agent in Zoho Desk that can handle and triage support tickets, and a Revenue Growth Specialist that identifies upselling and cross-selling opportunities. A Deal Analyzer and a Candidate Screener are also part of the first batch of agents available via the recently launched Zia Agent Marketplace.
Furthermore, in order to promote interoperability, Zoho is adopting the Model Context Protocol (MCP). It opens up access to over 15 Zoho apps and workflows to external agents, while still respecting user-defined permissions. Zoho Analytics and Zoho Flow are also integrated into the MCP ecosystem, and more apps will be added over time.
Availability and What’s Next
Zia LLM and the new agent tools are currently being rolled out to early access customers. While the full availability and pricing details are expected by the end of 2025.
For more tech news like this, join us on WhatsApp to stay updated with the latest developments in AI, software, and business tech.
