IIT Madras and Ziroh Labs Launch AI Centre of Excellence
In a milestone move for India's AI space, IIT Madras has partnered with California-based deep-tech startup Ziroh Labs and IITM Pravartak Technology Foundation. They're building an AI Centre of Excellence to address grassroots issues all over India.
The collaboration brings together scholarly know-how and advanced technology to bring AI closer and more effectively into real-life situations.
A Shift to Affordable AI
One of the most exciting developments in this partnership is the launch of Kompact AI. Traditionally, AI systems have relied on GPUs, which are costly and not always accessible. Kompact AI, however, allows AI models to run effectively on CPUs—the standard processor found in most computing devices. This innovation is a game-changer, particularly for developers who don’t have access to high-end hardware.
What makes Kompact AI even more remarkable is its performance. Despite running on CPUs, it offers up to three times the performance of today’s leading systems. Essentially, it brings the power of GPU-like AI performance to devices with far less processing power, making AI both affordable and scalable for a global audience.
Also read: IIT Madras and Ziroh Labs Launch AI Centre of Excellence
Optimized AI Models for Better Performance
Ziroh Labs didn’t stop at creating a new platform. The company also fine-tuned 17 popular AI models to ensure they work seamlessly on CPUs. These models, including well-known ones like DeepSeek, Qwen, and Llama, were optimized for both performance and accuracy. IIT Madras played a key role in testing these models to ensure they met strict performance standards.
The novelty here is the ability to use CPUs for AI, which are widely available and less costly than GPUs. Thanks to this invention, more developers will be able to construct and implement complicated models without needing specialised hardware, lowering the cost of AI. This might be significant, especially for researchers, entrepreneurs, and organisations with fewer resources.
Empowering Developers Worldwide
What makes Kompact AI truly stand out is that it can democratize AI. Developers everywhere in the world can now access powerful AI tools without needing to break the bank to buy GPUs. This transition creates innovation paths in fields where access to high-level computing facilities is scarce.
Besides, the platform facilitates domain-specific model development. These models are tailored to address specific problems in healthcare, agriculture, and education sectors. By enabling AI deployment at the grassroots level for real-world challenges, Kompact AI makes it easier for developers to create effective and relevant solutions to local needs.
Prioritizing Data Security and Privacy
Another major aspect of Kompact AI is data security. Because they execute models on CPUs locally, the platform can guarantee that sensitive information stays on-premise, which assists in fulfilling data residency legislation and data protection laws worldwide.
This is especially crucial for sectors such as finance and healthcare, where data security is a top concern. With Kompact AI, developers and companies can safely develop and deploy AI models without compromising security.
