Our CEO, Tarun Dua, discusses the next era of cloud computing powered by AI in this blog in ‘Financial Express Transform’: https://www.financialexpress.com/business/digital-transformation-breaking-down-language-barriers-future-of-cloud-computing-3321278/lite/. We summarize the most significant points of that article here.
Introduction
India's linguistic diversity, with 19,500 languages and dialects, poses challenges in education, administration, and government services. Indic-language Large Language Models (LLMs) provide a solution to break down language barriers while preserving diversity.
Evolution of Large Language Models (LLMs)
Dua highlights the evolution of AI and its integration in daily life, from smart homes to medical diagnostics. He points out that while global AI developments like ChatGPT have been groundbreaking, it's in the open-source arena where AI's real potential is unleashed, with platforms like Hugging Face and E2E Cloud playing pivotal roles.
Building India-Specific Indic-Language LLMs
‘The linguistic plurality of our nation is built into our culture and tradition, and it is something we all treasure. However, this diversity also presents unique challenges, often creating barriers in educational and administrative systems. It also complicates delivery of government services and limits access to information and opportunities for those not fluent in English, or in the dominant regional or national languages,’ says Tarun Dua.
He stresses the necessity of developing Indic-language Large Language Models (LLMs), arguing that proprietary AI models from the US or EU often fail to grasp the nuances of India's cultural and linguistic landscape. Dua suggests that India-specific LLMs could focus more on audio interfaces, considering the structural differences of Indian languages compared to English.
Referencing the Japanese government's investment in AI systems tailored for their language, Dua notes India's similar initiative, Bhashini. Launched by Prime Minister Narendra Modi, it aims to provide language technology solutions, leveraging AI, machine learning, and NLP technologies.
Cloud GPUs for Foundational Models
Tarun Dua also underlines the critical role of cloud GPUs in building and operating these LLMs. He mentions the HGX 8xH100 as an example of the advanced infrastructure necessary for constructing language models.
‘Datasets and the architecture of AI models are vital for building Large Language Models (LLMs), but the role of cloud infrastructure, particularly advanced GPUs, is equally crucial. These cloud GPUs not only facilitate the creation of these models but also their deployment and operation. The significance of cloud GPUs is so paramount that without them, the construction of a foundational language model becomes an exceedingly challenging, if not nearly impossible, task,’ says Dua.
Future Implications
Looking ahead, Dua envisions a future where AI-driven language technologies, predominantly on cloud platforms, will significantly enhance digital inclusivity in India. This advancement, he believes, will revolutionize interactions between humans and machines, making them more intuitive and conducted in preferred local languages.
‘Looking ahead to a future where interactions between humans and machines are inherently more intuitive and conducted in the user’s preferred language, it’s certain that an array of AI-driven language technologies will emerge. This advancement will predominantly unfold on cloud computing platforms, serving as the primary stage for this technological evolution. It’s this prospect of transformative progress that fuels my enthusiasm and motivates our continued efforts in development,’ concludes Dua.