UAE’s G42 Launches Open-Source Arabic Language AI Model

In the dynamic landscape of Artificial Intelligence (AI), the United Arab Emirates (UAE) continues to shine as a beacon of innovation. 

Bolstering its position, G42, a trailblazing AI company within the UAE, has orchestrated a monumental achievement—the launch of Jais, an open-source Arabic language AI model. This endeavor stands as a testament to the UAE’s commitment to fostering knowledge sharing and global progress.

Named after the UAE’s loftiest peak, Jais is the result of a triumphant collaboration between G42’s Inception, the Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), and Cerebras Systems. The driving force behind this achievement is collaboration itself, as underscored by Jackson’s remark, “We believe that innovation thrives when we collaborate.”

Jais: A Transformational Language Model

Jais, a transformer-based large language model (LLM), boasts a repertoire of cutting-edge attributes. Notably, it incorporates ALiBi position embeddings, a pioneering feature that enables the model to handle significantly longer inputs with enhanced context comprehension and accuracy. This technological marvel signals a pivotal stride in advancing the realm of AI, cementing UAE’s position at the forefront.

Dr. Eric Xing, President and University Professor at MBZUAI, elucidates the complex tapestry that wove Jais together. He notes that developing such a caliber of Arabic LLM necessitated a potent fusion of AI research and a nuanced grasp of the Arabic language’s diversity, heritage, and its burgeoning relevance across society’s echelons.

Among Jais’ formidable attributes are state-of-the-art techniques such as SwiGLU and maximal update parameterization. These elements intricately enhance the model’s training efficiency and accuracy, solidifying Jais as a formidable contender in the AI arena.

Jais extends an invitation to innovation enthusiasts, available for download on Hugging Face. For a more immersive experience, users can access Jais online by expressing interest on the dedicated website, eventually securing an invitation to explore the interactive playground environment.

Cerebras’ Condor Galaxy 1: Powering the Path to Excellence

The ascent of Jais was facilitated by Condor Galaxy 1, a supercomputer crafted by Silicon Valley’s Cerebras Systems. Designed around dinner plate-sized chips, CG1 possesses the staggering capacity of 4 exaFLOPs and 54 million cores. Linked together into a unified AI supercomputer, 64 Cerebras CS-2 systems form the bedrock of this extraordinary computational marvel.

The unveiling of a network comprising nine interconnected supercomputers stands as a testament to G42 and Cerebras Systems’ joint vision. These supercomputers, unveiled in July, signal a transformative AI computing paradigm that promises accelerated model training. CG-1, offered as a cloud service, empowers users to harness AI supercomputing prowess without grappling with the intricacies of physical system management.

A Glimpse into the Future

The collaboration between Cerebras and G42 doesn’t end here. The horizon promises CG-2 and CG-3, two additional supercomputers slated for deployment in the United States in early 2024. Carrying a combined capacity of 36 exaFLOPs, this unprecedented supercomputing network vows to reshape the global landscape of AI advancement.

Also Read: UAE Launches Cloudix To Improve Rainfall Across The Country

Jais emerges as a resplendent example of the UAE’s dedication to AI excellence. This open-source Arabic language AI model serves as a catalyst for progress, elevating innovation, and knowledge sharing to unparalleled heights.