Jais (language model)

Last updated

Jais is an open-source large language model developed in the United Arab Emirates and launched in August 2023. It was trained on both English- and Arabic-language data.

Contents

Origin

Jais is named after Jebel Jais, the highest mountain in the United Arab Emirates. [1] It was created in collaboration between Inception, a subsidiary of G42, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) in Abu Dhabi and California-based Cerebras Systems. [1] [2] [3]

Training

Jais has 13 billion parameters, with an update for 30 billion in the works as of October 2023. [3] It was trained for over 21 days by a team in Abu Dhabi on a subset of Cerebras's Condor Galaxy 1 supercomputer. [1] [2]

Its training dataset consisted of Arabic and English, some containing computer code. [1] [3] According to Timothy Baldwin, provost, and professor of natural language processing at MBZUAI, training the model on a diverse Arabic dataset allows it to switch between dialects. [3]

Features

Jais focuses exclusively on English and Arabic translations. [4] Additional functionality for working with images, graphs and tabular data is planned for future releases. [3]

Related Research Articles

<span class="mw-page-title-main">Demographics of the United Arab Emirates</span>

Demographic features of the United Arab Emirates (UAE) include population density, vital statistics, immigration and emigration data, ethnicity, education levels, religions practiced, and languages spoken within the UAE.

<span class="mw-page-title-main">United Arab Emirates</span> Country in West Asia

The United Arab Emirates (UAE), or simply the Emirates, is a country in West Asia, in the Middle East. Located at the eastern end of the Arabian Peninsula, it shares borders with Oman and Saudi Arabia; as well as maritime borders in the Persian Gulf with Qatar and Iran. The United Arab Emirates is an elective monarchy formed from a federation of seven emirates. As of 2023, the UAE has an estimated population of 9.97 million. Emirati citizens are estimated to form 11.6% of the population; the remaining residents are expatriates, the majority of whom are South Asian. Islam is the official religion and Arabic is the official language. Abu Dhabi is the country's capital, while Dubai, the most populous city, is an international hub.

<span class="mw-page-title-main">First Gulf Bank</span> Emirati bank

FGB was the third largest bank by assets in the United Arab Emirates (UAE), until it merged with the National Bank of Abu Dhabi in December 2016 to form First Abu Dhabi Bank, creating the largest bank by assets in the UAE. Established in 1979, FGB is headquartered in the Emirate of Abu Dhabi. FGB offers a wide range of financial services in the wholesale, consumer, and treasury banking sectors, including Islamic banking and bancassurance solutions for businesses and consumers via a network of branches across the UAE. Internationally, FGB has a branch in Singapore - that includes global wealth management services and a branch in Qatar, representative offices in London, India, Hong Kong, and Seoul, South Korea, and a subsidiary in Libya.

<span class="mw-page-title-main">Catholic Church in the United Arab Emirates</span>

The Catholic Church in the United Arab Emirates is part of the worldwide Catholic Church, under the spiritual leadership of the Pope in Rome.

<span class="mw-page-title-main">Masdar</span> Global renewable energy company

Masdar (Arabic:مصدر‎), also known as the Abu Dhabi Future Energy Company, is an Emirati state-owned renewable energy company. It was founded and chaired by Sultan Al Jaber in 2006 as a subsidiary of Mubadala Investment Company. The company is responsible for development of Masdar City, which headquarters the International Renewable Energy Agency.

Mubadala Investment Company PJSC, or simply Mubadala, is a state-owned global investment management holding company that acts as one of the sovereign wealth funds of the government of Abu Dhabi. The company was established in 2017 when then-named Mubadala Development Company and the International Petroleum Investment Company (IPIC) merged. Headquartered in Abu Dhabi, Mubadala also has offices in London, Rio de Janeiro, New York, San Francisco and Beijing.

<span class="mw-page-title-main">Abu Dhabi University</span> Private university in Abu Dhabi, United Arab Emirates

Abu Dhabi University (ADU) (Arabic: جامعة أبوظبي) is a private research university with its main campus in Khalifa City, Abu Dhabi, United Arab Emirates, and satellite campuses in Al Ain, Dubai and Madinat Zayed. Founded in 2003 by Ali Saeed bin Harmal al-Dhaheri, it is the largest private institution in the country that offers courses in various subjects up to post-graduation.

<span class="mw-page-title-main">United Arab Emirates–United States relations</span> Bilateral relations

The United Arab Emirates has quite a close and friendly relationship with the US, being described as the United States' best counter-terrorism ally in the Gulf by Richard A. Clarke, the U.S. national security advisor and counter-terrorism expert. In terms of defense, the United Arab Emirates Armed Forces has been nicknamed "Little Sparta" by United States Armed Forces generals and former U.S. Secretary of Defense Jim Mattis for its active role against extremists in the Middle East. The United Arab Emirates also hosts the only United States border preclearance in the Middle East. Both countries are members of the I2U2 Group, which was established in 2021.

Provision of education in the UAE began shortly after the establishment of the federation with the inception of the first university in Al Ain, Abu Dhabi, the United Arab Emirates University. Since then, the country has progressed with efforts of ensuring high literacy rates, modern programs and women's share in education. It works on improving its youths education which is why the agenda 2021 has been set. The UAE currently devotes approximately 25 percent of total federal government spending to education. As of 2019, the overall literacy rate is 96%.

Mass media in the United Arab Emirates is subject to government control and censorship. Media freedom is severely curtailed in the UAE. Most UAE media is owned by the government or by groups that have ties to the government. UAE law permits the government to censor content critical of the government. Journalists and writers who criticize the government are subject to repression.

<span class="mw-page-title-main">Emirati passport</span> Passport of the United Arab Emirates issued to Emirati citizens

Emirati passports are passports given from the government of the United Arab Emirates (UAE) to Emirati citizens for the purpose of international travel.

<span class="mw-page-title-main">Abu Dhabi</span> Capital of the United Arab Emirates and the Emirate of Abu Dhabi

Abu Dhabi is the capital city of the United Arab Emirates (UAE). The city is the seat of the Abu Dhabi Central Capital District, the capital city of the Emirate of Abu Dhabi, and the UAE's second-most populous city after Dubai.

<span class="mw-page-title-main">France–United Arab Emirates relations</span> Bilateral relations

France–United Arab Emirates relations are the foreign relations between France and the United Arab Emirates.

<span class="mw-page-title-main">China–United Arab Emirates relations</span> Bilateral relations

China – United Arab Emirates relations refer to the diplomatic relations between the People's Republic of China and the United Arab Emirates. Diplomatic ties were first established in 1984. The UAE maintains an embassy in Beijing and a consulate-general in Hong Kong while China has an embassy in Abu Dhabi and consulate-general in Dubai. The UAE and China have been strong international allies, with significant cooperation across economic, political and cultural aspects.

<span class="mw-page-title-main">Higher Colleges of Technology</span>

The Higher Colleges of Technology(HCT) (Arabic: كليّات التقنيّة العليا) is a public institute of technology with 16 campuses and facilities throughout the United Arab Emirates. Founded in 1988 by Sheikh Nahyan bin Mubarak al-Nahyan, it is the largest applied higher educational institution in the country.

<span class="mw-page-title-main">Khaled bin Mohamed Al Nahyan</span> Crown Prince of Abu Dhabi since 2023

Sheikh Khaled bin Mohamed bin Zayed Al Nahyan is crown prince of Abu Dhabi. He was appointed to the role on 29 March 2023. He is the eldest son of Sheikh Mohamed bin Zayed Al Nahyan, 3rd president of the United Arab Emirates.

<span class="mw-page-title-main">G42 (company)</span> Artificial Intelligence company

Group 42 Holding Ltd, doing business as G42, is an Emirati artificial intelligence (AI) development holding company based in Abu Dhabi, founded in 2018. The organization is focused on AI development across various industries including government, healthcare, finance, oil and gas, aviation, and hospitality. Tahnoun bin Zayed Al Nahyan, UAEs national security advisor is the controlling shareholder and chairs the company. Because G42 had strong ties to China, U.S. authorities have been concerned that G42 serves as a channel through which sophisticated U.S. technology is diverted to Chinese companies or the government. As of February 2024, G42 divested its stakes in China.

<span class="mw-page-title-main">Cerebras</span> American semiconductor company

Cerebras Systems Inc. is an American artificial intelligence company with offices in Sunnyvale and San Diego, Toronto, Tokyo and Bangalore, India. Cerebras builds computer systems for complex artificial intelligence deep learning applications.

<span class="mw-page-title-main">Technology Innovation Institute</span> Research institute

The Technology Innovation Institute (TII) is an Abu Dhabi government funded research institution that operates in the areas of artificial intelligence, quantum computing, autonomous robotics, cryptography, advanced materials, digital science, directed energy and secure systems. The institute is a part of the Abu Dhabi Government’s Advanced Technology Research Council (ATRC).

<span class="mw-page-title-main">Abdallah Abu Sheikh</span> Emirati-Jordanian businessman

Abdallah Abu Sheikh is a Jordanian/Emirati businessman, founder of Astra Tech, and CEO of Botim.

References

  1. 1 2 3 4 Cherney, Max A. (2023-08-30). "UAE's G42 launches open source Arabic language AI model". Reuters . Retrieved 2023-10-08.
  2. 1 2 Kerr, Simeon; Murgia, Madhumita (2023-08-30). "UAE launches Arabic large language model in Gulf push into generative AI". Financial Times . Retrieved 2023-10-08.
  3. 1 2 3 4 5 Tutton, Mark (2023-10-04). "Arabic AI could help open doors for other languages". CNN . Retrieved 2023-10-08.
  4. Ray, Tiernan (September 1, 2023). "Cerebras and Abu Dhabi build world's most powerful Arabic-language AI model". ZDNET . Retrieved 2023-10-08.