UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture

ABU DHABI, United Arab Emirates--(BUSINESS WIRE)--Aug 12, 2024--

The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) in the world, as independently verified by Hugging Face.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240812019509/en/

As the first SSLM for Falcon, it departs from prior Falcon models which all use a transformer-based architecture. This new Falcon Mamba 7B model is yet another example of the pioneering research the institute is conducting and the breakthrough tools and products it makes available to the community in an open source format.

H.E. Faisal Al Bannai, Secretary General of ATRC and Adviser to the UAE President for Strategic Research and Advanced Technology Affairs, said: “The Falcon Mamba 7B marks TII’s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi as a global hub for AI research and development. This achievement highlights the UAE’s unwavering commitment to innovation.”

For transformer architecture models, Falcon Mamba 7B outperforms Meta’s Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on the newly introduced benchmarks from HuggingFace. Meanwhile for the other SSLMs, Falcon Mamba 7B beats all other open source models in the old benchmarks and it will be the be first model on HuggingFace’s new tougher benchmark leaderboard.

Dr. Najwa Aaraj, Chief Executive of TII, said: “The Technology Innovation Institute continues to push the boundaries of technology with its Falcon series of AI models. The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives.”

State Space models are extremely performant at understanding complex situations that evolve over time, such as a whole book. This is because SSLMs do not require additional memory to digest such large bits of information.

Transformer based models, on the other hand, are very efficient at remembering and using information they have processed earlier in a sequence. This makes them very good at tasks like content generation, however, because they compare every word with every other word, this requires significant computational power.

SSLMs can find applications in various fields such as estimation, forecasting, and control tasks. Similar to the transformer architecture models, they also excel in Natural Language Processing tasks and can be applied to machine translation, text summarization, computer vision, and audio processing.

Dr. Hakim Hacid, Acting Chief Researcher of the TII’s AI Cross-Center Unit, said: “As we introduce the Falcon Mamba 7B, I’m proud of the collaborative ecosystem of TII that nurtured its development. This release represents a significant stride forward, inspiring fresh perspectives and further fueling the quest for intelligent systems. At TII, we’re pushing the boundaries of both SSLM and transformer models to spark further innovation in generative AI.”

Falcon LLMs have been downloaded over 45 million times, proving the outstanding success of the models. Falcon Mamba 7B will be released under TII Falcon License 2.0, the permissive Apache 2.0-based software license which includes an acceptable use policy that promotes the responsible use of AI. More information on the new model can be found at FalconLLM.TII.ae.

*Source:AETOSWire

Technology Innovation Institute (TII): Performance benchmarks - (Infographic: AETOSWire)

UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture (Photo: AETOSWire)

BANGKOK (AP) — World shares were mixed on Tuesday after Wall Street rolled to more records, with Hong Kong's benchmark losing more than 3%.

Oil prices shed more than $3 a barrel.

Germany's DAX gained 0.3% to 19,564.16, while the CAC 40 in Paris dropped 0.7% to 7,547.36. Britain's FTSE 100 lost 0.5% to 8,253.07.

The futures for the S&P 500 and the Dow Jones Industrial Average fell less than 0.1%.

Chinese shares extended losses after the government reported late Monday that growth in exports fell sharply in September, adding to signs of weakness in the economy.

The Shanghai Composite index lost 2.5% to 3,201.29, while the Hang Seng in Hong Kong gave up 3.7% to 20,318.79.

Weaker than expected data on lending and prices have undermined already fragile market sentiment that has wavered as investors await fresh details on the government plans for stimulus to help rev up the economy.

“Market participants continue to seek for clarity around fiscal stimulus support from Chinese authorities, but the lack of commitment remains a source of reservation for risk-taking in Chinese equities,” Yeap Jun Rong of IG said in a commentary.

Tokyo's Nikkei 225 index gained 0.8% to 39,910.55, while the Kospi in Seoul gained 0.4% to 2,633.45.

In Australia, the S&P/ASX 200 was up 0.8% to 8,318.40.

Also early Tuesday, the dollar fell to 148.89 Japanese yen from 149.83 yen. The euro rose to $1.0915 from $1.0911.

U.S. benchmark crude dropped $3.73 to $70.10 per barrel. Brent crude, the international standard, skidded $3.79 to $73.67 per barrel.

“The oil market is on a wild ride, caught in a whirlwind of geopolitical tension, OPEC+ strategy shifts and a slowdown from its biggest customer, China,” Stephen Innes of SPI Asset Management said in a report. China's usual growth in demand of about 600,000 barrels per day has fallen to 200,000 barrels.

Despite uncertainty over how conflict in the Middle East might affect oil supplies, “the real threat to crude isn't war, it's oversupply,” he said, noting that many oil exporters are committed to ramping up their output.

Besides oil, prices also have been falling for copper and other commodities that a healthy Chinese economy would devour.

On Monday, Wall Street rolled to more all-time highs.

The S&P 500 climbed 0.8% to build on its record set on Friday, closing at 5,859.85. The Dow Jones Industrial Average rose 0.5% to 43,065.22, adding 201 points to its own record. The Nasdaq composite gained 0.9% to 18,502.69.

The gains followed relatively quiet trading in Europe, while the U.S. bond market remained closed for the day because of a holiday.

This week will have few top-tier economic reports outside of an update Thursday on sales at U.S. retailers. That leaves the emphasis on corporate earnings reports, which will pick up the pace this week after big banks began the reporting season last week.

Bank of America, Johnson & Johnson and UnitedHealth Group will all report their latest results on Tuesday. Later in the week will come United Airlines, Netflix, American Express and Procter & Gamble.

Analysts expect S&P 500 companies to deliver overall growth of 4.1% in earnings per share for the latest quarter from a year earlier, according to FactSet. If they’re correct, it would be a fifth straight quarter of growth.

Stocks have broadly rallied to records on relief that interest rates are finally heading back down, now that the Federal Reserve has widened its focus to include keeping the economy humming instead of just fighting high inflation.

Recent reports showing the U.S. economy remains stronger than expected have also raised optimism that the Fed can pull off a perfect landing where it gets inflation down to 2% without causing a recession that many had thought would be necessary.

FILE - People pass the entrance for the Wall Street subway station on Sept. 2, 2024, in New York. (AP Photo/Peter Morgan, File)

FILE -A passerby moves past an electronic stock board showing Japan's Nikkei 225 index and stock prices outside a securities building Friday, Oct. 11, 2024 in Tokyo. (AP Photo/Shuji Kajiyama, File)