UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture

News

UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture

2024-08-12 19:42 Last Updated At：19:50

ABU DHABI, United Arab Emirates--(BUSINESS WIRE)--Aug 12, 2024--

The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) in the world, as independently verified by Hugging Face.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240812019509/en/

As the first SSLM for Falcon, it departs from prior Falcon models which all use a transformer-based architecture. This new Falcon Mamba 7B model is yet another example of the pioneering research the institute is conducting and the breakthrough tools and products it makes available to the community in an open source format.

H.E. Faisal Al Bannai, Secretary General of ATRC and Adviser to the UAE President for Strategic Research and Advanced Technology Affairs, said: “The Falcon Mamba 7B marks TII’s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi as a global hub for AI research and development. This achievement highlights the UAE’s unwavering commitment to innovation.”

For transformer architecture models, Falcon Mamba 7B outperforms Meta’s Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on the newly introduced benchmarks from HuggingFace. Meanwhile for the other SSLMs, Falcon Mamba 7B beats all other open source models in the old benchmarks and it will be the be first model on HuggingFace’s new tougher benchmark leaderboard.

Dr. Najwa Aaraj, Chief Executive of TII, said: “The Technology Innovation Institute continues to push the boundaries of technology with its Falcon series of AI models. The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives.”

State Space models are extremely performant at understanding complex situations that evolve over time, such as a whole book. This is because SSLMs do not require additional memory to digest such large bits of information.

Transformer based models, on the other hand, are very efficient at remembering and using information they have processed earlier in a sequence. This makes them very good at tasks like content generation, however, because they compare every word with every other word, this requires significant computational power.

SSLMs can find applications in various fields such as estimation, forecasting, and control tasks. Similar to the transformer architecture models, they also excel in Natural Language Processing tasks and can be applied to machine translation, text summarization, computer vision, and audio processing.

Dr. Hakim Hacid, Acting Chief Researcher of the TII’s AI Cross-Center Unit, said: “As we introduce the Falcon Mamba 7B, I’m proud of the collaborative ecosystem of TII that nurtured its development. This release represents a significant stride forward, inspiring fresh perspectives and further fueling the quest for intelligent systems. At TII, we’re pushing the boundaries of both SSLM and transformer models to spark further innovation in generative AI.”

Falcon LLMs have been downloaded over 45 million times, proving the outstanding success of the models. Falcon Mamba 7B will be released under TII Falcon License 2.0, the permissive Apache 2.0-based software license which includes an acceptable use policy that promotes the responsible use of AI. More information on the new model can be found at FalconLLM.TII.ae.

*Source:AETOSWire

Littell allows 1 hit in 7 innings and Rays beat Red Sox 2-0

2024-09-20 09:26 Last Updated At：09:30

ST. PETERSBURG. Fla. (AP) — Zack Littell allowed one hit over seven innings and the Tampa Bay Rays beat the Boston Red Sox 2-0 on Thursday night.

Littell (8-9), who made his team-leading 28th start in his first full season as starter, struck out seven and did not issue a walk. After Edwin Uceta pitched a perfect eighth, Garrett Cleavinger worked a 1-2-3 ninth to get his sixth save in seven chances.

“I don’t think we could have predicted the amount of success, the workload,” Cash said of Littell. “Just how much day-in and day-out giving us chances to win.”

Nick Sogard's two-out single in the third was Boston's only hit of the game.

Boston starts a three-game series at Fenway Park against Minnesota on Friday, trailing the Twins and Detroit by four games for the final AL wild card. The Red Sox would also need to jump over Seattle. The Rays are five games out of the third wild-card position.

“Uphill battle, it’s tough,” Boston manager Alex Cora said. “Realistically it’s very tough. But we have three games against (the Twins).”

Both the Red Sox and Rays have nine games remaining.

Boston has gone 22-35 since the All-Star break.

The Rays need to go 2-1 or better this weekend against Toronto in their final home series of the season to have an eighth consecutive winning record at home.

“I don’t think there’s anything glaring other than at the end of the day we just have not performed like we’re capable of,” Cash said.

Brandon Lowe drove in a run with a third-inning sacrifice off Brayan Bello (14-8). Bello gave up one run, five hits, two walks and struck out seven over 5 2/3 innings.

Dylan Carlson made it 2-0 on a run-scoring grounder in the seventh.

Boston slugger Rafael Devers went 0 for 3 with three strikeouts. He was hitless in 11 at-bats, including eight strikeouts, in the series.

“Right now, collectively, we’re slumping,” Cora said. “Same thing has been happening for a month and half.”

TRAINER'S ROOM

Red Sox: Closer Kenley Jansen, who has had some shoulder-lat issues, threw before the game after getting his 27th save on Wednesday and is fine … RHP Lucas Sims (right lat) was reinstated from the 15-day IL. … RHP Luis García (right elbow inflammation) could be back in the next few days.

Rays: Shane McClanahan (Tommy John surgery) is looking forward to throwing to hitters for the first time next Thursday. “It’s exciting,” McClanahan said, “I miss it. Miss it to death,”

UP NEXT

Red Sox: Face Minnesota RHP David Festa (2-6, 5.07 ERA) on Friday night. Boston has not announced its starter.

Rays: LHP Tyler Alexander (6-5, 5.58 ERA) will start or follow an opener Friday night against Toronto RHP José Berríos (16-9, 3.44 ERA). Berríos is 7-0 with an 1.51 ERA over his last seven starts.

AP MLB: https://apnews.com/hub/MLB