Skip to Content Facebook Feature Image

MOREH Demonstrates Production-Ready LLM Inference on Tenstorrent Galaxy, Achieving DGX A100-Class Performance with Improved Cost Efficiency

Business

MOREH Demonstrates Production-Ready LLM Inference on Tenstorrent Galaxy, Achieving DGX A100-Class Performance with Improved Cost Efficiency
Business

Business

MOREH Demonstrates Production-Ready LLM Inference on Tenstorrent Galaxy, Achieving DGX A100-Class Performance with Improved Cost Efficiency

2026-05-02 08:48 Last Updated At:09:05

Reduces HBM Costs with GPU–Tenstorrent Heterogeneous Distributed Serving
First unveiled at Tenstorrent's launch event, TT-Deploy, in San Francisco on May 1

SANTA CLARA, Calif., May 2, 2026 /PRNewswire/ -- Moreh, an AI infrastructure software company, led by CEO Gangwon Jo, announced that it has successfully validated LLM inference performance on the Tenstorrent Galaxy Wormhole system using its proprietary 'MoAI Inference Framework.'

Based on tests across leading Mixture-of-Experts (MoE) models—including GPT-OSS, Qwen, GLM, and DeepSeek—Moreh achieved LLM inference performance on Tenstorrent Galaxy Wormhole matching or surpassing NVIDIA DGX A100-class systems, demonstrating a compelling alternative to conventional GPU-centric AI infrastructure.

Moreh also improved cost efficiency by implementing a disaggregated serving architecture that combines GPUs with Tenstorrent Wormhole chips. By utilizing Tenstorrent processors as dedicated prefill accelerators, the company reduced reliance on high-cost HBM and lowered overall infrastructure costs.

The results were first unveiled at Tenstorrent's launch event, TT-Deploy, held on May 1 in San Francisco.

As a strategic partner of Tenstorrent and a major external contributor to Metalium, Moreh showcased a live LLM inference demo at the event. Building on its experience operating AMD GPU-based production environments in real-world data centers, the company presented its latest technical achievements in 'Production-Ready LLM Inference on Tenstorrent Galaxy.'

MoAI Inference Framework is a disaggregated inference solution that enables unified operation of heterogeneous GPUs and NPUs—including NVIDIA, AMD, and Tenstorrent—within a single cluster. This allows enterprises to build flexible AI infrastructure strategies without vendor lock-in.

Moreh CEO Gangwon Jo stated, "Achieving production-grade LLM inference performance and stability on Tenstorrent-based systems marks a significant milestone," and added, "We will continue to enhance performance through deeper optimization across heterogeneous architectures and closer integration with Tenstorrent NPUs."

Moreh is developing its own core AI infrastructure engine and, through its foundation LLM subsidiary Motif Technologies, is building end-to-end capabilities spanning both infrastructure and model domains. Simultaneously, the company is making its mark in the global market through collaborations with key partners such as AMD, Tenstorrent, and SGLang.

** This press release is distributed by PR Newswire through automated distribution system, for which the client assumes full responsibility. **

MOREH Demonstrates Production-Ready LLM Inference on Tenstorrent Galaxy, Achieving DGX A100-Class Performance with Improved Cost Efficiency

MOREH Demonstrates Production-Ready LLM Inference on Tenstorrent Galaxy, Achieving DGX A100-Class Performance with Improved Cost Efficiency

Thousands of Performances and Events Presented in More Than 190 Countries on All Continents

CHICAGO, May 2, 2026 /PRNewswire/ -- The 15th annual International Jazz Day came to a rousing conclusion with a historic All-Star Global Concert in the International Jazz Day 2026 Global Host City of Chicago.

This highly anticipated concert at Chicago's iconic Lyric Opera House featured over 40 world-renowned artists, including: Kris Bowers, Dee Dee Bridgewater, Till Brönner, Terri Lyne Carrington, James Carter, Emmet Cohen, Jacob Collier, Buddy Guy, Kurt Elling, Béla Fleck, Herbie Hancock, Christian McBride, Marcus Miller, Gregory Porter, Dianne Reeves and many more.

The 2026 All-Star Global Concert opened with a vibrant, four-part salute to the Host City of Chicago, with each performance reflecting the city's deep musical legacy. Dee Dee Bridgewater and Gregory Porter set the tone with an electrifying duet on "The In-Crowd," honoring Chicago jazz legend Ramsey Lewis. They were followed by Chicago native Herbie Hancock, who reimagined his crossover hit "Watermelon Man" by seamlessly blending its 1960s Blue Note groove with its later jazz-funk incarnation. The Chicago celebration continued with blues legend Buddy Guy—a defining figure of the Chicago blues tradition—joined by his protégé Christone "Kingfish" Ingram for a powerful take on his GRAMMY-winning "Damn Right, I've Got the Blues." Jacob Collier closed the opening tribute with a heartfelt homage to Quincy Jones, whose career was shaped in Chicago, featuring "She's Out of My Life" and "Soul Bossa Nova."

The evening continued with a stirring, choir-backed rendition of "Seems I'm Never Tired of Loving You" from Lizz Wright, followed by the innovative jazz hip-hop fusion segment "Funny Rabbit" led by Robert Glasper on piano, featuring Burniss "Boom Bishop" Travis II, Justin Tyson and DJ Jahi Sundance. Next came a radiant performance of "Antes de Ir" by Brazil's Bia Ferreira. Living up to its title, "Touch and Go," Béla Fleck delivered a nimble, exploratory performance that moved fluidly across bluegrass, jazz fusion, and classical influences. Dianne Reeves brought luminous depth to "In a Sentimental Mood," capturing the elegance of Duke Ellington's writing, while Kurt Elling delivered a soulful, swinging interpretation of "Dat Dere," a Bobby Timmons' composition associated with Art Blakey and the Jazz Messengers.

As the evening drew to a close, a series of iconic jazz works took center stage. Gonzalo Rubalcaba led a dynamic performance of "Caravan", followed by Gershwin's "Summertime", presented with a nod to the transformative interpretation by John Coltrane, which redefined the piece as a vehicle for intense improvisation. Marcus Miller then paid tribute to his former bandleader Miles Davis with a powerful rendition of "Tutu". International Jazz Day 2026 concluded with its traditional finale, "Imagine," the enduring anthem of peace by John Lennon—bringing the audience to its feet in a celebration of unity through music.

International Jazz Day was celebrated in 196 countries and all 50 U.S. States, through performances, education programs, and community service initiatives.

In the Host City of Chicago International Jazz Day was co-chaired by Quintin Primo III, Michael Reschke and Andrew Pritzker with major support by Capri Capital, GCM Grosvenor, GRoW @ Annenberg Foundation, MacArthur Foundation, The Prime Group, and TAWANI Foundation. United, the International Jazz Day Global Airline Partner, provided air transportation and additional support for artists and educators.

About International Jazz Day: In 2011, the United Nations Educational, Scientific and Cultural Organization (UNESCO) officially designated April 30 as International Jazz Day to highlight jazz and its diplomatic role of uniting people in all corners of the globe. International Jazz Day is chaired and led by the UNESCO Director-General Khaled El-Enany and legendary jazz pianist and composer Herbie Hancock, who serves as a UNESCO Goodwill Ambassador for Intercultural Dialogue. The Herbie Hancock Institute of Jazz is the lead nonprofit charged with planning, promoting and producing this annual celebration. International Jazz Day has become a global movement reaching more than a billion people annually through performances, education programs, community outreach initiatives, radio, television and streaming, along with electronic, print and social media.

Learn more about International Jazz Day at www.jazzday.com and www.unesco.org/jazzday.

 

** This press release is distributed by PR Newswire through automated distribution system, for which the client assumes full responsibility. **

International Jazz Day 2026 Worldwide Celebration Concludes with Thrilling All-Star Global Concert from Chicago

International Jazz Day 2026 Worldwide Celebration Concludes with Thrilling All-Star Global Concert from Chicago

International Jazz Day 2026 Worldwide Celebration Concludes with Thrilling All-Star Global Concert from Chicago

International Jazz Day 2026 Worldwide Celebration Concludes with Thrilling All-Star Global Concert from Chicago

Recommended Articles