Skip to Content Facebook Feature Image

WEKA Breaks The AI Memory Barrier With Augmented Memory Grid on NeuralMesh

Business

WEKA Breaks The AI Memory Barrier With Augmented Memory Grid on NeuralMesh
Business

Business

WEKA Breaks The AI Memory Barrier With Augmented Memory Grid on NeuralMesh

2025-11-19 06:00 Last Updated At:06:25

Breakthrough Memory Extension Technology, Validated on Oracle Cloud Infrastructure, Democratizes Inference, Delivering 1000x More Memory and 20x Faster Time to First Token for NeuralMesh Customers

ST. LOUIS and CAMPBELL, Calif., Nov. 19, 2025 /PRNewswire/ -- From SC25: WEKA, the AI storage company, today announced the commercial availability of Augmented Memory Grid™ on NeuralMesh™, a revolutionary memory extension technology that solves the fundamental bottleneck throttling AI innovation: GPU memory. Validated on Oracle Cloud Infrastructure (OCI) and other leading AI cloud platforms, Augmented Memory Grid extends GPU memory capacity by 1000x, from gigabytes to petabytes, while reducing time-to-first-token by up to 20x. This breakthrough enables AI builders to streamline long-context reasoning and agentic AI workflows, dramatically improving the efficiency of inference workloads that have previously been challenging to scale.

From Innovation to Production: Solving For The AI Memory Wall
Since its introduction at NVIDIA GTC 2025, Augmented Memory Grid has been hardened, tested, and validated in leading production AI cloud environments, starting with OCI. The results have confirmed what early testing indicated: as AI systems evolve toward longer, more complex interactions—from coding copilots to research assistants and reasoning agents—memory has become the critical bottleneck limiting inference performance and economics.

"We're bringing to market a proven solution validated with Oracle Cloud Infrastructure and other leading AI infrastructure platforms," said Liran Zvibel, co-founder and CEO at WEKA. "Scaling agentic AI isn't just about raw compute—it's about solving the memory wall with intelligent data pathways. Augmented Memory Grid enables customers to run more tokens per GPU, support more concurrent users, and unlock entirely new service models for long-context workloads. OCI's bare metal infrastructure with high-performance RDMA networking and GPUDirect Storage capabilities makes it a unique platform for accelerating inference at scale."

Today's inference systems face a fundamental constraint: GPU high-bandwidth memory (HBM) is extraordinarily fast but limited in capacity, while system DRAM offers more space but far less bandwidth. Once both tiers fill, key-value cache (KV cache) entries are evicted and GPUs are forced to recompute tokens they've already processed—wasting cycles, power, and time.

WEKA's Augmented Memory Grid breaks through the GPU memory wall by creating a high-speed bridge between GPU memory (typically HBM) and flash-based storage. It continuously streams key-value cache data between GPU memory and WEKA's token warehouse, using RDMA and NVIDIA Magnum IO GPUDirect Storage to achieve memory speeds. This allows large language and agentic AI models to access far more context without having to recompute previously computed KV cache or previously generated tokens, dramatically improving efficiency and scalability.

OCI-Tested Performance and Ecosystem Integration
Independent testing, including validation on OCI, has confirmed:

  • 1000x more KV cache capacity while maintaining near-memory performance.
  • 20x faster time to first token when processing 128,000 tokens compared to recomputing the prefill phase.
  • 7.5M read IOPs and 1.0M write IOPs in an eight-node cluster.

For AI cloud providers, model providers, and enterprise AI builders, these performance gains fundamentally change inference economics. By eliminating redundant prefill operations and sustaining high cache hit rates, organizations can maximize tenant density, reduce idle GPU cycles, and dramatically improve ROI per kilowatt-hour. Model providers can now profitably serve long-context models, slashing input token costs and enabling entirely new business models around persistent, stateful AI sessions.

The move to commercial availability reflects deep collaboration with leading AI infrastructure collaborators, including NVIDIA and Oracle. The solution integrates tightly with NVIDIA GPUDirect Storage, NVIDIA Dynamo, and NVIDIA NIXL, with WEKA having open-sourced a dedicated plugin for the NVIDIA Inference Transfer Library (NIXL). OCI's bare-metal GPU compute with RDMA networking and NVIDIA GPUDirect Storage capabilities provides the high-performance foundation WEKA needs to deliver an Augmented Memory Grid without performance compromises in cloud-based AI deployments.

"The economics of large-scale inference are a major consideration for enterprises," said Nathan Thomas, vice president, multicloud, Oracle Cloud Infrastructure. "WEKA's Augmented Memory Grid directly confronts this challenge. "The 20x improvement in time-to-first-token we observed in joint testing on OCI isn't just a performance metric; it fundamentally reshapes the cost structure of running AI workloads. For our customers, this makes deploying the next generation of AI easier and cheaper."

Commercial Availability
Augmented Memory Grid is now included as a feature for NeuralMesh deployments and on the Oracle Cloud Marketplace, with support for additional cloud platforms coming soon.

Organizations interested in deploying Augmented Memory Grid should visit WEKA's Augmented Memory Grid page to learn more about the solution and the qualification criteria.

About WEKA
WEKA is transforming how organizations build, run, and scale AI workflows with NeuralMesh™, its intelligent, adaptive mesh storage system. Unlike traditional data infrastructure, which becomes slower and more fragile as workloads expand, NeuralMesh becomes faster, stronger, and more efficient as it scales, dynamically adapting to AI environments to provide a flexible foundation for enterprise AI and agentic AI innovation. Trusted by 30% of the Fortune 50, NeuralMesh helps leading enterprises, AI cloud providers, and AI builders optimize GPUs, scale AI faster, and reduce innovation costs. Learn more at www.weka.io or connect with us on LinkedIn and X.

WEKA and the W logo are registered trademarks of WekaIO, Inc. Other trade names herein may be trademarks of their respective owners.

 

** The press release content is from PR Newswire. Bastille Post is not involved in its creation. **

WEKA Breaks The AI Memory Barrier With Augmented Memory Grid on NeuralMesh

WEKA Breaks The AI Memory Barrier With Augmented Memory Grid on NeuralMesh

WEKA Breaks The AI Memory Barrier With Augmented Memory Grid on NeuralMesh

WEKA Breaks The AI Memory Barrier With Augmented Memory Grid on NeuralMesh

WILMINGTON, Del., April 1, 2026 /PRNewswire/ -- SweetNight, a modern sleep brand committed to making intelligent sleep solutions accessible to everyday families, today announced the launch of the CoolNest® Hybrid Mattress. As the second flagship model in the CoolNest® Collection, the mattress combines advanced thermoregulation with a responsive hybrid support system and a comfort top layer to address the needs of hot sleepers. This launch reinforces SweetNight's focus on user-centric design, providing an optimized balance of temperature control and ergonomic support for families seeking high-quality rest at an accessible price point.

Engineered for Cooler Sleep All Night Long

The CoolNest® Hybrid Mattress is built around the CoolNest® System, a multi-layer cooling architecture designed for high-performance temperature regulation. At the surface, a cool‑to‑the‑touch ice silk cover, featuring over 10,000 micro‑pores per square centimeter, helps rapidly dissipate body heat and deliver an instant cooling sensation.

Beneath the surface, adaptive temperature‑regulation foams absorb and release heat as temperatures shift, helping maintain a stable sleep environment through out the night. Perforated foam layer, combined with a ventilated spring base, enhances airflow and heat buildup.

Reducing Sleep Disruptions with Motion Isolation and Temperature Stability

Recognizing that both temperature consistency and motion control are critical to uninterrupted sleep, the CoolNest® Hybrid integrates a dual-function hybrid design.

Individually pocketed Dynamic Coil™ springs respond independently to movement, helping minimize motion transfer between partners—making it an ideal choice for couples. At the same time, continuous airflow and efficient heat dissipation reduce the likelihood of nighttime overheating, a common cause of sleep disruption.

Ergonomic Support for Improved Sleep Quality

The hybrid support system combines cushioning foams with responsive coils to deliver a balance of comfort and structural support, making it well-suited for sleepers seeking relief from back discomfort.

Zoned coil configurations provide targeted support to promote proper spinal alignment.  Engineered for versatility, the mattress provides deep pressure relief for the shoulders and hips—essential for side sleepers—while maintaining the firm mid-section support required for healthy back sleeping. Reinforced edge support increases usable surface area and stability, offering consistent support across the entire mattress.

Designed for Couples and Versatile Sleep Styles

The DuoSense™ pillow top adds a plush, inviting surface while preserving the underlying support of the hybrid system. This combination of softness and stability accommodates a wide range of sleep preferences, making it especially suitable for couples with differing comfort needs.

Whether sleeping on the back, side, or in combination positions, the responsive design adapts to different body types and movement patterns, delivering consistent comfort throughout the night.

Designed to meet the needs of hot sleepers, busy households, and anyone seeking durable, high‑performance comfort, the CoolNest® Hybrid delivers effective cooling, reduced sleep disruptions, and enhanced overall sleep quality—at a price point designed for everyday accessibility.

Each mattress is backed by a 10-year warranty and includes free shipping, a 100-night home trial, and HSA/FSA eligibility for added convenience and peace of mind.

The CoolNest® Hybrid is now available nationwide at SweetNight Online, with pricing ranging from $399.99 to $799.99.

About SweetNight

SweetNight is a modern sleep brand dedicated to making high-quality, intelligent sleep solutions accessible to everyday families. The company addresses the biggest challenges in smart sleep by delivering technology that is simple, intuitive, and fairly priced. Its mission is to become the world's leading Self‑Adjusting Sleep Wellness Partner, bringing thoughtful, health‑focused innovation to households everywhere.

** This press release is distributed by PR Newswire through automated distribution system, for which the client assumes full responsibility. **

SweetNight Launches CoolNest® Hybrid Mattress, Delivering Cooler Nights and Better Sleep for Modern Households

SweetNight Launches CoolNest® Hybrid Mattress, Delivering Cooler Nights and Better Sleep for Modern Households

Recommended Articles