Skip to Content Facebook Feature Image

Langsmart Publishes Industry’s First p95 Semantic Cache Benchmarks for On-Premises AI Gateway, Challenges Market: “Show Me the p95”

News

Langsmart Publishes Industry’s First p95 Semantic Cache Benchmarks for On-Premises AI Gateway, Challenges Market: “Show Me the p95”
News

News

Langsmart Publishes Industry’s First p95 Semantic Cache Benchmarks for On-Premises AI Gateway, Challenges Market: “Show Me the p95”

2026-03-17 22:32 Last Updated At:22:50

SAN JOSE, Calif.--(BUSINESS WIRE)--Mar 17, 2026--

NVIDIA GTC 2026 — Langsmart, the enterprise AI governance company, today announced the successful completion of a rigorous enterprise evaluation with a Fortune 200 financial institution. The testing confirms that Langsmart’s Smartflow platform delivers a 10.2x speedup in response times, achieving sub-300ms latency on standard, low-resource hardware.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20260317721580/en/

As enterprise adoption of AI gateways accelerates – with analysts projecting 70% of engineering teams will use them by 2028 – the industry has struggled with a lack of standardized performance data. Langsmart’s latest results provide a transparent blueprint for organizations requiring high-performance AI governance within strict on-premises and air-gapped environments.

Enterprise Evaluation: Performance Under Pressure

The evaluation focused on real-world financial services workloads, prioritizing reliability and speed within a secure infrastructure. Unlike cloud-based gateways that require data to leave the perimeter, Smartflow was deployed as a Docker container on a modest 4vCPU, 8GB server.

Key performance milestones included:

“For banking, insurance, and healthcare, routing prompts and model responses through a third-party cloud is a liability,” said Craig Alberino, Founder and CEO of Langsmart. “Smartflow eliminates that risk by deploying entirely within the client’s network, delivering performance that actually exceeds cloud-hosted alternatives.”

Raising the Industry Standard: "Show Me the p95"

While the evaluation highlights Smartflow’s technical achievements, it also exposes a critical transparency gap in the AI gateway market. Langsmart’s research found that while many vendors promise efficiency, none currently publish p95 or p99 latency data – the metrics most critical for production-grade enterprise stability.

“Enterprise buyers deserve to see real numbers on real hardware, not marketing claims,” said Alberino. “We are calling on all AI gateway vendors to follow our lead and publish standardized benchmarks. If you’re providing enterprise infrastructure, show me the p95.”

Langsmart’s push for transparency aims to provide CISOs and CTOs with the empirical data needed to evaluate AI governance tools effectively, ensuring that security does not come at the cost of performance.

For the full benchmarking methodology and results, visit langsmart.ai/blog/show-me-the-p95.

About Langsmart
Langsmart is the enterprise AI governance company building Smartflow – the on-premises AI firewall, gateway, and governance control plane for regulated industries. Smartflow enables financial services, healthcare, and insurance organizations to govern AI model traffic at the network layer without data leaving their infrastructure. Langsmart is headquartered in the New York City metro area with teams in Connecticut and Austin, TX.

Smartflow semantic cache performance results from enterprise testing with a Fortune 200 financial institution. Testing conducted on a 4vCPU, 8GB on-premises server deployed as a Docker container.

Smartflow semantic cache performance results from enterprise testing with a Fortune 200 financial institution. Testing conducted on a 4vCPU, 8GB on-premises server deployed as a Docker container.

PASADENA, Calif.--(BUSINESS WIRE)--Mar 17, 2026--

ExchangeRight has announced the full subscription of Net-Leased All-Cash 16 DST, which provides 1031 exchange and cash investors with a $46.1 million portfolio of diversified net-leased real estate backed by recession-resilient tenants in necessity-based industries. The offering is designed to provide investors with stable monthly distributions, currently at an annualized rate of 5.08%, which is covered entirely by in-place lease revenue. Net-Leased All-Cash 16 DST is a closed offering and is not accepting new investors.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20260317984535/en/

The portfolio consists of four long-term net-leased properties tenanted by Hy-Vee Grocery, Sprouts Farmers Market, Tractor Supply Company, and Dollar General Market. These assets feature an initial weighted-average lease term of 18.2 years. Spanning a total of 151,226 square feet, the properties are located across Florida, Minnesota, Louisiana, and Vermont.

The Net-Leased All-Cash 16 DST exit strategy is structured to provide investors with a tax-deferred cash-out financing option, along with the potential to complete a 1031 exchange, a 721 exchange into the Essential Income REIT, cash out, or any combination of these options at exit. Pending successful future financing, the company intends to provide investors with the option to receive a tax-deferred lump sum payment of 20%+ of their initial investment through a cash-out financing, and a tax-deferred 721 exchange of the approximately 80% non-financed equity into the Essential Income REIT. There is no guarantee that the DST’s objectives, including its exit strategies, will be achieved.

“The full subscription of Net-Leased All-Cash 16 DST highlights the strong demand for unleveraged and diversified, net-leased real estate offerings that are designed to provide capital preservation, stable income, and strategic exits,” said Warren Thomas, managing partner at ExchangeRight. “This series is structured to serve the current needs of 1031 exchange investors while providing an on-ramp to our Essential Income REIT through the tax-deferred 721 exchange option. Our focus remains on stewarding our investors’ wealth through recession-resilient assets that have historically performed throughout all phases of the economic cycle.” The past performance of ExchangeRight and its previous offerings does not guarantee future performance.

About ExchangeRight

ExchangeRight and its affiliates’ vertically integrated platform features more than $7.2 billion in assets under management that are diversified across over 1,400 properties, and 28 million square feet throughout 47 states, as of February 28, 2026. ExchangeRight pursues its passion to empower people to be secure, free, and generous through its Essential Income REIT and 1031 DST portfolios that target secure capital, stable income, and strategic exits, all of which have historically met or exceeded investor projections since ExchangeRight’s inception. On behalf of investors nationwide, the company structures and manages net-leased portfolios of assets backed primarily by investment-grade corporations that have successfully operated in the necessity-based retail and healthcare industries. Past performance does not guarantee future results. Please visit www.exchangeright.com for more information.

ExchangeRight has announced the full subscription of Net-Leased All-Cash 16 DST, which provides 1031 exchange and cash investors with a $46.1 million portfolio of diversified net-leased real estate backed by recession-resilient tenants in necessity-based industries.

ExchangeRight has announced the full subscription of Net-Leased All-Cash 16 DST, which provides 1031 exchange and cash investors with a $46.1 million portfolio of diversified net-leased real estate backed by recession-resilient tenants in necessity-based industries.

Recommended Articles