#USA #Chicago #KoveSDM #Redis #Valkey

Kove Revolutionizes AI Inference with Benchmark Results

In a significant announcement, Kove, the innovator behind KoveSDM™, shared impressive benchmark results that showcase the capabilities of their software-defined memory technology. During the AI Infra Summit 2025, Kove revealed that its KoveSDM™ can boost AI inference workloads on Redis and Valkey by up to five times compared to traditional local DRAM memory. This advancement makes KoveSDM™ the world's first commercially viable software-defined memory solution, offering substantial improvements in performance and efficiency.

KoveSDM™ allows organizations to pool memory resources dynamically across their systems. By leveraging pooled memory that can be utilized on any Linux-compatible hardware, it eliminates the limitations of fixed and fragmented traditional DRAM setups. This technology is pivotal in addressing the ongoing challenges of high-performance AI workloads that require rapid processing and minimal latency.

Benchmark Insights

The benchmarks conducted on Oracle Cloud Infrastructure demonstrated remarkable performance enhancements with KoveSDM™ in place. Results indicated substantial improvements in workload management:

• - Redis Benchmark (v7.2.4): 50th Percentile SET operations were 11% faster, and GET operations saw a 42% increase in speed. On the 100th Percentile, SET operations were 16% slower but GET operations were still 14% more efficient.
• - Valkey Benchmark (v8.0.4): 50th Percentile SET operations improved by 10%, with GET operations marginally faster by 1%. In the 100th Percentile scenarios, SET operations experienced a 6% increase, while GET saw a striking 25% boost in speed.

John Overton, CEO of Kove, emphasized the significance of these results, stating, "These benchmarks validate that software-defined memory can dramatically accelerate AI inference by minimizing unnecessary recomputation and cache evictions, leading to substantial savings in GPU usage. The potential financial benefits for large-scale operations are tremendous, potentially saving millions of dollars annually."

With companies relying more on artificial intelligence, KoveSDM™ is uniquely positioned to address the increasing memory requirements that traditional DRAM cannot manage efficiently. As GPU and CPU capabilities expand, the bottleneck has shifted towards memory, making Kove’s innovative solution an essential component in any AI infrastructure.

Strategic Business Benefits

Organizations that deploy KoveSDM™ are likely to observe considerable operational and financial advantages, including:

• - Potential annual savings of $30-40 million from enhanced efficiency.
• - 20-30% reductions in hardware expenditures by delaying high-memory server refreshes.
• - 25-54% cuts in power and cooling expenses arising from improved memory usage.
• - Reduction in costly downtimes leading to opportunities for more effective operations.

According to Beth Rothwell, Director of GTM Strategy at Kove, this innovation marks a new category in technical solutions. "KoveSDM™ is crucial for creating a sustainable infrastructure that supports the intensive demands of AI applications. It allows AI systems to scale seamlessly while keeping GPUs actively engaged in productive work, ultimately leading to significant cost efficiencies."

The Urgent Need for Enhanced Memory Solutions

As the demand for AI technologies escalates, projections suggest that the requirements for computational resources are doubling every 6 to 12 months. Traditional DRAM budgets simply can't keep pace, leading to challenges that current tiered solutions struggle to address effectively.

KoveSDM™ provides a pivotal solution by optimizing DRAM usage across server ecosystems while delivering performance standards akin to local memory. The comparative advantage of KoveSDM™ over conventional tiered KV caching highlights its potential to outperform in various practical applications, further solidifying Kove's position as a leader in advancing AI infrastructure capabilities.

KoveSDM™ is available now and can be deployed without any changes to existing applications, operating seamlessly on supported x86 hardware running Linux.

About Kove

Founded in 2003, Kove has consistently broken new ground in tackling some of technology's most complex issues. From pioneering high-speed backups to record-setting storage solutions, Kove has demonstrated excellence in enhancing computing technologies. Their latest achievement, KoveSDM™, provides organizations the tools they need to maximize performance and operational effectiveness. Kove's commitment to innovation continues to impact a diverse range of industries, including finance, life sciences, energy, and defense. To learn more about Kove and its groundbreaking solutions, visit kove.com.