Moreh and SGLang Collaborate to Introduce Distributed Inference System at AI Infra Summit 2025

Moreh and SGLang Team Up at AI Infra Summit 2025

The AI Infra Summit 2025 has emerged as a pivotal conference focusing on the infrastructure framework for artificial intelligence and machine learning. Hosted from September 9 to 11 in Santa Clara, California, this year's summit drew an impressive crowd, with around 3,500 attendees and over 100 partner organizations. The event provided a platform tailored for hardware suppliers, hyperscalers, and computer infrastructure specialists aiming to advance the development of efficient and cost-effective AI systems.

On September 10, during a dedicated session on Enterprise AI, Gangwon Jo, the CEO of Moreh, took to the stage to present the latest advancements in their distributed inference system running on AMD technology. With benchmark results that suggested superior performance against leading models, including DeepSeek, the company's system showcased its capability to outperform NVIDIA's solutions.

The partnership with SGLang, a trailblazer in the deep learning inference software ecosystem, marked a significant collaboration at the summit. Together, they co-hosted a presentation and coordinated a networking booth, further reinforcing ties within the global AI community, particularly within the North American market. This interaction not only highlighted their commitment to collaboration but also pointed towards future developments in distributed inference systems based on AMD.

“Moreh stands at the forefront of technical capabilities among AMD's global software partners,” said Gangwon Jo, who reaffirmed the company's dedication to validating and enhancing concepts with several major firms in the AI landscape.

The company seeks to establish itself as a competitive player by offering diverse alternatives in AI-based computing, facilitated by close collaboration with AMD, Tenstorrent, and SGLang. Moreh is also in the process of developing its own AI infrastructure engine and validating the technological capabilities of Motif Technologies, a subsidiary focused on large language models (LLMs).

This collaborative effort at the AI Infra Summit emphasizes Moreh's aspiration to capture substantial market share in the rapidly evolving landscape of deep learning inference. With significant backing from partners like AMD and Tenstorrent, the outlook for Moreh appears promising as they aim to redefine the competitive environment in AI-driven solutions.

As the AI landscape continues to expand, the developments presented at the summit suggest a shift towards more diverse and innovative approaches in the industry. Attendees witnessed firsthand the potential of combined technologies from leaders in the field, paving the way for exciting advancements in AI infrastructure.