Moreh and SGLang Unveil Distributed Inference System at AI Infra Summit 2025

Unveiling Innovation: Moreh and SGLang at AI Infra Summit 2025

In a remarkable showcase of technological advancement, Moreh, a company specializing in AI infrastructure software, teamed up with SGLang to introduce their cutting-edge distributed inference system powered by AMD at the prestigious AI Infra Summit 2025. This event, held from September 9 to 11 in Santa Clara, California, attracted over 3,500 attendees including prominent figures in the tech industry, making it one of the most significant gatherings focused on AI and machine learning infrastructure.

CEO Gangwon Jo of Moreh presented the new system during the company’s session on September 10, highlighting its efficiency and capability to optimize the latest deep learning models, such as DeepSeek. The results showcased during the presentation revealed that Moreh's solution could optimize these models more effectively than the leading competitor, NVIDIA. This breakthrough places Moreh at the forefront of the AI software market, offering a competitive alternative to existing options.

The AI Infra Summit has evolved from its origins as the AI Hardware Summit in 2018, growing from a forum focused solely on semiconductors to an all-encompassing event that addresses the needs of AI infrastructure providers. The 2025 summit featured a variety of topics tailored for hardware suppliers, hyperscalers, and IT specialists working to develop cost-effective and efficient AI solutions.

During the presentation, Gangwon Jo also unveiled an advanced AI semiconductor system that integrates Moreh's software with hardware from Tenstorrent. This partnership signals a strategic move towards creating more affordable options for AI computing. In collaboration with SGLang, which is a leader in the deep learning inference software ecosystem, Moreh made notable strides towards enhancing their presence in the North American market.

The collaboration between Moreh and SGLang occurs at a pivotal moment for the AI industry, with both companies looking to expedite their development of a distributed inference system based on AMD technology. Jo expressed confidence in Moreh's robust technical capabilities, emphasizing the company’s ongoing proof-of-concept projects with several leading firms in the Large Language Model (LLM) sector.

Through diligent collaboration with AMD, Tenstorrent, and SGLang, Moreh aims to solidify its position on the global stage, presenting customers with a variety of AI computing alternatives. Moreh’s ongoing innovations and partnerships are positioned not only to enhance the efficiency of AI models but also to cater to the growing market demand for advanced AI infrastructure.

Moreh continues to cultivate its AI infrastructure engine and is securing comprehensive technological capabilities through its subsidiary, Motif Technologies, as it navigates the global landscape and refines its offerings with partners like AMD, Tenstorrent, and SGLang. The developments revealed at the summit demonstrate Moreh's commitment to revolutionizing the AI landscape and ensuring that they remain at the forefront of technology.

The recent advancements presented at the AI Infra Summit 2025 emphasize the importance of collaboration in the fast-evolving AI sector. Moreh's strategic partnerships highlight a collective effort to provide innovative solutions that not only enhance AI technology but also push the boundaries of what is currently achievable in this dynamic field of research and application.

As the world of AI continues to grow, collaborations like those of Moreh and SGLang are essential in defining the future of AI infrastructure and machine learning capabilities.