#USA #AI #San Francisco #Tetrate #Envoy

Tetrate Launches Built on Envoy: Enhancing Accessibility for AI Workloads

Tetrate, a key contributor to the Envoy open-source project, has launched the Built on Envoy marketplace, aiming to streamline the deployment of Envoy for AI applications. This innovative platform provides developers with free, community-driven extensions that tackle common challenges faced during Envoy's integration. By sharing these solutions, Tetrate not only fosters collaboration but also accelerates the deployment of Envoy across various sectors.

The Need for Built on Envoy

Envoy servers have become integral to organizations that leverage AI technologies. However, the complexities in deploying these systems often lead companies to develop custom solutions internally, resulting in inefficiencies and missed opportunities for shared innovation. Tetrate's Built on Envoy addresses these issues by providing ready-to-use extensions that simplify common tasks, enabling users to adopt Envoy more easily and maximize its capabilities.

Originally created in 2015 at Lyft, Envoy is currently utilized by significant players in the tech industry, including Netflix, Airbnb, and AWS, processing millions of requests daily. Despite its robust capabilities, many teams were deterred by the steep learning curve associated with Envoy's implementation. Recognizing this, Tetrate has developed a marketplace where developers can discover and deploy proven extensions without the need for in-depth expertise or extensive resources.

Key Features of the Marketplace

The Built on Envoy platform includes initial extensions tailored to address prevalent deployment hurdles. Key functionalities encompass:

• - Security and Authentication Tools: Extensions for WAF integration, OAuth2 token exchange, and SAML authorization workflows.
• - AI Governance Solutions: Tools to verify LLM requests against Azure Content Safety and provisions for request caching.
• - Operational Enhancements: Proxy configuration support for data platforms, alongside a unique file-server extension to serve static assets directly from Envoy.

This initial offering is designed to tackle the most pressing issues that teams encounter, paving the way for smoother operational systems.

Community Collaboration

Built on Envoy is publicly available under the Apache 2.0 open-source license, reinforcing Tetrate's commitment to fostering a long-lasting community ecosystem. The goal is to encourage organizations from diverse industries to contribute their own extensions, further enriching the marketplace and enhancing support and resources for Envoy users.

The marketplace also boasts a CLI package manager, allowing developers to easily test and iterate on extensions locally. This feature drastically reduces the time required to prototype and validate ideas, democratizing access to Envoy's capabilities.

In the words of Matt Klein, the creator of Envoy, “The growth of dynamic modules and support for Go and Rust in extensions will unlock Envoy's potential for countless users.” This enthusiasm underscores Tetrate’s aim to simplify the extension creation process significantly, making it accessible even for those unfamiliar with Envoy’s intricacies.

Long-term Goals

Looking ahead, Tetrate envisions a thriving ecosystem where users not only utilize existing extensions but also actively contribute new solutions. Varun Talwar, CTO at Tetrate, highlights how the platform provides a communal approach to problem-solving, enabling teams to work faster and share valuable resources.

Prominent figures in the field, including Chris Aniszczyk of the Cloud Native Computing Foundation, emphasize that initiatives like Built on Envoy are pivotal for accelerating the open-source community's growth. The ease of extending Envoy will empower more developers to participate in enriching its foundational qualities.

For engineers eager to engage with the Built on Envoy ecosystem, detailed resources can be found at built on envoy.io, where the platform offers essential information on the extensions currently available and guidelines for first-time users.

About Tetrate

Tetrate stands at the forefront of technological advancements related to Envoy, providing enterprises with reliable application networking and security solutions. By empowering organizations to scale their AI deployments effectively, Tetrate plays a pivotal role in adapting modern technologies for future applications. Interested parties can learn more about Tetrate by visiting tetrate.io.