Name: Keynote: Centralizing & Simplifying Enterprise AI Workflows with Envoy AI Gateway - Alexa Griffith, Senior Software Engineer, Bloomberg
Start: 2024-11-14T09:25:00-0700
End: 2024-11-14T09:30:00-0700

In-person
November 12-15
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon North America 2024 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Mountain Standard Time (UTC -7). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change and session seating is available on a first-come, first-served basis.

Thursday November 14, 2024 9:25am - 9:30am MST

Salt Palace | Level 1 | Hall DE

As Generative AI reshapes the industry, the demands on AI platforms have rapidly evolved. Organizations now require centralized infrastructure to manage and optimize access to self-trained, open source, and commercial AI models at scale. In this talk, we introduce the Envoy AI Gateway, a collaborative open source effort led by engineers from Bloomberg and Tetrate. Learn how the Envoy AI Gateway, which is built atop Envoy Gateway and Envoy Proxy, provides a unified, scalable solution for model access, usage limiting, and upstream authorization.

Speakers

Alexa Griffith

Senior Software Engineer, Bloomberg

Alexa Griffith is a Senior Software Engineer on Bloomberg’s Cloud Native Compute Services organization. She works on building an inference platform for ML workflows and the open source project KServe. She enjoys solving engineering challenges at scale and writing code in Go. She... Read More →

LLM gateway 11 12 pptx

Thursday November 14, 2024 9:25am - 9:30am MST
Salt Palace | Level 1 | Hall DE

Keynote Sessions

Feedback form is now closed.

KubeCon + CloudNativeCon North America 2024

Alexa Griffith

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!