Beyond MLOps: Building AI systems with Metaflow

Open-source Metaflow has been powering ML systems at companies like Netflix, 23andMe, and Goldman Sachs for years. With the advent of Generative AI, companies are starting to consider how the new techniques can be embedded in existing applications, and how they can power wholly new product experiences. This requires new engineering and infrastructure, in particular if the company wants to own the models and the user experience, integrating AI tightly into their business and systems, going beyond widely available commercial APIs.

In this talk, we will provide an overview of how Metaflow helps you build novel, differentiated AI-powered systems that require large-scale data engineering, model training, content embedding, inference, and more. We will cover changes compared to earlier ML stacks, focusing on the quickly growing compute needs in particular, and share our recent experiences from real-life large-scale AI use cases, and how they interoperate with existing data and ML systems.