MESA: Building a Personalized Messaging System at Netflix

At Netflix, we reach out to our members about new recommendations in the most effective way, through emails and notifications. We deliver billions of messages per year, and we work on the algorithms that decide what to send, when and to whom. The personalized system employs algorithms at the intersection of Personalization, Reinforcement Learning and Causal Inference.

In this talk, we will take the audience through a tour of the continuous explore and exploit system we have iterated on, and showcase a few particularly complex and fascinating challenges with offline evaluation and experimentation.