When Testing in Production is a Good Idea

Our business needs us to deliver big improvements to our analytics infrastructure and our client SDKs, on a reliable cadence and with low tolerance for regressions. This session covers some techniques we've developed to use the entropy of production to make this possible. I’ll provide a methodology that developers can use to do the same, especially in contexts with a lot of variability in how their software is used. With these ideas, we’ve been able to make predictable 20% to 40% improvements to the speed of our analysis infrastructure every quarter, with a team of two engineers.