At Netflix there is a different approach to analyze an A/B test. Maybe you’ve done this before and have an old script lying around. If it’s new, it’s probably going to take some time to set up, right? Not there.
Why it Matters? Netflix runs on an A/B testing culture: nearly every decision we make about product and business is guided by member behavior observed in test. At any point a Netflix user is in many different A/B tests orchestrated through ABlaze.
This enables us to optimize their experience at speed. Their A/B tests range across UI, algorithms, messaging, marketing, operations, and infrastructure changes. A user might be in a title artwork test, personalization algorithm test, or a video encoding testing, or all three at the same time.
Read more: https://medium.com/netflix-techblog/reimagining-experimentation-analysis-at-netflix-71356393af21
Comments