Beyond t-tests: Randomization, Traffic Allocation, & Multi-Armed Bandits

Description
Speaker
This event is hosted by SF Big Analytics Group. https://www.meetup.com/SF-Big-Analytics

Basic experimentation systems typically start with implementing t-tests or z-tests. But full experimentation systems comprise design, randomization and traffic allocation, targeting, logging, data processing, and statistical analysis.

In this talk we will explore two topics: First we will review some pitfalls in randomization and traffic allocation that can introduce bias in your results, and how to avoid them in your experimentation system. Then we will show how a good traffic allocation algorithm can make implementing multi-armed bandits much easier. This talk will be aimed at a general audience with basic knowledge of experimentation.

Robert Neal

Robert has spent the past six years building large scale experimentation systems at companies like Credit Karma, Udemy, and Twitter. Most of his 20+ year career has been in software engineering interspersed with stints in user experience research, service design strategy, and entrepreneurship. He is currently the Head of Experimentation at LaunchDarkly where his focus is on building tools that help make it easier for LaunchDarklys customers to make better data-based decisions.
  • Date: Sep 28, 12:00 (US Pacific Time)
  • Fee: Free
  • Available Seats: 378 (max 500)
  • Help? Send Question
Watch Recording