AB-tests analysis Using multiple metrics in AB-test analysis

203. Using multiple metrics in AB-test analysis

In this lesson we’ll try to answer the question “Is comparing only 1 metric is enough for AB-test analysis?”.

Often, when using third-party AB-test tools like Google Analytics or Optimizely you get only 1 metric out of the box – page visits or CTR (Click Through Rate). These metrics are useful for landing page AB-testing – we test designs or copy to make more visitors sign up.

What we really want is visitors become customers, but it happens after signup, sometimes it takes days or weeks for visitors to convert to customers (if your product has a...

“well worth the money”
Sign up and check out 36 free lessons and exercises.

Anatoli Makarevich, author of SQL Habit About SQL Habit

Hi, it’s Anatoli, the author of SQL Habit. 👋

SQL Habit is a course (or, as some of the students say, “business simulator”). It’s based on a story of a fictional startup called Bindle. You’ll play a role of their Data Analyst 📊 and solve real-life challenges from Business, Marketing, and Product Management.

SQL Habit course is made of bite-sized lessons (you’re looking at one atm) and exercises. They always have a real-life setting and detailed explanations. You can immediately apply everything you’ve learned at work. 🚀

“well worth the money”

Fluent in SQL in a month

Master Data Analysis with SQL with real life examples from Product Management, Marketing, Finance and more.
-- Type your query here, for example this one -- lists all records from users table: SELECT * FROM users
Loading chart... ⏳
Previous lesson: Building basic AB-test funnel
Next exercise: Calculating ARPU of AB-test variation