Udemy

Free A/B Testing Course: Hypotheses, Power and Decision Making

A result can look better without providing convincing evidence that a change caused an improvement. Elly Qi Liu introduces A/B testing through the questions behind an experiment: what to compare, how to plan the comparison and how to interpret the outcome.

Free learning access

Listed as Free on Udemy when checked on 23 October 2026. No coupon or subscription trial is required for the listed lessons. Enrollment needs a Udemy account; availability can change.

About this course

A result can look better without providing convincing evidence that a change caused an improvement. Elly Qi Liu introduces A/B testing through the questions behind an experiment: what to compare, how to plan the comparison and how to interpret the outcome.

Sixteen lectures in five sections total 49 minutes. The syllabus covers statistical foundations, experiment planning, a case study and common interview questions, including the difference between statistical significance and practical value.

Official course Learn AB Testing – Core Data Scientist Skills
Created by Elly Qi Liu
Platform Udemy
Language English
Level Intermediate — Udemy listing
Listed duration 49 minutes; 16 lectures across 5 sections
Certificate Not included with a new free enrollment

Skills you’ll gain

  • Formulating a testable comparison between alternatives
  • Recognizing sampling and statistical-power considerations
  • Separating practical importance from statistical significance
  • Explaining an experiment result with appropriate uncertainty

The course is presented as an introduction and does not list a programming prerequisite. Its focus is experiment reasoning rather than a full implementation in SQL, Python or a production experimentation platform.

The material refers to an optional commercial testing tool and its trial. That external offer is separate from the recorded course’s free access; there is no need to subscribe to study the statistical concepts. Illustrative data can be examined in a free spreadsheet, although a spreadsheet does not itself assign real website visitors to experimental groups.

For a useful learning exercise, write the question, primary measure and decision rule before considering results. This keeps attention on the purpose of the test and helps avoid selecting a favorable metric afterward. The short course offers a foundation, not proof that every observed difference is causal or worth implementing.

Enroll Now ↗

Related courses for your next step

  • Review a lower-level optionDescriptive statistics and variability

    Focus: Constructing frequency and relative-frequency tables · Distinguishing central tendency from variation and relative position

    Beginner

  • Add a related skillProduct outcomes and assumptions

    Focus: Separating strategic outcomes from a list of outputs · Connecting a product vision with objectives

    All Levels

Compare course focus, level and study time
Compare the published course outlines. A lower level is a preparation option, not a required prerequisite.
Course Level Focus Study time
This course — Free A/B Testing Course: Hypotheses, Power and Decision Making Intermediate Formulating a testable comparison between alternatives · Recognizing sampling and statistical-power considerations · Separating practical importance from statistical significance 49 minutes (Udemy listing)
Free Descriptive Statistics in Excel: Summaries, Spread and Outliers Beginner Constructing frequency and relative-frequency tables · Distinguishing central tendency from variation and relative position · Recognizing the difference between sample and population calculations 64 minutes (Udemy listing)
Free Product Strategy Course: Define Outcomes, Test Assumptions and Build a Roadmap All Levels Separating strategic outcomes from a list of outputs · Connecting a product vision with objectives · Identifying assumptions behind an idea 49 minutes (Udemy listing)

Frequently asked questions

Does the optional tool trial make the course a free trial?

No. The course lessons were separately listed as Free; the external software offer is optional.

Will a spreadsheet run experiments on my website?

No. It can support illustrative calculations but does not replace visitor-assignment software.

Is a statistically significant change always useful?

No. Practical effect and the decision context also matter.

Checked on 23 October 2026 using the public course details and syllabus. Coursya has not watched every lesson or tested full playback. New free enrollments do not include a Udemy completion certificate, instructor Q&A or direct messages.

Share this course

Questions & discussion

Share a useful question or correction. Comments appear after moderation. Please avoid personal or sensitive information.

Add to the discussion

Your email address will not be published. Required fields are marked *