Listed as Free on Udemy when checked on 23 October 2026. No coupon or subscription trial is required for the listed lessons. Enrollment needs a Udemy account; availability can change.
About this course
A result can look better without providing convincing evidence that a change caused an improvement. Elly Qi Liu introduces A/B testing through the questions behind an experiment: what to compare, how to plan the comparison and how to interpret the outcome.
Sixteen lectures in five sections total 49 minutes. The syllabus covers statistical foundations, experiment planning, a case study and common interview questions, including the difference between statistical significance and practical value.
| Official course | Learn AB Testing – Core Data Scientist Skills |
|---|---|
| Created by | Elly Qi Liu |
| Platform | Udemy |
| Language | English |
| Level | Intermediate — Udemy listing |
| Listed duration | 49 minutes; 16 lectures across 5 sections |
| Certificate | Not included with a new free enrollment |
Skills you’ll gain
- Formulating a testable comparison between alternatives
- Recognizing sampling and statistical-power considerations
- Separating practical importance from statistical significance
- Explaining an experiment result with appropriate uncertainty
The course is presented as an introduction and does not list a programming prerequisite. Its focus is experiment reasoning rather than a full implementation in SQL, Python or a production experimentation platform.
The material refers to an optional commercial testing tool and its trial. That external offer is separate from the recorded course’s free access; there is no need to subscribe to study the statistical concepts. Illustrative data can be examined in a free spreadsheet, although a spreadsheet does not itself assign real website visitors to experimental groups.
For a useful learning exercise, write the question, primary measure and decision rule before considering results. This keeps attention on the purpose of the test and helps avoid selecting a favorable metric afterward. The short course offers a foundation, not proof that every observed difference is causal or worth implementing.
Related courses for your next step
- Review a lower-level optionDescriptive statistics and variability
Focus: Constructing frequency and relative-frequency tables · Distinguishing central tendency from variation and relative position
Beginner
- Add a related skillProduct outcomes and assumptions
Focus: Separating strategic outcomes from a list of outputs · Connecting a product vision with objectives
All Levels
Compare course focus, level and study time
| Course | Level | Focus | Study time |
|---|---|---|---|
| This course — Free A/B Testing Course: Hypotheses, Power and Decision Making | Intermediate | Formulating a testable comparison between alternatives · Recognizing sampling and statistical-power considerations · Separating practical importance from statistical significance | 49 minutes (Udemy listing) |
| Free Descriptive Statistics in Excel: Summaries, Spread and Outliers | Beginner | Constructing frequency and relative-frequency tables · Distinguishing central tendency from variation and relative position · Recognizing the difference between sample and population calculations | 64 minutes (Udemy listing) |
| Free Product Strategy Course: Define Outcomes, Test Assumptions and Build a Roadmap | All Levels | Separating strategic outcomes from a list of outputs · Connecting a product vision with objectives · Identifying assumptions behind an idea | 49 minutes (Udemy listing) |
Frequently asked questions
Does the optional tool trial make the course a free trial?
No. The course lessons were separately listed as Free; the external software offer is optional.
Will a spreadsheet run experiments on my website?
No. It can support illustrative calculations but does not replace visitor-assignment software.
Is a statistically significant change always useful?
No. Practical effect and the decision context also matter.
Checked on 23 October 2026 using the public course details and syllabus. Coursya has not watched every lesson or tested full playback. New free enrollments do not include a Udemy completion certificate, instructor Q&A or direct messages.
Questions & discussion
Share a useful question or correction. Comments appear after moderation. Please avoid personal or sensitive information.