Rule on TaskFlow's Enterprise Landing Page A/B Test
Overview
What this challenge is about.
Rule on TaskFlow's Enterprise Landing Page A/B Test. Intermediate challenge in analysis. Analyzing real datasets and building models that drive decisions, ea...
The Brief
What you'll do, and what you'll demonstrate.
Does the redesigned landing page produce a statistically and practically significant increase in the demo-booking conversion rate compared with the existing page, once device-type effects are accounted for?
This is not a data exercise. It is the work an analyst or data scientist does when stakeholders need answers from messy data. That distinction matters to every hiring manager who has seen candidates describe statistical methods and none who have extracted insight from messy, incomplete, real-world data.
When you finish, you will have something most graduates do not: a real-world deliverable, verified by Ewance, that you can show to a hiring manager and say "I did this. Here is the proof."
When you finish, you will have something most graduates do not: a real-world deliverable, verified by Ewance, that you can show to a hiring manager and say "I did this. Here is the proof."
Earning criteria — what you'll demonstrate
- Formulate and execute a two-proportion hypothesis test correctly, including stating hypotheses, choosing the right test, and checking its assumptions.
- Use a chi-square test of independence to detect confounding from a categorical variable and reason about its impact on the headline result.
- Distinguish statistical significance from practical significance using effect size and confidence intervals.
- Clean and validate raw experiment data before drawing inferences from it.
- Communicate a defensible go/no-go recommendation to non-technical stakeholders in a concise memo.
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Hypothesis Testing
Apply hypothesis testing to solve real industry problems and demonstrate production-level capability.
- A B Testing
Apply a b testing to solve real industry problems and demonstrate production-level capability.
- Chi Square Test
Apply chi square test to solve real industry problems and demonstrate production-level capability.
- Data Cleaning
Apply data cleaning to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
Marketing Analyst
Mirrors the core of the role: turning a raw experiment into a defensible recommendation. You practice running and reading an A/B test end to end and translating the statistics into a business call leadership can act on.
This challenge sharpens
- a-b-testing
- hypothesis-testing
- data-cleaning
Growth / Experimentation Analyst
Growth teams live in continuous experimentation. This challenge builds the discipline of testing conversion lift rigorously, checking for confounders, and avoiding false positives before shipping a change to all traffic.
This challenge sharpens
- a-b-testing
- hypothesis-testing
- chi-square-test
Product Data Analyst
Product analysts validate whether shipped changes move the metrics that matter. You practice cleaning event-style data, segmenting by a categorical dimension, and communicating significance versus impact to product stakeholders.
This challenge sharpens
- data-cleaning
- chi-square-test
- hypothesis-testing