Rule on TaskFlow's Enterprise Landing Page A/B Test
Overview
What this challenge is about.
Run a two-proportion hypothesis test and chi-square check on landing page A/B data, then segment by device. Get a verifiable certificate.
The scenario
TaskFlow sells project-management software to businesses and is mid-transition from self-serve, product-led growth to a sales-assisted enterprise motion, which makes the booked-demo conversion rate the metric that now governs marketing spend. The landing-page redesign is the first concrete bet of that transition, so the roll-out decision is being watched by both the marketing and revenue leadership.
The Brief
What you'll do, and what you'll demonstrate.
Does the redesigned landing page produce a statistically and practically significant increase in the demo-booking conversion rate compared with the existing page, once device-type effects are accounted for?
Earning criteria — what you'll demonstrate
- Formulate and execute a two-proportion hypothesis test correctly, including stating hypotheses, choosing the right test, and checking its assumptions.
- Use a chi-square test of independence to detect confounding from a categorical variable and reason about its impact on the headline result.
- Distinguish statistical significance from practical significance using effect size and confidence intervals.
- Clean and validate raw experiment data before drawing inferences from it.
- Communicate a defensible go/no-go recommendation to non-technical stakeholders in a concise memo.
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Hypothesis Testing
Apply hypothesis testing to solve real industry problems and demonstrate production-level capability.
- A B Testing
Apply a b testing to solve real industry problems and demonstrate production-level capability.
- Chi Square Test
Apply chi square test to solve real industry problems and demonstrate production-level capability.
- Data Cleaning
Apply data cleaning to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
Marketing Analyst
Mirrors the core of the role: turning a raw experiment into a defensible recommendation. You practice running and reading an A/B test end to end and translating the statistics into a business call leadership can act on.
This challenge sharpens
- a-b-testing
- hypothesis-testing
- data-cleaning
Growth / Experimentation Analyst
Growth teams live in continuous experimentation. This challenge builds the discipline of testing conversion lift rigorously, checking for confounders, and avoiding false positives before shipping a change to all traffic.
This challenge sharpens
- a-b-testing
- hypothesis-testing
- chi-square-test
Product Data Analyst
Product analysts validate whether shipped changes move the metrics that matter. You practice cleaning event-style data, segmenting by a categorical dimension, and communicating significance versus impact to product stakeholders.
This challenge sharpens
- data-cleaning
- chi-square-test
- hypothesis-testing