Analysis
A/B Test Landing Page for a 40-Person SaaS Scale-Up
Overview
What this challenge is about.
You are a marketing analyst at TaskFlow. You have a dataset of 10,000 visitors with columns: group (control/variant), converted (yes/no), time on page (seconds), and device type (mobile/desktop). Perform a hypothesis test to compare conversion rates between the two groups at a 5% significance level. Also, check for any confounding effects from device type using a chi-square test. Provide a one-page memo with your conclusion and recommendation on whether to roll out the new page. Success means a statistically sound conclusion with proper consideration of assumptions.
The Brief
What you'll do, and what you'll demonstrate.
Determine whether the new landing page significantly increases demo sign-up conversion rate compared to the old page.
Earning criteria — what you'll demonstrate
- Formulate null and alternative hypotheses for a proportion test
- Perform a two-sample z-test for proportions
- Conduct a chi-square test for independence
- Interpret p-values and make decisions based on significance level
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
Careers
Roles this prepares you for.
Real titles. Real skill bridges. Pick the one closest to your trajectory.
Career mappings coming soon.