Design TaskFlow's Pricing-Page Experiment Verdict and Decision Proposal
Overview
What this challenge is about.
Design TaskFlow's Pricing-Page Experiment Verdict and Decision Proposal. Advanced challenge in analysis. Analyzing real datasets and building models that dri...
The Brief
What you'll do, and what you'll demonstrate.
Determine, with quantified confidence, whether replacing TaskFlow's self-serve pricing page with a 'Contact Sales' version improves conversion rate, lead quality, and revenue per visitor enough to justify launching it.
This is not a data exercise. It is the work an analyst does when stakeholders need answers from messy data. That distinction matters to every hiring manager who has seen candidates describe statistical methods and none who have extracted insight from messy, real-world data.
When you finish, you will have something most graduates do not: a real-world deliverable, verified by Ewance, that you can show to a hiring manager and say "I did this. Here is the proof."
Earning criteria — what you'll demonstrate
- Validate experiment data integrity, including detecting sample ratio mismatch against an intended split
- Apply frequentist and Bayesian methods to the same data and reconcile what each says
- Correct results for multiple-metric testing and for mid-test peeking
- Translate statistical effects into annualized revenue and a defensible business recommendation
- Communicate a nuanced experiment verdict to a non-technical executive audience
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- A B Testing
Apply a b testing to solve real industry problems and demonstrate production-level capability.
- Statistical Analysis
Apply statistical analysis to solve real industry problems and demonstrate production-level capability.
- Bayesian Methods
Apply bayesian methods to solve real industry problems and demonstrate production-level capability.
- Data Visualization
Transform complex data into clear, insightful visual representations.
- Business Metrics
Apply business metrics to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles:
Product / Growth Data Analyst
This challenge mirrors the core loop of a growth analyst: validating an experiment, judging significance honestly, and converting it into a launch decision. It builds the credibility to own experimentation verdicts that product leaders act on.
This challenge sharpens
- a-b-testing
- statistical-analysis
- business-metrics
Experimentation Scientist
Reconciling Bayesian and frequentist results while controlling for peeking and multiple testing is the daily work of an experimentation scientist. The challenge develops the methodological discipline these roles are hired to guarantee.
This challenge sharpens
- a-b-testing
- bayesian-methods
- statistical-analysis
Analytics Consultant
Consultants must turn ambiguous data into a defensible recommendation an executive can act on. Communicating an experiment verdict with quantified confidence to a VP is exactly the bridge this challenge builds.
This challenge sharpens
- business-metrics
- data-visualization
- statistical-analysis