Profile and Optimize a Virtual-Memory-Heavy Image Pipeline
Overview
What this challenge is about.
Profile and Optimize a Virtual-Memory-Heavy Image Pipeline. Intermediate challenge in analysis. Analyzing real datasets and building models that drive decisi...
The Brief
What you'll do, and what you'll demonstrate.
Halve the 8GB peak RSS of an AVIF re-encoding pipeline using virtual-memory-aware changes, validated against the same batch.
This is not a data exercise. It is the work an analyst does when stakeholders need answers from messy data. That distinction matters to every hiring manager who has seen candidates describe statistical methods and none who have extracted insight from messy, real-world data.
When you finish, you will have something most graduates do not: a real-world deliverable, verified by Ewance, that you can show to a hiring manager and say "I did this. Here is the proof."
Earning criteria — what you'll demonstrate
- Read /proc/PID/smaps to attribute RSS to specific mappings
- Distinguish major from minor page faults and their typical causes
- Apply madvise + streaming techniques to reduce peak memory
- Document the cause-and-effect chain clearly enough to fund the change
Program Fit
Where this fits in your program.
Sharpens the same skills your degree expects you to demonstrate.
Aligned coursework coming soon.
Skills
Skills you'll demonstrate.
Each one shows up on your verified credential.
- Virtual Memory
Apply virtual memory to solve real industry problems and demonstrate production-level capability.
- Performance Profiling
Apply performance profiling to solve real industry problems and demonstrate production-level capability.
- Memory Hierarchy
Apply memory hierarchy to solve real industry problems and demonstrate production-level capability.
- Go
Apply go to solve real industry problems and demonstrate production-level capability.
- System Calls
Apply system calls to solve real industry problems and demonstrate production-level capability.
- Documentation
Apply documentation to solve real industry problems and demonstrate production-level capability.
Careers
Career paths this challenge builds toward
Completing this challenge demonstrates skills that transfer directly to these roles: