Fuel Your Online Experiments With Evidence + Quality Test Design
Your business metrics × our quality experiment design = more signal, less noise.
Historical
Results ROI CheckRelative median effects from past experiments you can expect on projectsLEADS SALES SIGNUPS REVENUE
for metrics such as:on smaller experiments
Source: GoodUI data; N = ~500
on larger “leap” experiments
Source: Linowski “Leap” projects; N = 50
I’m available for fractional A/B test design projects. 100% response rate.
SCREEN TYPES WE HAVE THE MOST EXPERIENCE DESIGNING & OPTIMIZING FOR
HI, I’M JAKUB
OVER
15yrs
experience designing front-end UI A/B tests
COACHED
~100
experimentation & growth teams
PUBLISHED
~500
experiments on GoodUI
WITH
2
design degrees
AND A
for stats & numbers
FLEXIBLE WAYS OF INTEGRATING WITH YOUR TEAM
As simple as:
Or more complex teams:
JAKUB CAN LEAD:
A/B Test Design
A/B Test Analysis
Ideation & UI Design
Prioritization & Estimation
3 FRACTIONAL WAYS TO KICK OFF
Turn Any
A/B Test Around
Discuss The ROI On This
one time fee of 3,900USD
PROJECTS STARTS WITH
You choosing an a/b test you’d like us to iterate on and turn around.
1 A/B TEST DESIGN
PROJECTS FINISHES WHEN
You re-launch the A/B test we design and we analyze the results.
INCLUDED:
Test Design & Concepting
We’ll iterate on and design 1 test for you to build (Figma).
Test Setup Guidance
We’ll work with your dev team to make sure the test is built and setup to the highest quality.
Experiment Review
We’ll check the quality of your existing experiment (SRMs, effect estimation, triggers & metrics)
Test Analysis
We’ll analyze the results and make recommendations on next steps.
ITERATION GUARANTEE
If the experiment does not lead to an implementation decision, we will provide 1 extra test iteration and retest, free of charge.
MINIMUM REQUIREMENTS FOR SUCCESS:
You have your own dev team
Monthly visitors of 50k+
You have an A/B test to discuss
Maximize Gains With A Big LEAP A/B Test Design
Discuss The ROI On Thisstarting at a
one-time fee of 13,900USD
PROJECTS STARTS WITH
You choosing which screen(s) or flows you’d like us to optimize.
1 BIG LEAP A/B TEST DESIGN
PROJECTS FINISHES WHEN
You launch the A/B test we design and we analyze the results.
INCLUDED:
Test Design & Concepting
We’ll design 1 large leap a/b test for you to build (Figma).
Test Setup Guidance
We’ll work with your dev team to make sure the test is built and setup to the highest quality.
Opportunity Review
We’ll review the screen(s) or flows for multiple optimization opportunities.
Test Analysis
We’ll analyze the results and make recommendations on next steps.
Weekly Calls
To review test design work, capture new ideas & analyze completed tests.
ITERATION GUARANTEE
If the experiment does not lead to an implementation decision, we will provide 1 extra test iteration and retest, free of charge.
MINIMUM REQUIREMENTS FOR SUCCESS:
You have your own dev team
Monthly visitors of 50k+
Iterative A/B Test
Design Marathon
(4 Month+)
Discuss The ROI On This
starting at a
monthly fee of 9,900USD
PROJECTS STARTS WITH
You choosing which metrics and screens you’d like us to optimize.
3 A/B TESTS / MONTH
PROJECTS FINISHES
After the agreed experimentation term is over (4 month minimum).
INCLUDED:
Test Design & Concepting
We’ll design 3 tests each month for you to build (Figma).
Test Setup Guidance
We’ll work with your dev team to make sure the test is built and setup to the highest quality.
Roadmap Updates
We’ll work with your PM to make sure the tests are prioritized and added to the roadmap.
Test Analysis
We’ll analyze the results and make recommendations on next steps.
Weekly Calls
To review test design work, capture new ideas & analyze completed tests.
Iterations
ITERATIONS INCLUDED
Iterations are included, given the structure of the engagement.
MINIMUM REQUIREMENTS FOR SUCCESS:
You have your own dev team
Monthly visitors of 100k+
You are already A/B testing
WHERE DO THE GOOD
IDEAS COME
FROM?
Our Clients
Most of our ideas (good, bad and insignificant) come from over 15 years of experience designing at least ~1,000 front-end UI A/B tests. I’ve worked with selected companies such as:
Coaching & Learning From Growth Teams
We also talk experimentation with a variety of growth teams. I coached, learned from and shared data with ~100 teams. We share what works, what doesn’t and replicate the good stuff.
Actively Observing The Leaders
I also pay active attention to what leading ecommerce companies are A/B testing and how they are evolving. This is a highly impactful source of often successful optimization ideas.
Over the years we published 100+ so called “leaked” experiments based on how leading web sites have been evolving — a really great source of ideas worth replicating.
EXPECT THE HIGHEST
QUALITY A/B
TESTS
in Figma
CLEAR TEST DESIGN CRITERIA
Our experiments are designed with attention to detail which include setting triggers, custom metrics, owners and starting / stopping rules.
in Figma
ULTRA CLEAR DIFFERENCES
All our experiments contain clear differences between the control and variation with annotated screenshots. When you look back at your experiment 1 year later the differences remain clear.
NOTE TAKING
When we discuss tests during calls, we capture notes and decisions — it’s iteration fuel.
SAMPLE ESTIMATES
Our experiments come with upfront sample estimates to minimize false positive rates.
EXPLORATION INCLUDED
The first idea is rarely polished, free from confounders. During early exploration of any A/B test we push boundaries and generate more than one idea — widening the design space; opening conversations about new variables. Only then do we decide what’s in; what’s out or a future test idea.