Blueprint of an Experimentation Platform

Search lessons...

Decode Visitor Behavior with Heatmaps and Charts

Decipher how the visitor scrolls through your website and the barriers that might be keeping him from converting.

Decode Visitor Behavior with Heatmaps and Charts

Decipher how the visitor scrolls through your website and the barriers that might be keeping him from converting.

Choose the Metrics and Estimate the Sample Size

Select metrics that matter and tune the statistical parameters to balance between speed and accuracy.

Choose the Metrics and Estimate the Sample Size

Select metrics that matter and tune the statistical parameters to balance between speed and accuracy.

Interpret Statistics and Ensure the Health of Your Data

Analyse test results like a statistician and confidently decide when to stop the test.

Interpret Statistics and Ensure the Health of Your Data

Analyse test results like a statistician and confidently decide when to stop the test.

Take Robust Decisions with Twyman’s Law

Wear the scientist’s hat and get the data to speak the truth by asking the right questions.

Take Robust Decisions with Twyman’s Law

Wear the scientist’s hat and get the data to speak the truth by asking the right questions.

Slice the Data and Juice out Valuable Insights

Split the data into audience segments and discover hidden insights that others miss out.

Slice the Data and Juice out Valuable Insights

Split the data into audience segments and discover hidden insights that others miss out.

The 3 Kinds of Metrics You Need

Add diversity to your insights with success, guardrail and diagnostic metrics - and learn how to use them like a Ninja experimenter.

The 3 Kinds of Metrics You Need

Add diversity to your insights with success, guardrail and diagnostic metrics - and learn how to use them like a Ninja experimenter.

The 11 Characteristics to Pick Good Metrics

Discover the qualities that make some metrics better for experimentation and save yourself from many painful learnings.

The 11 Characteristics to Pick Good Metrics

Discover the qualities that make some metrics better for experimentation and save yourself from many painful learnings.

The 4 Pitfalls to Avoid In Metric Selection

Unravel the fatal fallacies of metric design so that you know when you are heading in the wrong direction.

The 4 Pitfalls to Avoid In Metric Selection

Unravel the fatal fallacies of metric design so that you know when you are heading in the wrong direction.

3 Case Studies to Learn from the Big Tech

Stand on the shoulders of Goliath and see what metric selection looks like in the real world.

3 Case Studies to Learn from the Big Tech

Stand on the shoulders of Goliath and see what metric selection looks like in the real world.

Pro-Tips to Paste on Your Desk

Take away a cheatsheet of tips and tricks and distribute in your team so it might come in handy on a rainy day.

Pro-Tips to Paste on Your Desk

Take away a cheatsheet of tips and tricks and distribute in your team so it might come in handy on a rainy day.

4 Levels of Statistical Significance

Understand significance with compelling visuals and separate the nuances you do not need to know as an experimenter.

4 Levels of Statistical Significance

Understand significance with compelling visuals and separate the nuances you do not need to know as an experimenter.

3 Statistical Error Rates to Tune your Test

Learn to tune the knobs of false positives, statistcal power and false discoveries to control the accuracy and sample size of your test.

3 Statistical Error Rates to Tune your Test

Learn to tune the knobs of false positives, statistcal power and false discoveries to control the accuracy and sample size of your test.

3 Statistical Biases that Mess Up Statistics

Comprehend and tackle the biases of peeking and multiple comparisons that lead to false winners and exaggerated uplifts.

3 Statistical Biases that Mess Up Statistics

Comprehend and tackle the biases of peeking and multiple comparisons that lead to false winners and exaggerated uplifts.

The 2 Smart Tricks to Save Visitors in A/B Tests

Meet the Region of Practical Equivalence and master how shifting the null hypothesis can save visitors with faster disabling or faster deploying.

The 2 Smart Tricks to Save Visitors in A/B Tests

Meet the Region of Practical Equivalence and master how shifting the null hypothesis can save visitors with faster disabling or faster deploying.

A Playbook to Handle 8 Common Statistical Problems

From A/A tests, to highly fluctuating metrics, take home a copy of my playbook to handle the popular problems you might come across.

A Playbook to Handle 8 Common Statistical Problems

From A/A tests, to highly fluctuating metrics, take home a copy of my playbook to handle the popular problems you might come across.

The History of A/B Tests and it’s Less Trustworthy Cousins.

Decipher why A/B tests are the gold standard of trust and get introduced to quasi-experimental algorithms you can use when tests cannot be run.

The History of A/B Tests and it’s Less Trustworthy Cousins.

Decipher why A/B tests are the gold standard of trust and get introduced to quasi-experimental algorithms you can use when tests cannot be run.

The Algorithms Beyond A/B Tests to Utilize Heavy Traffic

See what all you can do if you have more traffic than you need: Personalisations, Multi-variate Tests and Bandit Algorithms.

The Algorithms Beyond A/B Tests to Utilize Heavy Traffic

See what all you can do if you have more traffic than you need: Personalisations, Multi-variate Tests and Bandit Algorithms.

The Cultural Backlash on Experimentation and Surprising Results

Listen to the captivating stories of what happened in history when pioneers have tried to change existing beliefs. Be ready to lead your team through the same challenges all over again.

The Cultural Backlash on Experimentation and Surprising Results

Listen to the captivating stories of what happened in history when pioneers have tried to change existing beliefs. Be ready to lead your team through the same challenges all over again.

1 Hour Group Discussion: Where Does Experimentation Fit in a Future of AI?

No one knows where we are headed with the advancement of AI. Let us discuss how are we seeking the truth once AI becomes the smartest person in the room.

1 Hour Group Discussion: Where Does Experimentation Fit in a Future of AI?

No one knows where we are headed with the advancement of AI. Let us discuss how are we seeking the truth once AI becomes the smartest person in the room.