Gustavjung
• Male

## Gustavjung's Discussions

### Making decision on AB test results

Started this discussion. Last reply by Prateek Baranwal Feb 6.

Hi all,What would you do if?Bayesian Googe Optimize says probability to be best for Original is 64% (sales CR) and Frequentists's calculation says Original is higher that the Test by 10% (sales CR)…Continue

### DoE + Machine learning

Started Oct 26, 2016

We need to optimize something (product, drug, prototype etc) by testing it on users.Let's say we have a 6 factor 3 level full factorial experimental design. So we have 3x3x3x3x3x3 = 729 variations.We…Continue

Tags: learning, Machine, experiments, of, Design

### Sample size for Design of Experiment

Started Oct 26, 2016

Hi,There are sample size calculators for MVT experiments of conversion rates.But how to calculate it in case response is a scale data and is given by each user (like survey data)?Details:I am working…Continue

### Do we need maths proficiency for design of experiments?

Started this discussion. Last reply by Gustavjung Sep 6, 2016.

I use SAS JMP to run multivariate testing experiments (MVT, regression), it generates a test plan and performs regression analysis, defining significant effects. The most important thing is to be…Continue

Tags: experiments, of, Design

# Gustavjung's Page

## Latest Activity

"I suggest doing a third, separate analysis (hand-made) on the data that you gathered. There are many algorithms and options to perform A/B testing. Check the section on A/B testing in my book (here) page 259. "
Aug 3, 2019
Aug 3, 2019
Gustavjung posted a discussion

### Making decision on AB test results

Hi all,What would you do if?Bayesian Googe Optimize says probability to be best for Original is 64% (sales CR) and Frequentists's calculation says Original is higher that the Test by 10% (sales CR)  but the difference is not statistically significant or not enough sample size. Meanwhile, Test version shows statistical significance in Add to Cart CR only.Sample size is 200K. We cannot run the test more. Original is a delayed CTA page.Would you stick with the Original hopping that it will indeed…See More
Jul 29, 2019
Gustavjung's 2 discussions were featured
Jul 29, 2019

## Profile Information

Job Title:
UX Researcher / Conversion analytics
Interests:
Finding a new position, Networking, New venture, Other

## Comment Wall

Join Data Science Central