Started this discussion. Last reply by Vincent Granville Aug 3. 1 Reply 1 Like

Hi all,What would you do if?Bayesian Googe Optimize says probability to be best for Original is 64% (sales CR) and Frequentists's calculation says Original is higher that the Test by 10% (sales CR)…Continue

Started Oct 26, 2016 0 Replies 0 Likes

We need to optimize something (product, drug, prototype etc) by testing it on users.Let's say we have a 6 factor 3 level full factorial experimental design. So we have 3x3x3x3x3x3 = 729 variations.We…Continue

Tags: learning, Machine, experiments, of, Design

Started Oct 26, 2016 0 Replies 0 Likes

Hi,There are sample size calculators for MVT experiments of conversion rates.But how to calculate it in case response is a scale data and is given by each user (like survey data)?Details:I am working…Continue

Started this discussion. Last reply by Gustavjung Sep 6, 2016. 3 Replies 3 Likes

I use SAS JMP to run multivariate testing experiments (MVT, regression), it generates a test plan and performs regression analysis, defining significant effects. The most important thing is to be…Continue

Tags: experiments, of, Design

Gustavjung has not received any gifts yet

Vincent Granville replied to Gustavjung's discussion Making decision on AB test results

"I suggest doing a third, separate analysis (hand-made) on the data that you gathered. There are many algorithms and options to perform A/B testing. Check the section on A/B testing in my book (here) page 259. "

Aug 3

Gustavjung posted a discussion### Making decision on AB test results

Hi all,What would you do if?Bayesian Googe Optimize says probability to be best for Original is 64% (sales CR) and Frequentists's calculation says Original is higher that the Test by 10% (sales CR) but the difference is not statistically significant or not enough sample size. Meanwhile, Test version shows statistical significance in Add to Cart CR only.Sample size is 200K. We cannot run the test more. Original is a delayed CTA page.Would you stick with the Original hopping that it will indeed…See More

Jul 29

Héctor Droguett liked Gustavjung's discussion Do we need maths proficiency for design of experiments?

Sep 7, 2016

Gustavjung liked Gustavjung's discussion Do we need maths proficiency for design of experiments?

Sep 6, 2016

Gustavjung replied to Gustavjung's discussion Do we need maths proficiency for design of experiments?

"Michael, thank you very very much for your comprehensive answer.
I am not a statistician as well, I have degree in psychology of management and experience in conversion optimisation using design of experiments.
I now see some jobs as "Digital…"

Sep 6, 2016

Michael Clayton replied to Gustavjung's discussion Do we need maths proficiency for design of experiments?

"P values are serious topic in itself.
Now days, with automated data collection, large sample sizes, and precision gages for continuous data, you get very low P values simply due to large sample size, so everything looks significant. P values and T…"

Sep 4, 2016

Michael Clayton liked Gustavjung's discussion Do we need maths proficiency for design of experiments?

Sep 4, 2016

Michael Clayton replied to Gustavjung's discussion Do we need maths proficiency for design of experiments?

"I am an engineer NOT a statisticans, but I have been involved in hundreds of experiments of many types over past 50 years, mostly in industrial settings. Lately, I have been using JMP to study non-industrial datasets.
To run experiments involving…"

Sep 4, 2016

Gustavjung's discussion was featured### Do we need maths proficiency for design of experiments?

I use SAS JMP to run multivariate testing experiments (MVT, regression), it generates a test plan and performs regression analysis, defining significant effects. The most important thing is to be able to interpret and know the pitfalls. Mathematical calculations, as such, are not needed. I have read statistics books such as Montgomery Design of experiments and they are usually full of formulas. I still cannot understand how are they used in real world. Yea I understand that I need to know…See More

Sep 4, 2016

- Your Job Title:
- UX Researcher / Conversion analytics

- Interests:
- Finding a new position, Networking, New venture, Other

- No comments yet!

© 2019 Data Science Central ® Powered by

Badges | Report an Issue | Privacy Policy | Terms of Service

**Most Popular Content on DSC**

To not miss this type of content in the future, subscribe to our newsletter.

- Book: Statistics -- New Foundations, Toolbox, and Machine Learning Recipes
- Book: Classification and Regression In a Weekend - With Python
- Book: Applied Stochastic Processes
- Long-range Correlations in Time Series: Modeling, Testing, Case Study
- How to Automatically Determine the Number of Clusters in your Data
- New Machine Learning Cheat Sheet | Old one
- Confidence Intervals Without Pain - With Resampling
- Advanced Machine Learning with Basic Excel
- New Perspectives on Statistical Distributions and Deep Learning
- Fascinating New Results in the Theory of Randomness
- Fast Combinatorial Feature Selection

**Other popular resources**

- Comprehensive Repository of Data Science and ML Resources
- Statistical Concepts Explained in Simple English
- Machine Learning Concepts Explained in One Picture
- 100 Data Science Interview Questions and Answers
- Cheat Sheets | Curated Articles | Search | Jobs | Courses
- Post a Blog | Forum Questions | Books | Salaries | News

**Archives:** 2008-2014 |
2015-2016 |
2017-2019 |
Book 1 |
Book 2 |
More

**Most popular articles**

- Free Book and Resources for DSC Members
- New Perspectives on Statistical Distributions and Deep Learning
- Time series, Growth Modeling and Data Science Wizardy
- Statistical Concepts Explained in Simple English
- Machine Learning Concepts Explained in One Picture
- Comprehensive Repository of Data Science and ML Resources
- Advanced Machine Learning with Basic Excel
- Difference between ML, Data Science, AI, Deep Learning, and Statistics
- Selected Business Analytics, Data Science and ML articles
- How to Automatically Determine the Number of Clusters in your Data
- Fascinating New Results in the Theory of Randomness
- Hire a Data Scientist | Search DSC | Find a Job
- Post a Blog | Forum Questions