"Elementary particles are the building blocks of al matter everywhere in the universe.

Their properties are connected…

This article was written by Dan Shewan.

If science-fiction movies have taught us anything, it’s that the future is a bleak and terrifying dystopia ruled by murderous sentient robots.

Fortunately, only one of these things is true – but that could soon change, as…

Leveraging the use of big data, as an insight-generating engine, has driven the demand for data scientists at enterprise-level, across all industry verticals. Whether it is to refine the process of product development, help improve customer retention, or mine through the data to find new business opportunities—organizations are increasingly relying on the expertize of data…

“Arguably the most significant development in information technology over the past few years, blockchain has the potential to change the way that the world approaches big data, with enhanced security and data quality just two of the benefits afforded to businesses using Satoshi Nakamoto’s landmark technology.”…

This is part of a new series of articles: once or twice a month, we post previous articles that were very popular when first published. These articles are at least 6 month old but no more than 12 month old. The previous digest in this series was posted here a while back. 

18 Great Blogs Posted in the last 12…

Social media platforms such as Twitter and Facebook enable everyone to voice their opinions about topics, companies, and products online.

These comments are a great source for companies to analyze their customers’ opinion about their brand or product. However, with billions of Tweets and posts daily, this is can take a lot of time.

Unless of course, you use R J With just a few lines of R-code and the help of machine learning, we’re able to build mood monitoring tools quickly,…

Feature engineering is essential to applied machine learning, but using domain knowledge to strengthen your predictive models can be difficult and expensive. To help fill the information gap on feature engineering, this complete hands-on guide teaches beginning-to-intermediate data scientists how to work with this widely practiced but little discussed topic.

Author…

This is our list of featured articles and resources posted since Monday:

• Dealing With Imbalanced Datasets 
• Naive Principal Component Analysis in R 
• Distributed K-Means with…

This article was written by Tim O'Reilly.…

Principal Component Analysis (PCA) is a technique used to find the core components that underlie different variables. It comes in very useful whenever doubts arise about the true origin of three or more variables. There are two main methods for performing a PCA: naive or less naive. In the naive method, you first check some conditions in your data which will determine the essentials of the analysis. In the less-naive method, you set the those yourself,…

In this post, you discovered how to train a final machine learning model for operational use. You have overcome obstacles to finalizing your model, such as:

• Understanding the goal of resampling procedures such as train-test splits and k-fold cross validation.
• Model finalization as training a new model on all available data.
• Separating the concern of estimating performance from finalizing the model.…

Cross-validation is a technique used to assess the accuracy of a predictive model, based on training set data. It splits the training sets into  test and control sets. The test sets are used to fine-tune the model to increase performance (better classification rate or reduced errors in prediction) and the control sets are used to simulate how the model would perform outside the training set. The control and test sets must be carefully chosen for this method to make…

Artificial intelligence now fits in our daily lives and is deployed in more and more business sectors, hustling human expertise. Artificial intelligence should transform one job over two, but does not necessarily represent a threat. In fact, these jobs should be redirected to less repetitive tasks, with more added value.

 According to a PwC study from March 2017, 70% of the jobs in the energy sector and 65% of the jobs in the consumer sector could be…

This article is from Win-Vector LLC

In this article we will discuss the machine learning method called “decision trees”, moving quickly over the usual “how decision trees work” and spending time on “why decision trees work.” We will write from a computational learning theory perspective, and hope this helps make both decision trees and computational learning theory more comprehensible. The goal…

Summary:  Dealing with imbalanced datasets is an everyday problem.  SMOTE, Synthetic Minority Oversampling TEchnique and its variants are techniques for solving this problem through oversampling that have recently become a very popular way to improve model performance.

There are some problems that never go away. …

This article was written by Tom Simonite.

The nonprofit behind Wikipedia is teaming up with…

Digital transformation is underway in practically every industry in the world. Companies, businesses and organizations throughout the world are leveraging their assets, big data and analytics for an edge over their competitors. In fact, data analytics and big data have gained popularity to the extent that data analysis for differentiation is…

This article was posted by Sunil Ray. Sunil is a Business Analytics and BI professional.

Source for picture: click here

Introduction

Here’s a situation you’ve got…

Monday newsletter published by Data Science Central. Previous editions can be found here.  The contribution flagged with a + is our selection for the picture of the week.

Featured Resources and Technical Contributions

• Bayesian Kalman Filter to predict…

In this article, an R-hadoop (with rmr2) implementation of Distributed KMeans Clustering will be described with a sample 2-d dataset.

1. First the dataset shown below is horizontally partitioned into 4 data subsets and they are copied from local to HDFS, as shown in the following animation. The dataset chosen is small enough and it’s just for the POC purpose,…