Vincent Granville's Blog – December 2011 Archive (17)

Social Networks: How to Measure User Engagement?

Here are a few interesting KPI's:

  • Average session duration
  • Proportion of active versus passive behavior (active = posting a blog, inviting a thread; passive = browsing, reading articles)
  • New members per week, with breakdown US vs. non US
  • Average number of groups per member
  • Average number of friends per member
  • Number of page views per user (per member) per month
  • Time to last visit (average; per user; per…

Added by Vincent Granville on December 20, 2011 at 8:17am — No Comments

Only One-Third of Companies Making Effective Use of Data

HOPKINTON, Mass., Dec. 5, 2011 -- EMC Corporation today unveiled the findings of the largest-ever global survey of the data science community. Spanning the United States, the United Kingdom, France, Germany, India and China, the EMC Data Science Study reveals and quantifies a rampant scarcity across the globe for the prerequisite skills necessary for a company to capitalize on the opportunities found at the intersection of Big Data and data analytics. Only one-third of companies are…


Added by Vincent Granville on December 12, 2011 at 8:33am — No Comments

Healthcare fraud detection still uses cave-man data mining techniques

The Washington Education Association (WEA, in Washington State) is partnering with Aon Hewitts (Illinois), a verification company, to eliminate a specific type of health insurance fraud: teachers reporting non-qualifying people as dependents, such as an unemployed friend with no health insurance. The fraud is used by "nice" people (teachers) to provide health insurance to people who would otherwise have none, by reporting them as spouse or kids.

Interestingly, I saw the letter sent to…


Added by Vincent Granville on December 7, 2011 at 5:16pm — No Comments

Interview with Kaggle CEO Anthony GoldBloom

For those that haven't heard of Kaggle before, Kaggle is a team of people that provide the functionality and support to host Data Mining contests. Here is how it works : Suppose that you are working for a Telco and wish to implement a new Churn prediction model. Rather than running this project in-house, you submit your data to Kaggle. What happens next is that -hopefully- many…


Added by Vincent Granville on December 5, 2011 at 10:41am — No Comments

Online advertising: a solution to optimize ad relevancy

When you see google ads on Google search result pages or elsewhere, the ads that are displayed in front of you eyes (should) have been highly selected in order to maximize the chance that you convert and generate ad revenue for Google. Same on Facebook, Yahoo, Bing, LinkedIn and on all ad networks.

If you think that you see irrelevant ads, either they are priced very cheaply, or Google's ad relevancy algorithm is not working well.

Ad scoring algorithms used to be very simple,…


Added by Vincent Granville on December 3, 2011 at 8:43am — No Comments

Why and how you should build a data dictionary for big data sets

One of the most valuable tools that I've used, when performing exploratory analysis, is building a data dictionary. It offers the following advantages:

  • Identify areas of sparsity and areas of concentration in high-dimensional data sets
  • Identify outliers and data glitches
  • Get a good sense of what the data contains, and where to spend time (or not) in further data mining

What is a data dictionary

A data dictionary is a table…


Added by Vincent Granville on December 2, 2011 at 8:41am — No Comments

EMC Tries To Unify Big Data Analytics | InformationWeek

EMC Greenplum Modular Data Computing Appliance puts SQL and Hadoop in the same box, but is it a truly cohesive platform?


Added by Vincent Granville on December 2, 2011 at 8:40am — No Comments

Connecting with the Social Analytics Experts

Social Media Tips for Analytics Professionals 

From Text and Data Mining to Market Research and Social Media Consulting, few are more influential than today’s guests. In advance of the West Coast Text Analytics Summit (Nov. 10-11, San Jose), Text Analytics News caught up with four analytics leaders who are helping…


Added by Vincent Granville on December 2, 2011 at 8:39am — No Comments

How to detect a pattern? Problem and solution.

Check the three charts below: only one shows no pattern and is truly random. Which one?

Chart #1


Chart #2



Added by Vincent Granville on December 2, 2011 at 8:38am — No Comments

Statisticians Have Large Role to Play in Web Analytics | American Statistical Association

Read my full interview for AMSTATat http://magazine.amstat.org/blog/2011/09/01/webanalytics/. You will also find my list of recommended books. Here is a copy of the interview, in case the original article (posted on AMSTAT News) disappear.

(Dr. Granville's Interview for AMSTAT)

Vincent Granville is chief scientist at a publicly traded company and the founder of AnalyticBridge. He has consulted on…


Added by Vincent Granville on December 2, 2011 at 8:37am — No Comments

Classification accuracy using different bag of words

In this post I show how the accuracy of the classifier is influenced by the bag of words. 

The test has been done on a naive classifier but it returns good information about the data set.


The above image is an example of the bag of words used…


Added by Vincent Granville on December 2, 2011 at 8:36am — No Comments

Lifetime value of an e-mail blast: much longer than you think

See below an example of an Analyticbridge email campaign that was monitored over a period of about 600 days. It clearly shows that 20% of all clicks originate after day #5. Yet most advertisers and publishers ignore clicks occurring after day #3. Not only 20% of all clicks occurred after day #3, but the best clicks (in terms of conversions) occurred several weeks after the email blast. Also, note an organic spike occurring on day #23 in the chart below -…


Added by Vincent Granville on December 2, 2011 at 8:35am — No Comments

IBM's vice president of Big Data Products explains the role of data scientists | ComputerWorld

What is a data scientist? A data scientist is someone who analyzes an organization's big data to discover actionable trends that lead to business results. Data scientists look at what questions business people need to ask to remain competitive. They work directly with C-level executives, advising them on how to drive maximum value from big data and integrate new information. In many ways, a …


Added by Vincent Granville on December 2, 2011 at 8:33am — No Comments

Ventana Research Unveils Largest Research Ever Conducted on Business Analytics

PLEASANTON, Calif.- February 25th, 2011 - The largest benchmark research ever done on business analytics establishes for the first time that analytics has become the new engine for business competitiveness and profitability. This landmark research from Ventana Research, which involved input from more than 2,850 organizations, makes clear for the first time the little-understood role of business analytics in the success and failure of businesses.

The research found that more than…


Added by Vincent Granville on December 2, 2011 at 8:30am — No Comments

What is data science?

Below (in italic) is Revolution Analytics point of view. Mine is that is not just science, but a mix of craftsmanship, intuition, art, business acumen, magic and science. I would rather call it data witchcraft, and I call myself a data wizard.

Ever since the term "Data Scientist" was coined by DJ Patil and Jeff Hammerbacker in 2009,…


Added by Vincent Granville on December 2, 2011 at 8:30am — No Comments

How do your quantify data as large, big, or huge?

How big your data is depends on the quantity of information that it contains (measured using entropy metrics), rather than the number of terabytes. Huge data that is sparse or shallow is indeed not huge - and can be compressed very efficiently. What do you think?

Here's Stfan Carandy's viewpoint (founder of Bayesia Networks):

If I may cross-post the following from our blog at …


Added by Vincent Granville on December 2, 2011 at 8:28am — No Comments

86 Helpful Tools for the Data Professional PLUS 45 Bonus Tools | Syracuse University

Source: Joshua Kitlas.

I have been working on this (mostly) annotated collection of tools and articles that I believe would be of help to both the data dabbler and professional. If you are a data scientist, data analyst or data dummy, chances are there is something in here for you. Included is a list of tools, such as programming languages and web-based utilities,…


Added by Vincent Granville on December 2, 2011 at 8:26am — No Comments

Monthly Archives













© 2021   TechTarget, Inc.   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service