Subscribe to DSC Newsletter

All Blog Posts (6,673)


As the possibilities at the intersect of M2M+Big Data gets unlocked its very important to examine the economics underlying the use cases
So the core questions becomes…

Added by derick.jose on July 20, 2013 at 6:37am — 4 Comments

Botnets in the cloud: the new generation of spammers

Big data and data science is not just for good guys. If properly leveraged, it also provides competitive advantages for criminals, over their competitors, or to avoid detection.…


Added by Vincent Granville on July 17, 2013 at 10:00am — 1 Comment

Demand for Data Scientists and the Datification of Business

Source: EMC2 Survey.

You cannot improve and manage what you cannot…

Added by Michael Walker on July 16, 2013 at 1:00pm — 2 Comments

IBM 4690 Supermarket Application Transaction Data

Good day folks,

I'm conducting a data analytics project for a small supermarket and the IT guy sent me a file (.db0 extension) of their transaction details, but I'm unable to read it.  Apparently it comes from the IBM 4690 Supermarket Application controller.  I've done internet searches and nothing helpful comes up.  The guy that sent it to me said he has never had to convert or read it into CSV or any other file format, so he can't provide any assistance.  Can anyone help?…


Added by Bert Riley on July 16, 2013 at 6:42am — 2 Comments

Big Data on the Big Data Conversation: Tracking the NSA Story

By Nicholas Hartman, Director

Recent revelations regarding the National Security Agency's (NSA) extensive data interception and monitoring practices (aka PRISM) have brought a branch of "Big Data's" research into the broader public light. The basic premise of such work is that computer algorithms can study…


Added by Nicholas Hartman on July 15, 2013 at 8:51am — No Comments

8 M2M Big Data Use cases in Building Management Systems

As the internet of things explodes, the building management industry is ripe for disruption from sensor data.Here are a 8 specific big data use cases which are at the intersect of M2M Analytics + Big Data + Building Management Systems. Please click for details about each use case…


Added by derick.jose on July 12, 2013 at 8:27pm — No Comments

Weekly digest - July 15

Featured Articles


Added by Vincent Granville on July 11, 2013 at 6:30pm — No Comments

Rapid hadoop development with progressive testing

Debugging Hadoop jobs can be a huge pain.  The cycle time is slow, and error messages are often uninformative --- especially if you're using Hadoop streaming, or working on EMR.

I once found myself trying to debug a job that took a full six hours to fail.  It took more than a week -- a whole week! -- to find and fix the problem.  Of course, I was doing other things at the same time, but the need to constantly check up on the status of the job was a huge drain on my energy and…


Added by Abe Gong on July 10, 2013 at 10:47am — 1 Comment

Data Science Summer Reading List 2013

Machine Learning: A Probabilistic Perspective, by Kevin Murphy.

Boosting: Foundations and Algorithms, by Robert E. Schapire.

Models Behaving Badly: Why Confusing Illusion with Reality Can Lead to Disaster, by Emanuel Derman.

Doing Data Science, by Cathy O'Neil and Rachel…


Added by Michael Walker on July 9, 2013 at 3:00pm — 1 Comment

Information Singularity and the Principles of the Analytics Rock Star

Recently, Bernard Wehbe at StatSlice Systems wrote an intriguing and thought-provoking whitepaper on information singularity and the principles of the analytics rock star. 

Successful analytics professionals should follow a set of guiding principles which are very important and often missed by traditional…


Added by Jared Decker on July 9, 2013 at 8:23am — No Comments

Interesting database questions

I am not an expert in database design, since most of my career I have worked with alternate data storage / data access solutions. But one of the very first projects I had to do back in 1985 when I was a student was to write the code for a fully functional database architecture, in Pascal, from scratch. You will probably find some of my questions naive, and some intriguing.…


Added by Vincent Granville on July 8, 2013 at 2:00pm — 11 Comments

Big Data and Meaningful Storage Metrics

Big data has the potential to alter the calculus by which data management groups buy, manage, and structure information storage. 

Article originally published on TDWI, by Stephen…


Added by Vincent Granville on July 8, 2013 at 1:00pm — No Comments

Big Data Applications to Financial Instituions

Would be interested to know who and where the major research into applying Big Data to FI marketing and risk management is talking place. Thanks.

Added by Dean Ozanne on July 5, 2013 at 7:42am — No Comments

wind power economics, check out the bidding profile of wind power generators

electricity Analytics

using large datasets from PJM, R , javascipt , we have provided

a categorical data representation of the bidding pattern followed by wind power generators.

please provide feedback.


Parag Patil


KW Energy 

Added by Parag Patil on July 3, 2013 at 7:15am — No Comments

Data Scientists vs. Data Engineers

More and more frequently we see organizations make the mistake of mixing and confusing team roles on a data science or "big data" project - resulting in over-allocation of responsibilities assigned to …

Added by Michael Walker on July 2, 2013 at 12:01pm — 9 Comments

The Data Scientist: Elusive or Illusive?

Excitement around Big Data has significantly increased the demand for data scientists. This hot position has been hailed as the "Sexiest Job of the 21st Century" by the Harvard Business Review.

When we started in the advanced analytics space we didn't use the term 'data scientist.' We were more focused on solving problems than defining a job description. Our initial teams have evolved and adapted to challenges through hands-on experience to find…


Added by Nicholas Hartman on July 2, 2013 at 12:00pm — 4 Comments

M2M + Big Data Analytics = Unlocking Blue Ocean Opportunities at the intersect

M2M + Big Data Analytics = Unlocking Blue Ocean Opportunities at the intersect

When human beings got connected, it unlocked a whole new set of possibilities and companies like facebook, linkedin etc came up with solutions which had never been there before.

The ability of machines to interact with each other promises to unlock a whole new set of opportunities unprecedented in our history

What are some real life examples of M2M…


Added by derick.jose on July 1, 2013 at 5:40am — 1 Comment

Hello, BigData World !

Hello, everybody,

    I am excited to find this nice website. I'm an engineer focusing on BigData ( Hadoop/Hive/HBase/Spark/Shark etc) . I found a lot of resource in this website. I'd like to learn more and share with others here.

Added by Zhu Guangbin on June 28, 2013 at 8:38pm — No Comments

How do school ratings correlate with home prices?

This could be a good project in connection with our data science apprenticeship. Two websites, and provide two great indicators: school scores for more than 100,000 schools…


Added by Vincent Granville on June 28, 2013 at 8:00pm — No Comments

Blog Topics by Tags

Monthly Archives












  • Add Videos
  • View All

© 2019   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service