Many businesses are feeling the pressures of data overload. Consequently, many businesses have databases that look like the picture below.
Businesses are stockpiling more data than ever before. From machine-generated data, social sentiment, transactional data, and emails, many companies feel as if they are drowning in data. According to a report by the…Continue
Added by Larisa Bedgood on May 5, 2015 at 9:39am — No Comments
If you’re planning on a data driven approach, you’re going to need data, most likely from a nice mix of sources that will give you the right amount of insight you need to make it worthwhile.
But if you’re not careful, you can quickly spend a lot of money getting it whether it’s “free” or not. Because as much as we’d like it to be, most of it is definitely not free, even if it is on an open and…
Added by Anne Russell on May 3, 2015 at 12:14pm — No Comments
"Measurement owes its existence to Earth; estimation of quantity to measurement; calculation to estimation of quantity; balancing of chances to calculation; and victory to balancing of chances." - Sun Tzu, The Art of War (Translated by L. Giles)
The quote from Sun Tzu seems to suggest how a military leader gathers data; adapts to different situations; and makes decisions weighing the circumstances. It says that the balancing of chances depends on "calculation." I…Continue
I made a recent discovery that I would like to share with the community. In my previous blog, I introduced a special algorithmic shell that distributes stocks based on their price movements (along the x-axis) and volume movements (y-axis). Using this shell, it is possible to visualize the trading behaviours of dozens of stocks simultaneously. I noticed one day that the stocks seemed to be lining up in formation. I decided to test the accuracy of my visual interpretation. Below I present the…Continue
Added by Don Philip Faithful on March 22, 2015 at 5:22am — No Comments
I took only a single biology course during my years in university. My environmental toxicology professor explained that when testing for the LD50 (the dose that kills 50 percent of a population) a certain percentage will probably die right away; on the other hand, some might be able to tolerate unusually high exposure levels. There is a distribution of responses. A related principle applies to stress. People respond differently to stress: some might flee from their stressors (avoid or evade)…Continue
Added by Don Philip Faithful on March 7, 2015 at 6:34am — No Comments
Try introducing yourself as a Competitive Intelligence or CI analyst. Chances are that the reactions will range from (a) That's what you do all day, Google search? to (b) Identifying 007 ways to look at competition, Corporate Bond?
Of course, one can always resort to the classical definition of CI. It is defined as the action of defining, gathering, analyzing,and distributing intelligence about products, customers,…Continue
I am a newbie to Bigdata and would like to highlight some significant advantages if incorporated in a company's supply-chain management strategies, expecting the reader's views and suggestions.
Because, in recent past I have developed a online supply-chain management systems in which sellers and customers are matched using an algorithm. It acted as a decision support system and I needed to dig deeper on the available data to get more insights over the data pattern (even for…Continue
When I read a blog, I often find myself in deep thought as I approach the end, trying to determine if the author has said anything that I might be able to use. A blog doesn't have to say anything. Nor does it have to be useful to me specifically. It might simply offer a personal reflection on life. As a person who also writes blogs, I…Continue
Added by Don Philip Faithful on January 3, 2015 at 8:16am — No Comments
Before elaborating on my fruitless existence - about my decision to avoid fruit - I want to emphasize how this blog is actually about something that I call the "Fallacy of Rational Prerequisite." There will be some misunderstanding about this term even after my prolonged explanation. I just want to state plainly at the outset that I am not proposing that people become irrational. If they are already so, I am not suggesting that they further the situation.…Continue
Added by Don Philip Faithful on December 20, 2014 at 8:21am — No Comments
Trying to deploy a pervasive analytics strategy for your entire organization, or even a department, is not an easy task. That being said, changing the way people work has never been an easy task, imagine cloud computing 15 years ago. Until the average employee can physically see how this new technology can change their live for the better, there is always friction in adoption because of traditional habits. This friction is why organizations need to make sure they have a well…Continue
Added by TJ Laher on November 25, 2014 at 8:00am — No Comments
Thermometers and scales to measure weight appeared in retail outlets long ago. Blood pressure monitors perhaps came later. Pedometers and heart-rate monitors seem more recent - possibly closer to my time. I saw several devices while doing this blog intended to electronically record among other things hours of sleep; these are designed to be worn on the body all the time. A couple of weeks ago, I bought something to give the heart rate and blood oxygen saturation level. I consider it a real…Continue
Added by Don Philip Faithful on November 8, 2014 at 9:18am — No Comments
Given the nature of the community, presumably many visitors already have a strong understanding of the nature of quantitative data. Perhaps more mysterious is the idea of qualitative data especially since it can sometimes be expressed in quantitative terms. For instance, "stress" as an internal response to an externality differs from person to person; yet it would be possible to canvas a large number of people and express stress levels as an aggregate based on a perceptual gradient: minimal,…Continue
Added by Don Philip Faithful on October 25, 2014 at 6:37am — No Comments
Being the son of a mechanic, I have spent many years handling power tools. I'm especially fond of a couple of hammer-drills in my possession. They can effortlessly drill holes through concrete. At least, this is what my father once claimed. He handed down his most treasured tools to me. I'm big on pliers and screwdrivers. This might be due to my vocational training as a technician. Even today - long after I completed my diploma and continued to further my education - I still carry a licence…Continue
Added by Don Philip Faithful on September 27, 2014 at 7:39am — No Comments
This blog is about the peculiar nature in which software sometimes gets developed. I hope that many readers will recognize the relevance of data science in the examples taken from my own projects. I propose that development is the product of creativity more than accreditation. Creativity is something complicated that interacts with a person over his or her life circumstances. Many people know how to write . . . sentences and paragraphs. However, the ability to write well does not necessarily…Continue
Added by Don Philip Faithful on August 30, 2014 at 8:59am — No Comments
Many years ago, I attended a vocational college to learn skilled trade. I was taught about the behaviour of systems. I learned that after renovations to a house, the furnace might cycle on and off more frequently; this can leave some parts of the house too cold. A wood-burning stove or fireplace should be treated as a part of a system. Open doors and windows in the dwelling can cause exhaust from such appliances to enter living spaces. I realize that these particular examples of systems…Continue
Added by Don Philip Faithful on August 16, 2014 at 8:31am — No Comments
In this blog, I will explain how an approach to handle small amounts data can be reconstructed to handle much larger amounts. This reconstruction is the product of an anomalous perspective or mutation relating to the attribution of performance.
Many businesses share certain common features.…Continue
Added by Don Philip Faithful on August 1, 2014 at 6:21am — No Comments
The role of statistics in data science is often debated. Despite rapid developments in technology giving access to algorithmically sophisticated approaches, I feel that statistics can still provide many worthwhile insights. If I have a database of sales figures spanning many years, I feel that I can become more aware of historic trends and seasonal patterns through the use of statistics. Statistics offers a sense of state, direction, pace, and progress. Statistics can also enable estimation…Continue
Added by Don Philip Faithful on July 19, 2014 at 7:57am — No Comments
Somebody once mentioned to me that there is a need for a standard method of performance evaluation that can be applied to all employees regardless of their exact duties: e.g. to compare a janitor to an accountant. In my jurisdiction, there is a regulatory requirement for "equal pay for work of equal value" that can affect companies with government contracts. I consider the concept of "equal value" complicated due to its subjective nature. Certainly two people handling exactly the same work…Continue
Added by Don Philip Faithful on July 5, 2014 at 7:31am — No Comments
A few semesters into my undergraduate studies, I decided to move away from campus in order to escape the incessant party atmosphere. I chose to rent an old but roomy apartment in Kitchener, Ontario. I read somewhere that this city was formerly called New Munich. One day in the dead of morning, I heard loud banging and smashing downstairs. It seemed that neither I nor my cat could sleep, so I went to investigate. I saw the owner of the building at the front entrance of the apartment holding a…Continue
Added by Don Philip Faithful on June 21, 2014 at 6:27am — No Comments