Whether we know it or not, we use Natural Language Processing every day. It makes it easier for us to interact with computers and software and allows us to perform complex searches and tasks without the help of a programmer, developer or analyst.

In this, the last article in our three-article series we discuss Natural Language Processing and…

Business markets and competition are moving much more quickly these days and predicting, planning and forecasting is more important than ever. It is also important to ensure that every team member is a real asset to the organization and can contribute their knowledge and skill with full Insight into the effects and outcome of activities and processes and the ability to correct the course and make recommendations using clear, concise information. Advanced analytics is the…

How machines process and understand human language

Everything we express (either verbally or in written) carries huge amounts of information. The topic we choose, our tone, our selection of words, everything adds some type of information that can be interpreted and value extracted from it. In theory, we can understand and even predict human behaviour using that information.…

What is NLP?

Natural Language Processing (NLP) can be simply defined as teaching an algorithm to read and analyze human (natural) languages just like the human brain does, but a lot faster than a human could, more accurately and on very large amounts of data.

It is a great skill to have if you are an aspiring data scientist or data analyst because has…

Machine Learning / Deep Learning models can be used in different ways to do predictions. My preferred way is to deploy an analytic model directly into a stream processing application (like Kafka Streams or KSQL). You could e.g. use the …

Enterprises are learning fast about the relevance and use of AI and Cognitive Computing platforms. Before adopting AI and Cognitive Computing platforms, enterprises must focus on designing the right strategy for their business. A data-driven strategy is very important to derive the maximum benefit from the platform that will help to interpret data and provide accurate…

ABSTRACT

Image processing is a rapidly evolving field with immense significance in science and engineering. One of the latest

applications of Image processing is in Intelligent Character Recognition (ICR), that is the computer translation of

handwritten text into machine-readable and machine-editable…

In this series, I will talk about training a simple neural network on image data. To give a brief overview, neural networks is a kind of supervised learning. By this I mean, the model needs to train on historical data to understand the relationship between input variables and target variables. Once trained, the model can be used to predict target variable on new input data. In the previous posts, we have written about linear, lasso and ridge regression. All those methods come under…

Social media provide a low-cost alternative source for public health surveillance and health-related classification plays an important role to identify useful information. We summarized the recent classification methods using social media in public health. These methods rely on bag-of-words (BOW) model and have difficulty grasping the semantic meaning of texts. Unlike these methods, we present a word embedding based clustering method. Word embedding is one of the strongest trends in Natural…

Artificial Intelligence Overview

AI refers to ‘Artificial Intelligence’ which means making machines capable of performing intelligent tasks like human beings. AI performs automated tasks using intelligence.

The term Artificial Intelligence has two key components -

• Automation  
• Intelligence

For More…

Visual Analytics and Data Discovery allow analysis of big data sets to find insights and valuable information. This is much more than just classical Business Intelligence (BI). See this article for more details and motivation: "Using Visual Analytics to Make Better Decisions: the Death Pill Example". Let's take a look at important characteristics to choose the right tool for…

At the Data Science Association our members often complain about the major data engineering problem of finding the right tools and programming models to build both robust data processing pipelines and efficient ETL processes for data transformation and integration.…

Summary:…

Abstract

This article provides a full demo application using both the C# and R programming languages interchangeably to rapidly identify and cluster similar images.   The demo application includes a directory with 687 screenshots of webpages.  Many of these images are very similar with different domain names but near identical content.  Some images are only slightly similar with the sites using the same general layouts but different colors and different images on certain…

Hadoop is an open source framework for storing massive amounts of data on clusters of commodity hardware.



Haboob is a dense dust storm that moves fast…

We are witnessing a paradigm shift in Data Environment. In recent years, Big Data has risen on the technology horizons and is under the aspect of efficient and cost effective management and analysis of vast amounts of data for both public and private organizations. There are several organizations, which are trying to harness this continuing data stream, and in 2014, several of these organizations will go about making this data available in real time .

Any organization, that want to…

Natural language processing (NLP) involves machine learning, artificial intelligence, algorithms and linguistics related to interactions between computers and human languages. One important goal…

Batch data processing is an efficient way of processing high volumes of data is where a group of transactions is collected over a period of time. Data is collected, entered, processed and then the batch results are…