If you have learned temporal parallelism used to speed up CPU execution, you came across instruction pipelines aka pipeline processing. In pipeline processing, you will have many instructions in different stages of execution. The term "Data Pipeline" is a misnomer representing a high bandwidth communication channel used for data transportation between a source system and a destination. In certain cases the destination is called a sink. Pipelines by definition allow flow of a fluid…

Continue

You are familiar with the term data lake. A data lake is a repository used to store unlimited volume of data. These days, most of the cloud service providers allow us to host scalable data lakes for storing data as it arrives. For using these data lakes, it is not required to structure the data and we can run different types of applications on it. Usually they are applications for big data analytics and machine learning. These applications need entire data to be present in one data lake and… Continue

Given the rapid pace at which technology around has evolved, there are a lot of changes that companies these days must embrace. Perhaps the most significant, as well as the crucial difference in the context of technologies for business, is the move to the cloud. Yes, companies all over the world are moving their data along with their entire IT operations to the cloud, but why? More than a few reasons come to mind, starting with the most rudimentary benefits: Digital transformation. Cloud…

Continue

Quantum computers come in 2 varieties, quantum annealers and quantum gate models. So far, DWave is the only company selling quantum annealers.

A third type of device is now available from Fujitsu. Fujitsu calls its device a "quantum inspired digital annealer". The Fujitsu device does not have any quantum correlation (quantum entanglement)…

Continue

Emerging cloud applications like machine learning, AI and big data analytics require high performance computing systems that can sustain the increased amount of data processing without consuming excessive power. Towards this end, many cloud operators have started adopting heterogeneous infrastructures deploying hardware accelerators, like FPGAs, to increase the performance of computational intensive tasks. However, most hardware accelerators lack…

Continue

As stated in the last article, database obesity due to numerous intermediate tables and stored procedures is rooted in the closed computational system. If there is an independent computing engine providing computing capability independent of databases, then the latter can lose weight.

 

With a separate computing engine, the database-generated intermediate data doesn’t have to be stored as data tables; instead, it can be stored in the file system to be further computed…

Continue

Continue

I attended the Carrier Network Security Strategies conference ( #CNSS2015)held by Light Reading in NYC on Dec 2. I also attended the New Jersey Tech Council’s Data Summit (#NJTechCouncil) on Dec 9. The main topics of discussion in the conference were around securing the perimeter of networks and protecting customer, carrier and network data. Here is brief summary of what I learned in these two conferences about managing and operating networks securely and protecting…

Continue

Cloud data replication is good for backups, but what else might you do with it? For forward-looking users, data replication in the cloud is also a lever for better information, increased autonomy, enhanced productivity, and bigger business opportunities down the line. By conserving an untouched valid reference copy of data, users are free to process or change the other replicated instances, according to their individual…

Continue

By now you already know how important Big data processing and analytic is in running a lot of industries in the world. It is a multi-sector industry that helps manage big data, monitor trends, improve business operations, and even fight crimes. Big data is used in so many industries that it is considered as one of the most in demand skill this 2015.

But just like…

Continue

With immense growth in technology, financial institutes, skyscrapers and malls, one can find that the number of consumers have increased exponentially in the Middle East over the past few years. Reports suggests that 91% of the population comprises of expats in UAE enjoying high salaries and tax free benefits. 

Moreover, the options to spend your money have gotten bigger and better with UAE working towards the initiative to build Smart Cities setting strong infrastructure fundamentals…

Continue

To be short, in-memory computing takes advantage of physical memory, which is expected to process data much faster than disk. In-place, on the other hand, fully utilizes the address space of 64bit architecture. Both are gifts from the modern computer science; both are essences of the BigObject. 

In-place computing only becomes possible upon the introduction of 64bit architecture, whose address space is big enough to hold the entire data set for most of cases we are dealing with today.…

Continue

Hi all,

This is my first post here. I'm glad to introduce this newly launched big data analytic engine, the BigObject. In the past 2 years we have been working on an optimal approach to handle big data for analytic purposes and challenging the existed models, some assumptions of which are no longer valid. For example, as the data size grows so rapidly, is it still practical that we stick to the relational models neglecting the time spending in data retrievals? What impact did…

Continue

In a recent post of mine I had mentioned about the partnership between MapR and Canonical towards an initiative to make Hadoop available with Ubuntu natively through Ubuntu Partner Archive. Since, the package has been released now, I thought of showing how to get it done. Trust me it's really cool to install Hadoop…

Continue