Subscribe to DSC Newsletter

All Blog Posts Tagged 'Big' (282)

Top libraries for Distributed Deep Learning

The performance of the neural network improves with an increasing volume of training data. With more and more devices generating data that can potentially be used for training and model generation, the models are getting better at generalizing the stochastic environment and handling complex tasks. However, with more data and more complex structures for the deep neural networks, the computational requirements increase.

Even though we have started leveraging GPUs for deep neural network…

Continue

Added by Packt Publishing on June 13, 2018 at 12:30am — No Comments

Big Data and Cyber Security - A double whammy for hackers

Businesses are growing more digitized today. As this happens, cybersecurity threats are rising as well. Companies are placed at an increasing risk, which is why they need help from big data analysis. In fact, KuppingerCole conducted a study entitled “Big Data and Information Security.” study looks in-depth at current deployment levels and the benefits of big data…

Continue

Added by Evan Morris on May 15, 2018 at 8:30pm — 1 Comment

Deep Learning Infrastructure for Extreme Scale with 
the Apache Kafka Open Source Ecosystem

I had a new talk presented at "Codemotion Amsterdam 2018" this week. I discussed the relation of Apache Kafka and Machine Learning to build a Machine Learning infrastructure for extreme scale.

Long version of the title:

"Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Source Ecosystem - How to Build a Machine Learning Infrastructure with Kafka, Connect, Streams, KSQL, etc."

As always, I want to share the slide deck. The talk was…

Continue

Added by Kai Waehner on May 8, 2018 at 9:30pm — No Comments

Open Source ETL: Apache NiFi vs Streamsets

After reviewing 8 great ETL tools for fast-growing startups, we got a request to tell you more about open source solutions.There are many open source ETL tools and frameworks, but most of them require writing code.…

Continue

Added by Luba Belokon on April 26, 2018 at 2:30am — No Comments

GDPR Drives Real Time Analytics

New reforms under the General Data Protection Regulation (GDPR) started as an attempt to standardize data protection regulations in 2012. The European Union intends to make Europe “fit for the digital age.” It took four years to finalize the agreements and…

Continue

Added by Ronald van Loon on March 26, 2018 at 10:30pm — 1 Comment

How State Governments Can Protect and Win with Big Data, AI and Privacy

I was recently asked to conduct a 2-hour workshop for the State of California Senior Legislators on the topic of “Big Data, Artificial Intelligence and Privacy.” Honored by the privilege of offering my perspective on these critical topics, I shared with my home-state legislators how significant opportunities await the state. I reviewed the once-in-a-generation opportunities awaiting the great State of California (“the State”), where decision makers could vastly…

Continue

Added by Bill Schmarzo on February 13, 2018 at 5:30am — No Comments

Analyzing Geographic Data with QGIS - Part 1

Today I'm writing this post to explain how it's possible to make geographic analysis and answer questions like: which is the richest area in my city? How many people do live in one neighborhood? 

You can do it combining shape files with an excel spreadsheet, let's understand it together...

First of all, we need to install one Geographic Information System (GIS), and I recommend QGIS - free and open source GIS

Then,…

Continue

Added by Thiago Buselato Maurício on February 11, 2018 at 9:30am — No Comments

Predict - Prescribe - Prevent: Analytics Value Cycle

Organizations looking for justification to move beyond legacy reporting should review this little ditty from the healthcare industry:

The Institute of Medicine (IOM) estimates that the United States loses $750 billion annually to medical fraud, inefficiencies, and other siphons in the healthcare system…

Continue

Added by Bill Schmarzo on January 26, 2018 at 1:30pm — No Comments

Big Data Isn’t a Thing; Big Data is a State of Mind

“Big Data is dead.” “Big Data is passé.”

“We no longer need Big Data; we need Machine Learning now.”

As we end 2017 and look forward to big (data) things in 2018, the most important lessons of 2017 – in fact, maybe the most important lesson going forward – is that Big Data is NOT a thing. Big Data isn’t about the volume, variety or velocity of data any more than car…

Continue

Added by Bill Schmarzo on January 20, 2018 at 5:30am — No Comments

Lessons in Becoming an Effective Data Scientist

I was recently a guest lecturer at the University of California Berkeley Extension in San Francisco. On a lovely Saturday afternoon, the classroom was crowded with students of all ages learning the tools of the modern economy. The craftspeople of the “Analytics Revolution” were busy learning new skills and tools that will prepare them for this Brave New World of analytics. I was blown away by their dedication!

As we teach the next generation, it’s important…

Continue

Added by Bill Schmarzo on January 19, 2018 at 5:00am — 4 Comments

Avoiding the IOT ‘Twister’ Business Strategy

Most organizations’ IOT Strategy look like a game of ‘Twister’ with progress across important IOT capabilities such as architecture, technology, data, analytics and governance; variables comprising a series of random investments and decisions.…

Continue

Added by Bill Schmarzo on January 13, 2018 at 5:00am — No Comments

From social media to public health surveillance: Word embedding based clustering method for twitter classification

Social media provide a low-cost alternative source for public health surveillance and health-related classification plays an important role to identify useful information. We summarized the recent classification methods using social media in public health. These methods rely on bag-of-words (BOW) model and have difficulty grasping the semantic meaning of texts. Unlike these methods, we present a word embedding based clustering method. Word embedding is one of the strongest trends in Natural…

Continue

Added by CD on January 4, 2018 at 10:30am — 1 Comment

The Difference between Data Scientists, Data Engineers, Statisticians, and Software Engineers

Finding out the difference between data scientists, data engineers, software engineers, and statisticians can be confusing and complicated. While all of them are linked to data in a way, there is an underlying difference between the work they do and manage. 

The growth of data  and its usage across…

Continue

Added by Ronald van Loon on December 19, 2017 at 1:00am — 1 Comment

How to Create a Smart City with IoT and Big Data

These days, it seems like every city is trying to implement “smart” initiatives. Take Singapore for example, now known for the most extensive effort to collect data on citizens’ daily living habits/routines ever attempted by a municipality. Even Bill Gates has pumped millions of dollars into helping Phoenix in their smart city efforts.

But what do we mean when we talk about a “smart city”? Is it the better use of resources within the city center, or the fact that all resources being…

Continue

Added by Ronald van Loon on December 8, 2017 at 1:30am — No Comments

Using Data Analytics to Prevent, Not Just Report

I recently had another client conversation about optimizing their data warehouse and Business Intelligence (BI) environment. The client had lots of pride in their existing data warehouse and business intelligence accomplishments, and rightfully so. The heart of the conversation was about taking costs out of their reporting environments by consolidating runaway data marts and “spreadmarts,” and improving business analyst BI…

Continue

Added by Bill Schmarzo on November 18, 2017 at 7:00am — No Comments

The 3 Phases of Digital Transformation

The research firm Technology Business Research (TBR) recently came out with a report titled, “Winning The Business Of Digital Transformation Services Requires A Process-Led Approach” authored by Sebastian Lagana and Jennifer Hamel. The report is full of good nuggets, but I especially liked the way that they categorized the 3 phases of Digital Transformation:

  • Substitution represents basic IT modernization; such as leveraging new…
Continue

Added by Bill Schmarzo on November 12, 2017 at 5:00am — No Comments

Hacking the Autonomous Vehicle

I love it when I get feedback from a blog that I’ve written. I appreciate the different perspectives and insights that others bring to a topic of interest. 

The section of the blog that fueled the most comments stem from a scene in the movie I, Robot where Detective Spooner (played by Will Smith) is explaining to Doctor Calvin (who is responsible for giving robots human-like behaviors) why he distrusts and hates robots. He is describing an incident…

Continue

Added by Bill Schmarzo on November 5, 2017 at 1:30pm — No Comments

Artificial Intelligence, Globalization and International Basketball

A strong declaration from a historically antagonist foe should put chills in the hearts of Americans preparing themselves for the world ahead: Russian President Vladimir Putin says the nation that leads in AI will be the ruler of the world  … The ruler of the world!

From the article (with some modification to avoid political landmines), we get the following:

“The development of artificial intelligence has increasingly become a national security…

Continue

Added by Bill Schmarzo on November 4, 2017 at 6:00am — No Comments

How Big Data can Help Community Banks

Big Data tools not only simplify lengthy analytical procedures in any industry, but they also provide a competitive advantage to banks. With new regulations, banks are looking at ways to make compliance procedures more effective and accurate. Big Data in banking is slowly gaining momentum and becoming an inevitable necessity across the banking industry. As traditional…

Continue

Added by Deena Zaidi on November 2, 2017 at 11:00am — No Comments

3 Theorems on the Economic Value of Data

Since releasing the University of San Francisco research paper on “How to Determine the Economic Value of Your Data” (EvD), I have had numerous conversations with senior executives about the business and technology ramifications of EvD. Now with the release of Doug Laney’s “Infonomics” book that builds upon Doug’s EvD work at Gartner, I expect these conversations to intensify. In fact, I just traveled to Switzerland to discuss the potential business and technology…

Continue

Added by Bill Schmarzo on November 1, 2017 at 11:00am — 4 Comments

Monthly Archives

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

1999

Videos

  • Add Videos
  • View All

© 2020   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service