Subscribe to DSC Newsletter

All Blog Posts Tagged 'RNN' (11)

The Coming Revolution in Recurrent Neural Nets (RNNs)

Summary: Recurrent Neural Nets (RNNs) are at the core of the most common AI applications in use today but we are rapidly recognizing broad time series problem types where they don’t fit well.  Several alternatives are already in use and one that’s just been introduced, ODE net is a radical departure from our way of thinking about the solution.

 …

Continue

Added by William Vorhies on March 11, 2019 at 7:30am — No Comments

Combining CNNs and RNNs – Crazy or Genius?

Summary: There are some interesting use cases where combining CNNs and RNN/LSTMs seems to make sense and a number of researchers pursuing this.  However, the latest trends in CNNs may make this obsolete.

 

There are things that just don’t seem to go together.  Take oil and water for instance.  Both valuable, but try putting…

Continue

Added by William Vorhies on August 14, 2018 at 7:34am — 3 Comments

Temporal Convolutional Nets (TCNs) Take Over from RNNs for NLP Predictions

Summary: Our starting assumption that sequence problems (language, speech, and others) are the natural domain of RNNs is being challenged.  Temporal Convolutional Nets (TCNs) which are our workhorse CNNs with a few new features are outperforming RNNs on major applications today.  Looks like RNNs may well be history.

 …

Continue

Added by William Vorhies on May 1, 2018 at 7:29am — 1 Comment

Transfer Learning –Deep Learning for Everyone

Summary: Deep Learning, based on deep neural nets is launching a thousand ventures but leaving tens of thousands behind.  Transfer Learning (TL), a method of reusing previously trained deep neural nets promises to make these applications available to everyone, even those with very little labeled data.

 

Deep Learning, based on…

Continue

Added by William Vorhies on April 17, 2018 at 12:25pm — No Comments

Automated Deep Learning – So Simple Anyone Can Do It

Summary:  There are several things holding back our use of deep learning methods and chief among them is that they are complicated and hard.  Now there are three platforms that offer Automated Deep Learning (ADL) so simple that almost anyone can do it.

 

There are several things holding back our use of deep learning methods and…

Continue

Added by William Vorhies on April 10, 2018 at 8:18am — 1 Comment

Machine Learning – Can We Please Just Agree What This Means

Summary:  As a profession we do a pretty poor job of agreeing on good naming conventions for really important parts of our professional lives.  “Machine Learning” is just the most recent case in point.  It’s had a perfectly good definition for a very long time, but now the deep learning folks are trying to hijack the term.  Come on folks.  Let’s make up our minds.

 

As a profession we do a pretty poor job of agreeing on good naming conventions…

Continue

Added by William Vorhies on December 4, 2017 at 3:30pm — 5 Comments

The Three Way Race to the Future of AI. Quantum vs. Neuromorphic vs. High Performance Computing

Summary:  There’s a three way technology race to bring faster, easier, cheaper, and smarter AI.  High Performance Computing is available today but so are new commercial versions of actual Quantum computers and Neuromorphic Spiking Neural Nets.  These two new entrants are going to revolutionize AI and deep learning starting now.

 …

Continue

Added by William Vorhies on November 14, 2017 at 8:07am — 4 Comments

Will Our Robots Harm Us?

Summary:  We are approaching a time when we need to be concerned that our AI robots may indeed harm us.  The rapid increase in the conversation about what ethics should apply to AI is appropriate but needs to be focused on the real threats, not just the wild imaginings of the popular press.  Here are some data points to help you in thinking about this, what our concerns should be today, and what our concerns should be in the future.

 …

Continue

Added by William Vorhies on October 24, 2017 at 9:26am — No Comments

Has Deep Learning Made Traditional Machine Learning Irrelevant?

Summary:  The data science press is so dominated by articles on AI and Deep Learning that it has led some folks to wonder whether Deep Learning has made traditional machine learning irrelevant.  Here we explore both sides of that argument.

 

On Quora the other day I saw a question from an aspiring data scientist that asked – since all the…

Continue

Added by William Vorhies on December 13, 2016 at 9:24am — 4 Comments

Recurrent Neural Nets – The Third and Least Appreciated Leg of the AI Stool

Summary:  Convolutional Neural Nets are getting all the press but it’s Recurrent Neural Nets that are the real workhorse of this generation of AI.

 We’ve paid a lot of attention lately to Convolutional Neural Nets…

Continue

Added by William Vorhies on October 24, 2016 at 3:53pm — No Comments

More on 3rd Generation Spiking Neural Nets

Summary:  Here’s some background on how 3rd generation Spiking Neural Nets are progressing and news about a first commercial rollout.

 

Recently we wrote about the development of AI and neural nets beyond the second generation Convolutional and Recurrent Neural Nets (CNNs / RNNs) which have come on so strong and dominate the…

Continue

Added by William Vorhies on October 18, 2016 at 8:04am — 1 Comment

Monthly Archives

2019

2018

2017

2016

2015

2014

2013

2012

2011

1999

Videos

  • Add Videos
  • View All

© 2019   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service