While Deep Neural Nets are the state of the art in machine learning, the flipside is that they are really hard to train. Up until 2006, there was no way to train them satisfactorily. Here is a clip that explains further.