Michael Nielsen provides a visual demonstration in his web book Neural Networks and Deep Learning that a 1-layer deep neural network can match any function . It is just a matter of the number of neurons to get a prediction that is arbitrarily close – the more the neurons the better the approximation.  There is the Universal Approximation Theorem as well that supplies a rigorous proof of the same.But the known issues…