Subscribe to DSC Newsletter

# ML Math Skills

Hi,

I am teaching myself ML for fun.

I am going through the Deep Learning book by Goodfell, Bengio and Courville.  Must must admit they lost me on chapter 2 page.

Any suggestions how to get over this part?  Any youtube videos, or books that might help out getting over through this?  Thanks.

Views: 8456

### Replies to This Discussion

You may want to take a course in Linear Algebra before getting into ML.  It won't make a lot of sense unless you have a basic understanding of matrices.

A good starting point would be https://www.coursera.org/learn/datasciencemathskills also this one doesn't cover matrices as far as I remember. Andrew NG's Machine Learning course (https://www.coursera.org/learn/machine-learning/home/week/1) also has a linear algebra section in week 1 to refresh your knowledge.

There are really some great books  I love Mathematics - From the Birth of Numbers which is brilliant in that you get great scope & history. Also I highly value Schaum's outlines series : Linear Algebra (Fully solved problems) walks you thru certain problems and how to solve, then gives you problems to solve, you give it a spin and the answers are provided so you can verify accordingly. I think we also have to give a shout out to the for Dummies series which are are written be great people with great imaginations to convey a thought process in a fun manner.

Get the the library and have some fun !

Greetings Frederick,

What the product operation line is saying (equation 2.5) is the cell C_{i,j} is defined as the dot product of A's row i and B's column j.

A How To video is Intro to matrix multiplication (video) | Khan Academy. This is just the tip of the iceberg for linear algebra. As other commentators noted, a refreshing class on linear algebra might be helpful.

For a mathematical reason why the definition of matrix multiplication is the way it is, see https://math.stackexchange.com/questions/271927/why-historically-do...

I'd suggest some background in machine learning and neural networks before you start reading the book.

1) Linear algebra is a must have!
2) Look into the history of neural networks. Start with perceptron and feed forward network with 1 hidden layer before you move onto other architectures - they are fancy, but learning the limitations of perceptron, feed forward networks will truly inspire you to read more.
3) Learn how to interpret weights of neural networks. Hidden layer weights may seem insignificant, but they tell you exactly what/how the network learns.

IMHO these 3 are necessary to understand why other architectures are required and the type of problems that each architecture can solve. I admit that deep learning is a beast, but it can be tamed by using a systematic approach. Ideally, go through a course on deep learning (there are many in YouTube) and use the book as primary reference material.

Matrix product is basic to understand ML. I think this may help you to visualize what is happening. In addition, follow the suggestion given in above comments.

Here is what I recommend when I'm mentoring and had good success with it

Ian GoodFellow is fairly advanced.

I would suggest you start with Grokking Deep Learning by Andrew Trask.
This book has the lowest barrier to entry possible in author's own words and I can attest he has achieved his mission.
https://www.manning.com/books/grokking-deep-learning
He breaks down all the concepts into extremely small and simple Intuition.
you will be doing Gradient Descent & Back Propagation in your sleep :)

After that, I would read Deep Learning with Python by François Chollet, creator of Keras
https://www.manning.com/books/deep-learning-with-python
Now you will be armed with DNN, ConvNet, RNN, GAN, and ML(Linear Regression, Logistic &  Kernel Methods).

For Math, here are some resources I'm listing in relevance to Deep Learning
https://courses.edx.org/courses/course-v1:Microsoft+DAT256x+1T2018a...
https://www.khanacademy.org/math/linear-algebra
https://www.khanacademy.org/math/multivariable-calculus

You can spend years teaching yourself math, statistics, ML and DL. Pick a simple project and learn these concepts as a means, your learning will go far.

Good Luck!

Exactly. I was also stuck. It just shows the poor skills these professors have in writing textbooks. We have to think about newer technologies. One good example is there. 3Blue1Brown

thanks

Anil Kumar said:

Here is what I recommend when I'm mentoring and had good success with it

Ian GoodFellow is fairly advanced.

I would suggest you start with Grokking Deep Learning by Andrew Trask.
This book has the lowest barrier to entry possible in author's own words and I can attest he has achieved his mission.
https://www.manning.com/books/grokking-deep-learning
He breaks down all the concepts into extremely small and simple Intuition.
you will be doing Gradient Descent & Back Propagation in your sleep :)

After that, I would read Deep Learning with Python by François Chollet, creator of Keras
https://www.manning.com/books/deep-learning-with-python
Now you will be armed with DNN, ConvNet, RNN, GAN, and ML(Linear Regression, Logistic &  Kernel Methods).

For Math, here are some resources I'm listing in relevance to Deep Learning
https://courses.edx.org/courses/course-v1:Microsoft+DAT256x+1T2018a...
https://www.khanacademy.org/math/linear-algebra
https://www.khanacademy.org/math/multivariable-calculus

You can spend years teaching yourself math, statistics, ML and DL. Pick a simple project and learn these concepts as a means, your learning will go far.

Good Luck!

I am in the same boat. Do I started linear algebra from MIT Open Courseware's Linear algebra course by Prof Strang.

## Videos

• ### DSC Webinar Series: How to Use Time Series Data to Forecast at Scale

Added by Tim Matteson

• ### DSC Webinar Series: Why Data Prep is Step 1 for Analytics Success

Added by Tim Matteson

• ### DSC Webinar Series: 9 Best Practices for Data Blending

Added by Tim Matteson

• Add Videos
• View All

© 2019   Data Science Central ®   Powered by