Lecture 1: Probability and Counting | Statistics 110

This is kind of a masters degree course i created for myself to get knowledge of Machine Learning from bottoms up First, you need a strong mathematical base. Otherwise, you can copy paste an algorithm or use an API but you will not get any idea of what is happening inside Following concepts are very essential 1) Linear Algebra (MIT [link] ) 2) Probability (Harvard [this video] ) Get some basic grasp of machine learning. Get a good intuition of basic concepts 1) Andrew Ng coursera course ( [link] ) 2) Tom Mitchell book ( [link] ) Both the above course and book are super easy to follow. You will get a good idea of basic concepts but they lack in depth. Now you should move to more intense books and courses You can get more in-depth knowledge of Machine learning from following sources 1)Nando machine learning course ( [link] ) 2)Bishops book ( [link] ) Especially Bishops book is really deep and covers almost all basic concepts. Now for recent advances in Deep learning. I will suggest two brilliant courses from Stanford 1) Vision ( [link] ) 2) NLP ( [link] ) The Vision course by Karparthy can be a very good introduction to Deep learning. Also, the mother book for deep learning ( [link] )is good

I recommend "Introduction to Probability" by Joseph K Blitzstein and Jessica Hwang. This book is tough. Really tough. However, you are really going to do "deliberate practice" while having a go on the assignments. It bothers me that the author does not provide the answer to most of the questions. This is specially bad in this field of Mathematics (Probability). As an example, in calculus you can always plot the curve, the derivative and see if the result makes sense, in probability theory it is hard to have a simple and safe sanity check. You can watch all classes from Harvard here for free: [this video] If you want, there is also a MOOC in EdX with the same material: [link] Sheldon Ross' book is also a good one. It was mentioned here. I specially like the section on theoritical problems, only with exercises on proofs. Every chapter has one. However, Joe Blitzstein problems are more challenging and will train you more on intuition.