Spring 2019: MA 59800 Mathematical Aspects of Neural Networks
Instructor: Greg Buzzard

Resources

The list of papers for presentations has some relevant papers. There are many more in this annotated bibliography.

Here are some additional textbooks and other references:

• Deep Learning Tutorial. Tutorial with code using Theano
• A Brief Introduction to Neural Networks, David Kriesel. Includes history, theory, and practice.
• Deep learning in neural networks: An overview, Jürgen Schmidhuber. The author's web page includes lots of history and references.
• Understanding Machine Learning: From Theory to Algorithms
• Stanford CS 231n, Spring 2018
• Andrew Ng's Machine learning course on Coursera

There are many more resources available online.