COSC 78 Deep Learning
This course provides an introduction to deep learning, a methodology to train hierarchical machine learning models using large collections of examples. Deep learning is a special form of machine learning where rich data representations are simultaneously learned with the model, thus eliminating the need to engineer features by hand.
The course begins with a comprehensive study of feedforward neural networks, which are the model of choice for most hierarchical representation learning algorithms. Other models covered in this course include convolutional neural networks, restricted Boltzmann machines, autoencoders, sparse codes. Several lectures are devoted to discuss strategies to improve the bias-variance tradeoff, such as regularization, data augmentation, pre-training, dropout, and multi-task learning. The course also studies modern applications of deep learning, such as image categorization, speech recognition, and natural language processing.