Deep Learning

Machine Learning Neural Networks

Overview

Neural network architectures, optimization, and training techniques.

Gradients in Math and Code

Normalization in Deep Learning

• Layer Normalization
• Root Mean Square Layer Normalization

Positional Encodings in Deep Learning

Optimization in Deep Learning