Practice of Deep Learning
1. Introduction
2. Optimization
3. Supervised Learning
4. Regularization
5. Normalization
6. Initialization
6.1 Motivation
6.2 Effect on training Dynamics
6.3 Common initialization schemes
6.4 Initializing parameters in Pytorch
7. Hyperparameters Searching
7.1 Motivation
7.2 Methods